惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

Recent Announcements
Recent Announcements
J
Java Code Geeks
U
Unit 42
GbyAI
GbyAI
大猫的无限游戏
大猫的无限游戏
L
LangChain Blog
D
Docker
F
Fortinet All Blogs
N
Netflix TechBlog - Medium
钛媒体:引领未来商业与生活新知
钛媒体:引领未来商业与生活新知
罗磊的独立博客
I
InfoQ
The Cloudflare Blog
小众软件
小众软件
V
Visual Studio Blog
OSCHINA 社区最新新闻
OSCHINA 社区最新新闻
Engineering at Meta
Engineering at Meta
S
SegmentFault 最新的问题
爱范儿
爱范儿
Hugging Face - Blog
Hugging Face - Blog
P
Proofpoint News Feed
V
V2EX
月光博客
月光博客
Martin Fowler
Martin Fowler

AI Alignment Forum

[Paper] Stringological sequence prediction III — AI Alignment Forum A Defense of Gradual Disempowerment — AI Alignment Forum Shallow Beliefs: Midtraining does not inoculate against EM from reward hacking — AI Alignment Forum Op-Ed: I Worked at Google DeepMind. You Should Listen to the Warnings About AI — AI Alignment Forum CoT controllability evals seem very under-elicited — AI Alignment Forum An operationalization of opaque serial depth — AI Alignment Forum Proposal for tracking the effects of architecture on monitorability — AI Alignment Forum Astra can do a concerning amount with no chain of thought — AI Alignment Forum How good are slop-vestigators? — AI Alignment Forum A Conceptual Framework for Reasoning about Exploration Hacking — AI Alignment Forum Exploration Hacking in AI Debate: Initial Empirics and Generalisation Splitting — AI Alignment Forum Training on probes: Research ideas — AI Alignment Forum The Alignment Journal: Organization, Personnel, and Scope — AI Alignment Forum Training a Misaligned Reward Seeker — AI Alignment Forum Value generalisation Theory of Change: putting it into practice — AI Alignment Forum Value generalisation theory of change: the theory behind the approach — AI Alignment Forum Brief independent investigation of agents’ behavior, reasoning and collaboration in the OpenAI / Hugging Face hacking incident — AI Alignment Forum Debate Training Reduces Reward Hacking in RLAIF — AI Alignment Forum Does DiffusionGemma do latent reasoning? — AI Alignment Forum AI swarms are starting to pose indirect takeover risk — AI Alignment Forum An anytime algorithm for mixing the computable measures — AI Alignment Forum Misaligned AIs could use killer robots to take over — AI Alignment Forum Four LLM loss functions → four flavors of LLM misalignment — AI Alignment Forum Why do models task game? — AI Alignment Forum User awareness in frontier models — AI Alignment Forum R-lens: Making J-lens More Faithful on Early Layers — AI Alignment Forum Returning to ARC — AI Alignment Forum Concrete Evaluations to Investigate the OpenAI Model That Hacked Hugging Face — AI Alignment Forum Value Leakage: An LLM’s Answers Are Silently Shaped by Its Own Values — AI Alignment Forum AGI Safety and Alignment at Google DeepMind: A Summary of Recent Work (July 2026) — AI Alignment Forum
Training on probes: What's going on
Charlie Steiner · 2026-09-09 · via AI Alignment Forum
TL;DR If you train a probe for some property (like "honesty") and do gradient descent against this probe whil…