The safe-to-dangerous shift is a fundamental problem for eval realism; but also for measuring awareness - 惯性聚合

推荐订阅源

SegmentFault 最新的问题

人人都是产品经理

Blog — PlanetScale

cs.AI updates on arXiv.org

Cisco Talos Blog

CXSECURITY Database RSS Feed - CXSecurity.com

酷壳 – CoolShell

Threat Intelligence Blog | Flashpoint

博客园 - 叶小钗

让小产品的独立变现更简单 - ezindie.com

Security Latest

Proofpoint News Feed

Privacy International News Feed

Palo Alto Networks Blog

DataBreaches.Net

大猫的无限游戏

www.infosecurity-magazine.com

Google Online Security Blog

Netflix TechBlog - Medium

博客园 - 【当耐特】

CERT Recently Published Vulnerability Notes

Hugging Face - Blog

Hacker News - Newest: "LLM"

Kaspersky official blog

KPMG report finds enterprise disconnect between AI and its ROI | CIO

CTFtime.org: upcoming CTF events

Stack Overflow Blog

博客园 - Franky

Tor Project blog

The GitHub Blog

宝玉的分享

LINUX DO - 最新话题

Application and Cybersecurity Blog

AI Alignment Forum

Deployment Awareness Matters More Than Evaluation Awareness — AI Alignment Forum The Case for Model Forensics — AI Alignment Forum LLM-Driven Feature Discovery — AI Alignment Forum How transparent is DiffusionGemma (and why it matters) — AI Alignment Forum GDM AI Control Roadmap — AI Alignment Forum Predicting LLM Safety Before Release by Simulating Deployment — AI Alignment Forum Synthetic document finetuning for instilling positive traits — AI Alignment Forum Why Do Naive SFT Filters For Safety Properties Fail? — AI Alignment Forum SFT Drives Gemini’s Safety Properties — AI Alignment Forum Building and evaluating model diffing agents — AI Alignment Forum Sympathy for both sides of the egregious misalignment debate — AI Alignment Forum Models May Behave Worse When Eval Aware — AI Alignment Forum Sequent: scale and automation for higher confidence in alignment — AI Alignment Forum Tracing Eval-Awareness Emergence Through Training of OLMo 3 — AI Alignment Forum A Mike's-Eye View of ARC's Research — AI Alignment Forum Efficient tradeoffs and the safety-usefulness tradeoff model — AI Alignment Forum Can activation verbalizers surface an internal chain of thought? — AI Alignment Forum My research: a computational cognitive neuroscience perspective on alignment — AI Alignment Forum Announcing the ARC White-Box Estimation Challenge — AI Alignment Forum Testing Gemini models for scheming tendencies Advice for making robust-to-training model organisms Eval Cooperativeness May Be a Scalable Mitigation for Eval Gaming Full automation of AI R&D probably yields a large speed up even without a software-only singularity Looking for backdoors in Jane Street LLMs The Case for Evaluating Model Behaviors Risk reports need to address deployment-time spread of misalignment Mechanistic estimation for expectations of random products Empowerment, corrigibility, etc. are simple abstractions (of a messed-up ontology)

The safe-to-dangerous shift is a fundamental problem for eval realism; but also for measuring awareness

Charlie Grif · 2026-05-15 · via AI Alignment Forum

此内容由惯性聚合(RSS阅读器)自动聚合整理，仅供阅读参考。原文来自 — 版权归原作者所有。