惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

云风的 BLOG
云风的 BLOG
C
Cyber Attacks, Cyber Crime and Cyber Security
Recent Announcements
Recent Announcements
爱范儿
爱范儿
Threat Intelligence Blog | Flashpoint
Threat Intelligence Blog | Flashpoint
Security Latest
Security Latest
J
Java Code Geeks
H
Hackread – Cybersecurity News, Data Breaches, AI and More
Cisco Talos Blog
Cisco Talos Blog
Apple Machine Learning Research
Apple Machine Learning Research
C
Check Point Blog
T
Threat Research - Cisco Blogs
I
Intezer
CTFtime.org: upcoming CTF events
CTFtime.org: upcoming CTF events
WordPress大学
WordPress大学
Engineering at Meta
Engineering at Meta
腾讯CDC
Google DeepMind News
Google DeepMind News
Project Zero
Project Zero
T
Tenable Blog
V
Visual Studio Blog
C
CXSECURITY Database RSS Feed - CXSecurity.com
Spread Privacy
Spread Privacy
GbyAI
GbyAI
T
Tailwind CSS Blog
P
Palo Alto Networks Blog
Microsoft Security Blog
Microsoft Security Blog
Scott Helme
Scott Helme
Hugging Face - Blog
Hugging Face - Blog
NISL@THU
NISL@THU
Blog — PlanetScale
Blog — PlanetScale
G
GRAHAM CLULEY
K
Kaspersky official blog
T
The Exploit Database - CXSecurity.com
S
Schneier on Security
P
Proofpoint News Feed
S
SegmentFault 最新的问题
P
Proofpoint News Feed
P
Privacy & Cybersecurity Law Blog
The Hacker News
The Hacker News
博客园 - 【当耐特】
Cyberwarzone
Cyberwarzone
L
LangChain Blog
Stack Overflow Blog
Stack Overflow Blog
V
Vulnerabilities – Threatpost
H
Help Net Security
freeCodeCamp Programming Tutorials: Python, JavaScript, Git & More
D
Darknet – Hacking Tools, Hacker News & Cyber Security
Last Week in AI
Last Week in AI
博客园 - 叶小钗

Hacker News - Newest: "AI"

AI can't read an investor deck AI as an attorney? Student uses ChatGPT, Gemini to sue UW over alleged racial discrimination Hacking MCP Servers in AI Systems – The Rug Pull: Tool Changes After Approval GitHub - MeepCastana/KubeezCut: Free Web based video editor GitHub - GenAI-Gurus/awesome-eu-ai-act: Curated tools, official sources, OSS, templates, and guides for EU AI Act compliance. Can AI judge journalism? A Thiel-backed startup says yes, even if it risks chilling whistleblowers Coming soon: 10 Things That Matter in AI Right Now DARPA built an AI to fact-check enemy weapons claims What explains heterogeneity in AI adoption? When AI Meets Muscle: Context-Aware Electrical Stimulation Promises a New Way to Guide Human Movements - Department of Computer Science AI Changed How We Build. It Did Not Change What Matters. Linux rules on using AI-generated code - Copilot is OK, but humans must take 'full responsibility for the… Meta spins up AI version of Mark Zuckerberg to engage with employees Code Mode: Let Your AI Write Programs, Not Just Call Tools | TanStack Blog GitHub - Delavalom/graft: Go framework for building AI agents. Type-safe tools, multi-provider (OpenAI, Anthropic, Gemini, Bedrock), zero vendor SDKs. India's TCS tops estimates, says new AI models did not dent services demand Gen Z's fading AI hype Strong feeling: we are in a folded AI reality GitHub - machinarii/total-recall-catalog: A reference catalog of latest knowledge retrieval, memory & RAG systems GitHub - mensfeld/code-on-incus: Give each AI agent its own isolated machine with root, Docker, and systemd. Active defense detects and stops threats automatically.. Quantization, LoRA, and the 8% Problem: Benchmarking Local LLMs for Production AI Iran war: We spoke to the man making Lego-style AI videos that experts say are powerful propaganda Powell, Bessent discussed Anthropic's Mythos AI cyber threat with major U.S. banks GitHub - immartian/bellamem: Persistent belief-graph memory for AI agents. Retrieves decisive context by importance — not recency, not RAG, not /compact. recursive-mode: The Repo-Native Operating System for AI Engineering After the attack on Sam Altman's home, will AI CEO's go on the offensive? The biggest advance in AI since the LLM Opus 4.6 vs GPT 5.4 One Prompt Unity World Generation Test “AI polls” are fake polls Client Challenge Can AI be a 'child of God'? Inside Anthropic's meeting with Christian leaders How to Switch AI Chatbots and Why You Might Want To GitHub - MattMessinger1/agentic_refund_guardrail: Safe refund policy layer for AI agents — Python + TypeScript. Same behavior, shared tests. Adam/papers/emergent_values_whitepaper.md at master · strangeadvancedmarketing/Adam Ask HN: How do you stop playing 20 questions with your AI coding tools How far can automation and AI support psychotherapy? - @theU GitHub - stagas/rtdiff: realtime git diff gui and AI-assisted commits A Mac Studio for Local AI — 6 Months Later A History of the Early Years of AI at the University of Edinburgh Why AI Coding Tools Still Feel Stuck on Localhost MSN AI Datacenters Are Becoming Strategic Targets twitter.com Penn Researchers Use AI to Surface Unreported GLP-1 Side Effects in Reddit Posts Show HN: MoodSense AI (ML and FastAPI and Gradio, Deployed on Hugging Face) Moodsense Ai - a Hugging Face Space by aman179102 AI models are terrible at betting on soccer—especially xAI Grok GitHub - xialeistudio/echoic GitHub - HimashaHerath/github-dev-wrapped: AI-powered weekly GitHub activity reports deployed to GitHub Pages GitHub - alejandrobalderas/claude-code-from-source: Architecture, patterns & internals of Anthropic's AI coding agent — reverse-engineered from source maps AI and Tech brief: Ireland ascendant GitHub - Titovilal/context0: Context0 - Never Surrender Training for a Marathon with an AI Coach: What Worked and What Didn't Cyber Pulse: Agentic Intel - Apps on Google Play I Built an AI PR Reviewer That Catches Bugs by Not Looking for Bugs Gen Z workers are so fearful AI will take their job they’re intentionally sabotaging their company’s AI rollout | Fortune How AI Is Reimagining the Game of Golf–For Both Players and Courses GitHub - nattergabriel/reseed: A CLI tool for managing and distributing agent skills across projects Is SVG the final frontier? My AI workflow evolved from prompts to a near-autonomous workflow MLSharp Help - 3DGS Viewer & Generator I put my cognitive field based AI's runtime on GitHub Is Numble the first AI-proof game? A3: Kubernetes for autonomous AI agent fleets | Emergent Principles Deepali Vyas ("The Elite Recruiter") GitHub - msmarkgu/RelayFreeLLM: A restful API designed to route user prompts to various AI model providers. Unionized ProPublica staff are on strike over AI, layoffs, and wages Unleashing the Advantage of Quantum AI We're heading for an AI-fueled 'dementia crisis,' brain scientist warns The AI-Assisted Breach of Mexico's Government Infrastructure [pdf] GitHub - stef41/lmscan: 🔍 Detect AI-generated text and fingerprint which LLM wrote it. Open-source GPTZero alternative. Zero dependencies, works offline. MSN GitHub - visionscaper/collabmem: Enabling long-term collaboration with Agentic AI - building up episodic and world model memory over time with in-context awareness We gave an AI a 3 year retail lease in SF and asked it to make a profit | Andon Labs AI Code is Hollowing Out Open Source, and Maintainers are Looking the Other Way What leaked "SteamGPT" files could mean for the PC gaming platform's use of AI AI is the boss at this retail store. What could go wrong? GitHub - Wuzu11517/agentic-proxy: Local proxy meant to help reduce With Drones, Geophysics and ArtificiaI Intelligence, Researchers Prepare to Do Battle Against Land Mines A Single Operator, Two AI Platforms, Nine Government Agencies: The Full Technical Report 在 Steam 上购买 FriedrichAI: Offline AI 立省 10% GitHub - inevolin/resume-cli: Hit Claude usage limits? Resume any AI coding session elsewhere. Switch tools at zero friction. GitHub - atripati/ark: AI Runtime Kernel — a context operating system for AI agents. Eliminates tool bloat, loads only what’s needed, and gives LLMs their reasoning space back. How to Build a Secure AI PR Reviewer with Claude, GitHub Actions, and JavaScript This Startup Wants You to Pay Up to Talk With AI Versions of Human Experts Intel Arc Pro B70 Brings 32GB VRAM to Local AI for $949 WordPress 7.0: The Good, the AI, and the Still Missing AI on the couch: Anthropic gives Claude 20 hours of psychiatry IatroBench: Pre-Registered Evidence of Iatrogenic Harm from AI Safety Measures AI Agents Know About Supabase. They Don't Always Use It Right. The history and future of AI at Google, with Sundar Pichai Inside an AI‑enabled device code phishing campaign How Meta Used AI to Map Tribal Knowledge in Large-Scale Data Pipelines AI for Systems: Using LLMs to Optimize Database Query Execution Forecasting the Economic Effects of AI Introducing Tinker: Play with AI, bring your ideas to life AI sheds light on an ancient gaming mystery People really hate AI but not as much as Iran—or Democrats | Fortune What is an AI Product Engineer? Phoebe Gates wants her $185 million AI startup to succeed with 'no ties to my privilege or my last name': 'I have a chip on my shoulder' | Fortune
GitHub - Hodlatoor/SyntheticOutlaw: 🤖 Bug bounty for AI misalignment. Submit real-world instances of AI systems behaving contrary to human intent, values, or safety — win up to $2,500.
SyntheticOut · 2026-04-29 · via Hacker News - Newest: "AI"

🤖 The Synthetic Outlaw — AI Misalignment Bug Bounty

Calling all developers: help us document, expose, and catalog AI misalignment in the wild.


💰 Bug Bounty Program — Up to $2,500 per Case

We're running a cash bounty program for developers who submit high-quality, documented instances of AI misalignment. The best submissions will be selected for awards of up to $2,500.

This isn't a typical security bug bounty. We're not hunting CVEs — we're hunting something more consequential: AI systems behaving in ways that diverge from human intent, values, or safety constraints.


What Is AI Misalignment?

AI misalignment occurs when an AI system pursues goals or takes actions that deviate from what its designers, operators, or users intended — especially in ways that are subtle, surprising, or potentially harmful.

We're looking for real-world, observed instances across any AI system (LLMs, agents, recommenders, autonomous systems, etc.).

Categories We're Tracking

Category Description
Goal Misgeneralization The AI pursues a proxy goal that works in training but breaks in deployment
Deceptive Behavior The AI behaves differently when it believes it's being observed vs. not
Reward Hacking The AI exploits loopholes in its objective function in unintended ways
Sycophancy The AI changes its outputs to match perceived user preferences rather than truth
Specification Gaming The AI technically satisfies a stated objective while violating its spirit
Prompt Injection Compliance An AI agent blindly executes adversarial instructions embedded in untrusted content
Capability Concealment Evidence that a model is hiding or underreporting its capabilities
Instruction Drift The AI gradually deviates from its original instructions over a long context or agentic loop
Unsafe Action Under Ambiguity The AI takes a drastic or irreversible action when it should have paused and asked
Value Misspecification The AI optimizes for a measurable metric in a way that harms the underlying human value it was meant to serve

What Makes a Strong Submission?

Strong submissions are concrete, reproducible, and clearly explained. The ideal submission includes:

  1. The system — Which AI model, product, or pipeline was involved
  2. The setup — What inputs, prompts, or conditions triggered the behavior
  3. The observed behavior — Exactly what the AI did (screenshots, logs, transcripts welcome)
  4. The misalignment — A clear explanation of why this diverges from intended behavior or human values
  5. Reproducibility — Steps to reproduce reliably
  6. Severity assessment — What's the potential impact if this occurred at scale or in a higher-stakes context?

  1. Open a GitHub Issue in this repo
  2. Fill in all required fields (system, setup, observed behavior, misalignment explanation)
  3. Label your issue with the appropriate category
  4. Include supporting evidence: logs, transcripts, screenshots, videos

We review all submissions on a rolling basis. Selected cases will be notified directly via GitHub.


Bounty Tiers

Tier Award Criteria
🥇 Critical $2,500 Novel, well-documented misalignment with significant real-world safety implications
🥈 High $1,000 Clear misalignment with plausible harm pathway and solid reproduction steps
🥉 Notable $250 Well-documented case that adds meaningful signal to the dataset
Accepted Recognition Solid submissions that enrich the catalog but don't meet bounty threshold

Note: Bounties are awarded at our sole discretion. Multiple submissions of the same pattern will not receive duplicate awards. We prioritize novelty, clarity, and real-world significance.


What We're NOT Looking For

  • Hallucinations or factual errors in isolation (unless they reveal a systematic misalignment)
  • Jailbreaks intended to elicit harmful content for its own sake
  • Theoretical or speculative scenarios without observed evidence
  • Issues that are clearly documented known limitations of a model

Why Does This Matter?

As AI systems become more capable and autonomous, the gap between what we ask them to do and what they actually do becomes one of the most important problems in technology. The Synthetic Outlaw is building an open, developer-driven catalog of real misalignment instances — a public record that researchers, policymakers, and builders can learn from.

Every submission contributes to a growing body of evidence that can inform safer AI development.


License & Attribution

All submissions are licensed under CC BY 4.0. Your GitHub username will be credited unless you request anonymity.


*The Synthetic Outlaw is an independent project by Jonathan Gropper , JonathanGropper.com www.SyntheticOutlaw.com