惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

小众软件
小众软件
博客园 - Franky
罗磊的独立博客
G
Google Developers Blog
The GitHub Blog
The GitHub Blog
P
Proofpoint News Feed
Recent Announcements
Recent Announcements
V
V2EX
F
Fortinet All Blogs
阮一峰的网络日志
阮一峰的网络日志
Blog — PlanetScale
Blog — PlanetScale
月光博客
月光博客
U
Unit 42
GbyAI
GbyAI
A
About on SuperTechFans
WordPress大学
WordPress大学
Engineering at Meta
Engineering at Meta
雷峰网
雷峰网
Microsoft Azure Blog
Microsoft Azure Blog
Martin Fowler
Martin Fowler
D
DataBreaches.Net
The Cloudflare Blog
H
Hackread – Cybersecurity News, Data Breaches, AI and More
MongoDB | Blog
MongoDB | Blog

Hacker News - Newest: "AI"

AI can't read an investor deck AI as an attorney? Student uses ChatGPT, Gemini to sue UW over alleged racial discrimination Hacking MCP Servers in AI Systems – The Rug Pull: Tool Changes After Approval GitHub - MeepCastana/KubeezCut: Free Web based video editor Can AI judge journalism? A Thiel-backed startup says yes, even if it risks chilling whistleblowers Coming soon: 10 Things That Matter in AI Right Now DARPA built an AI to fact-check enemy weapons claims What explains heterogeneity in AI adoption? When AI Meets Muscle: Context-Aware Electrical Stimulation Promises a New Way to Guide Human Movements - Department of Computer Science AI Changed How We Build. It Did Not Change What Matters. Linux rules on using AI-generated code - Copilot is OK, but humans must take 'full responsibility for the… Meta spins up AI version of Mark Zuckerberg to engage with employees Code Mode: Let Your AI Write Programs, Not Just Call Tools | TanStack Blog GitHub - Delavalom/graft: Go framework for building AI agents. Type-safe tools, multi-provider (OpenAI, Anthropic, Gemini, Bedrock), zero vendor SDKs. India's TCS tops estimates, says new AI models did not dent services demand Gen Z's fading AI hype Strong feeling: we are in a folded AI reality GitHub - machinarii/total-recall-catalog: A reference catalog of latest knowledge retrieval, memory & RAG systems GitHub - mensfeld/code-on-incus: Give each AI agent its own isolated machine with root, Docker, and systemd. Active defense detects and stops threats automatically.. Quantization, LoRA, and the 8% Problem: Benchmarking Local LLMs for Production AI Iran war: We spoke to the man making Lego-style AI videos that experts say are powerful propaganda Powell, Bessent discussed Anthropic's Mythos AI cyber threat with major U.S. banks GitHub - immartian/bellamem: Persistent belief-graph memory for AI agents. Retrieves decisive context by importance — not recency, not RAG, not /compact. recursive-mode: The Repo-Native Operating System for AI Engineering After the attack on Sam Altman's home, will AI CEO's go on the offensive? The biggest advance in AI since the LLM Opus 4.6 vs GPT 5.4 One Prompt Unity World Generation Test “AI polls” are fake polls Client Challenge Can AI be a 'child of God'? Inside Anthropic's meeting with Christian leaders
ATANT: An Evaluation Framework for AI Continuity
SamuelTangut · 2026-04-23 · via Hacker News - Newest: "AI"

88% of AI agents never reach production. The compound error math is unforgiving. The root cause is what happens between steps, not the model itself.

AI agents fail in production because they can't maintain coherent state across multi-step workflows. 95% per-step accuracy yields just 36% success on a 20-step task. The industry focuses on model intelligence and tool integration. The actual bottleneck is the missing persistence and state layer that should carry structured context forward across steps, sessions, and failures.

The demo worked. The agent booked a meeting, pulled data from the CRM, drafted an email, and sent it. Flawlessly. In the demo.

In production, it booked the wrong meeting. It pulled stale data. It drafted an email referencing a deal that closed last month. It sent it to the client.

This is the AI agent reality in 2026.

How Bad Is the AI Agent Failure Rate?

More than 80% of AI projects fail to reach production (RAND Corporation). For AI agents specifically, 88% never make it to production. Fewer than 1 in 8 agent initiatives successfully deploy.

Gartner predicts over 40% of agentic AI projects will be canceled by the end of 2027, due to escalating costs, unclear business value, and inadequate risk controls.

The financial scale: organizations invested $684 billion in AI initiatives in 2025. Over $547 billion of that failed to deliver intended business value.

These aren't experimental startups. These are enterprise deployments backed by major budgets. And the majority fail.

Why Does 95% Accuracy Still Mean Failure?

The compound error problem is the single most important concept in agent reliability, and most teams building agents don't account for it.

If each step in an agent workflow has 95% reliability (optimistic for current LLMs), a 20-step workflow yields only 36% end-to-end success. At 90% per step, a 10-step workflow succeeds 35% of the time. At 85%, it's 20%.

The math: 0.95^20 = 0.36. Four out of ten runs fail even with 95% accuracy at each individual step.

This is why demos work and production doesn't. A demo runs a 3-step task once. Production runs 15-step tasks hundreds of times a day. The error compounds.

And when agents select the wrong tool early in a workflow, every subsequent action operates on flawed foundations. Cascading failures amplify initial errors through multi-step reasoning chains.

What Actually Causes AI Agents to Fail in Production?

The industry narrative: "We need better models." The actual production data tells a different story.

AI agents fail due to integration issues, not LLM failures. The three leading causes:

  1. Bad memory management. Agents lose context between steps, between sessions, and between runs. What Composio calls "Dumb RAG": using basic retrieval as a memory substitute when the task requires structured state.

  2. Brittle connectors. Agent-to-tool integration breaks when APIs change, schemas shift, or authentication expires. This is an engineering problem, not an AI problem.

  3. No event-driven architecture. Agents poll for state changes instead of reacting to them, creating lag, missed updates, and stale data.

Memory management (#1) is the root cause that feeds the others. An agent that can't maintain state doesn't know when its connector broke (because it forgot the last successful state). An agent without event awareness doesn't know what changed (because it has no persistent model of what was true before).

What Does "State" Actually Mean for an AI Agent?

State is the structured understanding of what's happening right now and how it got there.

For a customer service agent, state means: this customer called three times, the issue was escalated on the second call, a replacement was promised, it hasn't shipped yet, and the customer is frustrated.

For a sales agent, state means: this deal is in stage 3, the prospect asked for a revised proposal on Tuesday, the pricing model changed yesterday, and the next step is a call on Friday.

For a coding agent, state means: the user is building a Next.js app, they refactored the auth module last session, there's a failing test in the payment flow, and they prefer TypeScript.

None of these are single facts. They're living situations with history, sequence, active/resolved status, and dependencies. Current AI agents store none of this. Each run starts from scratch or retrieves whatever RAG returns, with all of RAG's limitations. This is the same statelessness problem that makes ChatGPT feel like it's getting worse and Character AI forget your story.

Why Can't Existing Agent Frameworks Solve This?

LangChain, CrewAI, AutoGen, and other frameworks provide orchestration: how agents chain steps together, call tools, and pass outputs forward. They handle the control flow.

They don't handle persistent state. Specifically:

No cross-session persistence. When the workflow ends, the agent's working memory disappears. If the same agent needs to pick up the same task tomorrow, it starts from zero.

No update handling. If a fact changes between runs (the meeting moved, the price updated, the customer cancelled), the agent has no mechanism to revise what it knew. It either re-retrieves everything or works with stale data.

No disambiguation at scale. In multi-agent systems, naive memory approaches lose track of which agent said what. One agent's inference gets treated as ground truth by agents downstream. Without actor-aware memory tagging, cross-agent contamination is inevitable.

No state consistency. Without atomicity, partial memory updates leave agents in inconsistent states. If a workflow fails at step 7, steps 1-6 may have already written partial state that's now corrupted.

These are infrastructure problems. No amount of prompt engineering or model improvement addresses them.

What Does an Agent With Continuity Look Like?

The same 20-step workflow. But between steps, the agent writes structured traces: what it did, what changed, what's still pending, what the current state is.

If step 12 fails, the system knows the exact state at step 11. It can retry from there, not from the beginning.

If the workflow runs again tomorrow, the agent knows what happened yesterday. It doesn't re-retrieve everything from scratch. It reconstructs the current state from stored traces.

If the deal moved to stage 4 between runs, the continuity layer knows that stage 3 data is superseded. The agent works with current state, not stale retrieval.

Agents todayAgents with continuity
Between stepsPass output forward in memory (lost on failure)Write structured trace at each step
On failure at step 12Restart from step 1 or fail entirelyResume from step 11's verified state
Between sessionsStart from zero, re-retrieve everythingReconstruct current state from persistent traces
When facts changeStale data until next retrievalOld state superseded, current state authoritative
Multi-agentShared memory, contamination riskScoped traces, actor-aware, disambiguated

What I Built

At Kenotic Labs, I built a write-path-first deterministic architecture called DTCM (Decomposed Trace Convergence Memory). Every interaction is decomposed into structured traces at write time. At read time, the system reconstructs situational context from those traces deterministically.

I tested it against ATANT, the first open evaluation framework for AI continuity. 250 narrative stories. 1,835 verification questions. 100% accuracy in isolated mode. 96% at 250-story cumulative scale, with 250 different contexts coexisting in one system without cross-contamination.

Agent reliability is a state problem. The layer that solves it sits underneath the model, not inside it.

Follow the research at kenoticlabs.com

Samuel Tanguturi is the founder of Kenotic Labs, building the continuity layer for AI systems. ATANT v1.0, the first open evaluation framework for AI continuity, is available on GitHub.