惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

A
About on SuperTechFans
博客园 - 聂微东
让小产品的独立变现更简单 - ezindie.com
让小产品的独立变现更简单 - ezindie.com
奇客Solidot–传递最新科技情报
奇客Solidot–传递最新科技情报
博客园 - 司徒正美
宝玉的分享
宝玉的分享
美团技术团队
量子位
The Cloudflare Blog
freeCodeCamp Programming Tutorials: Python, JavaScript, Git & More
IT之家
IT之家
爱范儿
爱范儿
J
Java Code Geeks
博客园 - Franky
Last Week in AI
Last Week in AI
B
Blog
H
Hackread – Cybersecurity News, Data Breaches, AI and More
I
InfoQ
GbyAI
GbyAI
Recent Announcements
Recent Announcements
小众软件
小众软件
H
Help Net Security
Microsoft Azure Blog
Microsoft Azure Blog
MyScale Blog
MyScale Blog

InfoWorld

AWS boosts CloudWatch Logs query limits by 10x to ease debugging for developers, SREs 21 LLMs tuned for special domains AWS adds Advanced Prompt Optimization tool to Bedrock Capacity markets could reshape cloud computing Four cutting-edge tools for spec-driven development Anthropic puts Claude agents on a meter across its subscriptions Notion courts developers with a platform for AI agents and workflow automation Using continuous purple teaming to protect fast-paced enterprise environments A better way to work with SQL Server Evidence-driven workflows: Rethinking enterprise process design AWS debuts Graviton-powered Redshift RG instances to cut analytics costs SAP’s AI promises last year? Most are still rolling out First look: Lemonade serves up local AI with limitations GitLab CEO sees developer tool bill increasing 100-fold Red Hat adds support for agentic AI development What’s new and exciting in JDK 26 Kill the loading spinner with local-first data and reactive SQL A networking revolution at AWS Tokenmaxxing is super dumb Hands-on with React, Supabase, and PowerSync How to add AI to an existing product (without annoying users) Your AI doesn’t need another database What happens when engineering teams reorganize around AI agents Python isn’t always easy When cloud giants meddle in markets 12 model-level deep cuts to slash AI training costs The best new features in Python 3.15 Teradata launches platform for enterprise AI agents moving beyond pilots Three skills that matter when AI handles the coding MongoDB targets AI’s retrieval problem
Why most AI agents disappoint in production (and what to ...
by Tobie Morgan Hitchcock · 2026-05-26 · via InfoWorld

Agents disappoint in production when we ask them to drive on roads built for dashboards. Build these four guarantees into the substrate to make them reliable.

AI agents look brilliant in a demo because demos are friendly worlds. The data is curated, the tools behave, and nothing important changes while the agent is in mid-thought. Production is the opposite: data arrives late, facts conflict, permissions bite, APIs time out, and the underlying state changes constantly.

That gap is why early “agents in production” often get scoped down to something safer: read-only assistants, human-in-the-loop workflows, or narrow domains with heavily curated data. Several high-profile deployments have also been scaled back after meeting messy real-world constraints. Rather than being a verdict on autonomy, these stumbles are a reminder that autonomy is unforgiving. Small cracks in your data stack become large cracks in agent behavior.

The same pattern shows up whenever agents move from toy workflows to systems with real state. As scope increases, weak guarantees create predictable symptoms: overconfident actions on stale data, brittle reasoning when meaning drifts, and compounding errors once the agent can write back.

The fix is to treat agents as what they are: systems that read, reason, and write against live operational data. That pushes you into establishing guarantees that most enterprise stacks provide only implicitly. Four matter more than the rest: freshness, semantics, safe write paths and lineage.

Freshness: Stop reasoning about yesterday

Many organizations have learned to live with staleness: batch pipelines, replica lag, caches, delayed CDC (change data capture), materialized views. Humans compensate with judgment. Agents compensate with confidence.

A common production failure mode is correct reasoning on the wrong time slice. The agent reads inventory that is minutes behind and triggers a reorder that collides with replenishment already in flight. Or the agent sees an incident marked “resolved” in one system while another system still shows the rollback pending, and it proceeds with a change that should have waited. Call these mistakes what they are: freshness bugs.

A “freshness guarantee” means time is first class. Facts have timestamps. Queries support clean “as of” semantics, so an agent can ask what was true at time T, what is true now, and what changed since its last action. Workflows declare freshness SLOs for the data they depend on. When the platform cannot meet them, the agent degrades gracefully. It pauses, asks for confirmation, or switches to a read-only plan.

Freshness also has a deployment dimension. Many agent use cases are local by nature, from factories to retail sites. If you need low-latency context, pushing everything back to a central store and waiting for it to come round the loop is a design flaw, not an optimization problem.

Semantics: Make meaning explicit, not inferred

Agents fail in subtler ways when the data looks right but means different things across systems. Customer versus account. Order versus transaction. A status code that drifted between teams. Duplicate identifiers. Inconsistent naming. Each system can be locally correct while the agent is globally wrong.

This is where teams reach for vector search and call it memory. Embeddings are excellent for similarity. They are weak at representing complex structure and constraints. In practice, similarity can help you find relevant material but it does not give you a semantic contract. It cannot enforce that “this customer” is the same entity across CRM, billing, support, and identity systems. It cannot naturally encode constraints like “a device belongs to exactly one site at a time” or “a refund requires a matching settlement.” When agents rely on fuzzy recall to do deterministic work, they behave like confident improvisers.

A semantic guarantee means an explicit model of entities and relationships, often a “context graph” that links operational records to the documents and signals that describe them. This is a shift from older knowledge graph programs that imported data in batches for analytical queries. The emerging agent use case is constant streaming of data, much of it documents and files, combined with real-time read and write in the same operational loop.

Safe write paths: Agents make changes, so design for reversibility

Read-only agents can be wrong and still be useful. Write-capable agents can be wrong and destructive. The compounding effect is the risk that a mistaken update becomes the next step’s ground truth, a retry becomes a duplicate side effect, and a partial write leaves the world inconsistent.

Safe write paths begin with transactional guarantees. ACID transactions keep state transitions coherent. Idempotency matters because agents retry and networks wobble. Concurrency control matters because the agent is rarely the only actor changing state. Then come guardrails: row-level security, role-based access, and constraints enforced by the platform, rather than buried in prompts.

A practical pattern is plan-validate-commit. The agent proposes a structured change set, validates it against current state and constraints, then commits with an audit record that links action to evidence. Approval can be automated or human depending on risk, but the write path stays disciplined.

Lineage: If you cannot trace decisions, you cannot improve them

When an agent goes wrong, teams need to answer a simple question: what did it see? Without that, debugging becomes archaeology.

Lineage connects data to behavior. It includes provenance for records and documents, plus agent-specific traces: which retrieval results were used, which tool calls ran, which policies were applied, and what changed as a result. An AI-native platform should make it practical to capture and query this. It should include immutable audit trails for high-risk actions, versioning or time travel for critical entities, and links from decisions to the exact data snapshots used. This is also how evaluation becomes engineering: through replayable scenarios, regression tests, and drift detection.

What an AI-native data platform provides

These four guarantees point to the same conclusion: agentic workloads punish fragmentation. Every extra datastore, index, and pipeline is another place for semantics to drift and freshness to fail. Agents end up stitching together five systems at runtime, and runtime stitching is where consistency dies. Because agents operate across these systems continuously, not occasionally, they amplify integration flaws.

An AI-native data platform is a foundation that can represent operational truth, semantic context, and retrieval signals in one place, with transactional correctness, controlled writes, and auditable history. That typically means native support for all of the data shapes agents need in the same workflow: relational records, JSON documents, graph relationships, time-series events, and vector embeddings. It also means support for composable queries that can blend structured filters, relationship traversal, and similarity search without shipping data across services.

The other requirement is deployment flexibility. The data plumbing tends to move slower than the front-end UX, because shiny interfaces are easier to understand than the hard work of making systems consistent at scale. Agents bring that plumbing problem to the surface. Platforms that can run the same engine in the cloud, in self-hosted environments, in memory, and at the edge reduce orchestration overhead and make guarantees easier to maintain.

Where to start: An engineer’s agent readiness checklist

Full autonomy rarely needs to be the starting point. Explicit guarantees do.

Start with read paths. Prove retrieval quality, freshness bounds, and semantic coherence while the agent is advisory. Define a context contract: authoritative sources, entity resolution rules, the relationships that matter, and what “fresh enough” means for each workflow. Instrument lineage by default so every recommendation can be traced to evidence.

Introduce writes gradually. Scope early actions to reversible operations. Make tool calls idempotent. Use transactions. Keep enforcement in the platform layer. Treat approvals as a tunable control, with human sign-off where risk and blast radius demand it.

Agents disappoint in production when we ask them to drive on roads built for dashboards. Build the four guarantees into the substrate and the same model will start behaving like a far more reliable system. That is the unglamorous truth behind “agent memory” and “context graphs.” This is infrastructure work, but it is also the shortest path from demos to deployment.

New Tech Forum provides a venue for technology leaders—including vendors and other outside contributors—to explore and discuss emerging enterprise technology in unprecedented depth and breadth. The selection is subjective, based on our pick of the technologies we believe to be important and of greatest interest to InfoWorld readers. InfoWorld does not accept marketing collateral for publication and reserves the right to edit all contributed content. Send all inquiries to doug_dineley@foundryco.com.