惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

J
Java Code Geeks
M
MIT News - Artificial intelligence
D
Docker
S
SegmentFault 最新的问题
B
Blog
Apple Machine Learning Research
Apple Machine Learning Research
博客园_首页
博客园 - 【当耐特】
让小产品的独立变现更简单 - ezindie.com
让小产品的独立变现更简单 - ezindie.com
The GitHub Blog
The GitHub Blog
Y
Y Combinator Blog
腾讯CDC
阮一峰的网络日志
阮一峰的网络日志
U
Unit 42
C
Check Point Blog
GbyAI
GbyAI
美团技术团队
Recent Announcements
Recent Announcements
F
Fortinet All Blogs
量子位
OSCHINA 社区最新新闻
OSCHINA 社区最新新闻
V
Visual Studio Blog
钛媒体:引领未来商业与生活新知
钛媒体:引领未来商业与生活新知
G
Google Developers Blog

DEV Community

Authentication Security Deep Dive: From Brute Force to Salted Hashing (With Java Examples) Why AI Systems Don’t Fail — They Drift Spilling beans for how i learn for exam😁"Reinforcement Learning Cheat Sheet" I Replaced Chrome with Safari for AI Browser Automation. Here's What Broke (and What Finally Worked) How Python Borrows Other People's Work The $40 Architecture: Processing 1 Billion API Requests with 99.99% Uptime Vibe Coding: A Workflow Guide (From Zero to SaaS) Most webhook security guides protect the wrong side. The scary part is delivery. Headless CMS for TanStack Start: Build a Blog with Cosmic EU Age Verification App "Hacked in 2 Minutes" — What Actually Happened Comfy Cloud’s delete function does not actually remove files Running AI Models on GPU Cloud Servers: A Beginner Guide Event-driven media intelligence with AWS Step Functions and Bedrock I scored 500 AI prompts across 8 quality dimensions — here's what broke How to Call Google Gemini API from Next.js (Free Tier, No Backend Needed) The Portal Protocol: Reclaiming Human Connection in the Age of AI How to Fix Your Team's Scattered Knowledge Problem With a Self-Hosted Forum Intro to tc Cloud Functors: A Graph-First Mental Model for the Modern Cloud Designing Multi-Tenant Backends With Both Ownership and Team Access I Built a Neumorphic CSS Library with 77+ Components — Here's What I Learned PostgreSQL Performance Optimization: Why Connection Pooling Is Critical at Scale Cómo construí un SaaS multi-rubro para gestionar expensas en Argentina con FastAPI + Vue 3 🚀 I Built an Ethical Hacking Scanner Tool – Open Source Project I Replaced /usage and /context in Claude Code With a Single Statusline A Pythonic Way to Handle Emails (IMAP/SMTP) with Auto-Discovery and AI-Ready Design I Collected 8.9 Million Polymarket Price Points — Here's What I Found About How Markets Really Move EcoTrack AI — Carbon Footprint Tracker & Dashboard Everyone's Using AI. No One Agrees How. 5 self-hosted ebook managers worth trying in 2026 Building Your First AI Agent with LangChain: From Chatbot to Autonomous Assistant
Why Runtime Governance for LLM Agents Is Inevitable
Jonny · 2026-05-16 · via DEV Community

What three independent research groups concluded in early 2026 — and what it means for anyone building agent pipelines today

In the first quarter of 2026, at least three independent research groups published formal frameworks for the same problem: how to govern the behavior of LLM agents at runtime.
That convergence is worth paying attention to.

The Core Problem
Traditional software has decades of formal specification tooling. Type systems, API contracts, assertions, interface specifications — all of these provide compile-time and runtime guarantees about what a program will do.
LLM agents have prompts.
As Bhardwaj (2026) puts it in Agent Behavioral Contracts: prompts "carry no formal semantics, no verifiable guarantees, and no enforcement mechanisms." This gap between formal software contracts and informal agent instructions is the root cause of a class of failures unique to agentic AI: behavioral drift, silent policy violations, and governance failures that only surface after the fact.
The problem compounds in multi-step pipelines. Each agent step transforms shared state. By the time a failure is visible, the system has already passed through multiple intermediate states — none of which were formally validated.

Three Research Groups, Three Angles

  1. Behavioral Contracts (Bhardwaj, 2026) arxiv.org/abs/2602.22302 Bhardwaj formalizes the contract as C = (P, I, G, R): Preconditions, Invariants, Governance policies, and Recovery mechanisms — enforced at runtime, not at training time. The key insight is the Drift Bounds Theorem: without continuous runtime enforcement, agent behavior inevitably drifts from its specification over multi-turn interactions. An agent tasked with professional customer support may begin with appropriate responses but progressively adopt a more casual tone, hallucinate features, or volunteer information it wasn't asked for. Training-time alignment and output guardrails don't prevent this — they don't monitor state across steps. The paper also makes a distinction that matters in practice: text-level safety does not transfer to tool-call safety. Behavioral contracts must operate at the action level, not merely the output level.
  2. Policies on Paths (Kaptein et al., 2026) arxiv.org/abs/2603.16586 The Eindhoven group argues that the execution path is the central object for governance — not the individual output, not the prompt, not the access control list. Their framing: prompt-level instructions shape the distribution over paths without evaluating them. Static access control evaluates deterministic policies that ignore the path. Neither is sufficient. Effective governance requires policies that evaluate (agent identity, partial path, proposed next action, organizational state) — before the action executes. They also note the regulatory context: EU AI Act provisions for high-risk systems take effect in August 2026 and "effectively demand proper orchestration." The gap between what organizations are deploying and what they can demonstrably govern is, in their assessment, the central obstacle to responsible agent adoption.
  3. Governing What You Cannot Observe (2026) arxiv.org/abs/2604.24686 The third paper takes a statistical angle: agents are partially observable systems. You can't directly inspect internal state — you can only observe actions and outputs. Governance frameworks that assume full observability will fail in practice. Their RiskGate framework introduces a Viability Index that transforms governance from reactive to predictive — flagging drift before it becomes a violation, not after.

What All Three Agree On
Despite different formal approaches, the three papers converge on the same structural conclusions:
Training-time alignment is insufficient. Constitutional AI, RLHF, and output guardrails operate on individual outputs in isolation. They have no concept of state across steps, no preconditions, no invariants over multi-turn interactions.
Governance must happen before execution. Checking outputs after the fact means side effects have already occurred. Tokens were consumed. External APIs were called. State was written. By the time you detect the violation, you're doing forensics, not enforcement.
The execution path is what needs to be governed. Not the prompt. Not the output. The sequence of actions the agent took — evaluated against policies at each step, before each step.

The Infrastructure Gap
A 2026 KPMG survey found that 75% of enterprise leaders cite security, compliance, and auditability as the most critical requirements for agent deployment. Yet most production agent systems today rely on logging, output filtering, and hope.
The academic framing makes the gap concrete: organizations are deploying systems they cannot formally govern. The tooling to close that gap — runtime contract enforcement, policy evaluation on execution paths, structured audit trails — is what's missing.
This isn't a distant research problem. It's the infrastructure layer that production agent pipelines need right now.

What This Means in Practice
If you're building agent pipelines today, the research points to a few concrete requirements for any governance layer worth having:

Preconditions evaluated before execution — not assertions after the fact
Policy enforcement at the action level — not just output filtering
State preserved on failure — for audit and replay
Structured failure events — not just stack traces

These aren't exotic research requirements. They're engineering primitives that the field is converging on — from multiple independent directions, in the same quarter.

Papers referenced:

Agent Behavioral Contracts — Bhardwaj, Feb 2026 — arxiv.org/abs/2602.22302
Runtime Governance for AI Agents: Policies on Paths — Kaptein et al., Mar 2026 — arxiv.org/abs/2603.16586
Governing What You Cannot Observe — Apr 2026 — arxiv.org/abs/2604.24686