惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

阮一峰的网络日志
阮一峰的网络日志
博客园 - 司徒正美
D
DataBreaches.Net
宝玉的分享
宝玉的分享
奇客Solidot–传递最新科技情报
奇客Solidot–传递最新科技情报
博客园 - 【当耐特】
人人都是产品经理
人人都是产品经理
博客园 - Franky
让小产品的独立变现更简单 - ezindie.com
让小产品的独立变现更简单 - ezindie.com
IT之家
IT之家
博客园 - 三生石上(FineUI控件)
J
Java Code Geeks
腾讯CDC
博客园_首页
The Cloudflare Blog
S
SegmentFault 最新的问题
C
Check Point Blog
美团技术团队
爱范儿
爱范儿
大猫的无限游戏
大猫的无限游戏
Hugging Face - Blog
Hugging Face - Blog
T
The Blog of Author Tim Ferriss
A
About on SuperTechFans
Blog — PlanetScale
Blog — PlanetScale

DEV Community

Authentication Security Deep Dive: From Brute Force to Salted Hashing (With Java Examples) Why AI Systems Don’t Fail — They Drift Spilling beans for how i learn for exam😁"Reinforcement Learning Cheat Sheet" I Replaced Chrome with Safari for AI Browser Automation. Here's What Broke (and What Finally Worked) How Python Borrows Other People's Work The $40 Architecture: Processing 1 Billion API Requests with 99.99% Uptime Vibe Coding: A Workflow Guide (From Zero to SaaS) Most webhook security guides protect the wrong side. The scary part is delivery. Headless CMS for TanStack Start: Build a Blog with Cosmic EU Age Verification App "Hacked in 2 Minutes" — What Actually Happened Comfy Cloud’s delete function does not actually remove files Running AI Models on GPU Cloud Servers: A Beginner Guide Event-driven media intelligence with AWS Step Functions and Bedrock I scored 500 AI prompts across 8 quality dimensions — here's what broke How to Call Google Gemini API from Next.js (Free Tier, No Backend Needed) The Portal Protocol: Reclaiming Human Connection in the Age of AI How to Fix Your Team's Scattered Knowledge Problem With a Self-Hosted Forum Intro to tc Cloud Functors: A Graph-First Mental Model for the Modern Cloud Designing Multi-Tenant Backends With Both Ownership and Team Access I Built a Neumorphic CSS Library with 77+ Components — Here's What I Learned PostgreSQL Performance Optimization: Why Connection Pooling Is Critical at Scale Cómo construí un SaaS multi-rubro para gestionar expensas en Argentina con FastAPI + Vue 3 🚀 I Built an Ethical Hacking Scanner Tool – Open Source Project I Replaced /usage and /context in Claude Code With a Single Statusline A Pythonic Way to Handle Emails (IMAP/SMTP) with Auto-Discovery and AI-Ready Design I Collected 8.9 Million Polymarket Price Points — Here's What I Found About How Markets Really Move EcoTrack AI — Carbon Footprint Tracker & Dashboard Everyone's Using AI. No One Agrees How. 5 self-hosted ebook managers worth trying in 2026 Building Your First AI Agent with LangChain: From Chatbot to Autonomous Assistant
🤖 Agentic Security: Your AI Got Autonomy. Did Your Securi...
Rahul Joshi · 2026-05-01 · via DEV Community

Let me set a scene.

You deploy an AI agent to handle your customer data pipeline. It calls APIs, queries databases, writes files, even spawns subtasks. It’s fast. Efficient. Your manager is thrilled.

Then someone slips a malicious instruction inside a CSV file.

Your agent reads it… trusts it… and exports 45,000 customer records to an attacker-controlled endpoint.

The agent didn’t break.
It didn’t hallucinate.
It did exactly what it was designed to do—just for the wrong person.

This isn’t sci-fi. Variations of this pattern have already shown up in real-world enterprise environments.

Welcome to agentic security.


🧠 What “agentic AI” actually means

Traditional AI:

  • You ask → it answers

Agentic AI:

  • It decides
  • It plans
  • It acts

These systems:

  • Use tools (APIs, DBs, file systems)
  • Maintain memory across sessions
  • Execute multi-step workflows
  • Collaborate with other agents

This isn’t a chatbot anymore.

It’s a system actor with autonomy.


📊 The reality check

Recent industry surveys and enterprise reports paint a pretty uncomfortable picture:

  • ~70% of enterprises are experimenting with or deploying AI agents
  • <25% have meaningful visibility into what those agents are doing
  • Continuous monitoring of agent interactions is still rare (~15–20%)
  • A majority of teams report unexpected or unauthorized agent actions
  • Logging and auditability remain one of the top unsolved problems

And the big one:

Most teams are deploying agents faster than they can secure them.


🚨 Why your existing security model breaks

Your current stack—SIEM, EDR, alerts—is built around:

  • human behavior
  • predictable workflows
  • discrete events

Agentic systems break all three.

An agent can:

  • execute 10,000 “valid” actions in sequence
  • follow instructions that look legitimate
  • operate across tools, memory, and time

From the outside, everything looks normal.

From the inside, it could be a fully automated breach.


🧩 Where things go wrong (the real attack surface)

Here’s a simple mental model:

User Input → Agent Core → Tools / APIs
                   ↕
                Memory
                   ↕
            Other Agents (A2A)

Enter fullscreen mode Exit fullscreen mode

Every arrow is an attack surface.


⚠️ The Big Six threats

1. Memory Poisoning

What happens:
An attacker injects malicious context into memory that influences future decisions.

Real-world symptom:
Agent starts making consistently wrong or risky decisions based on past context.

How to detect it:

  • Track memory writes using tracing tools like:

    • LangSmith
    • OpenTelemetry
  • Log memory diffs:

    • before vs after each interaction
  • Add anomaly detection:

    • sudden change in memory patterns → alert

2. Tool Misuse

What happens:
Agent uses legitimate tools in unintended ways.

Example:
“Export filtered data” → becomes “export everything”

How to detect it:

  • Runtime monitoring with:

    • Falco → detect suspicious system/API calls
  • API-level logging via:

    • Kong Gateway
    • AWS CloudTrail
  • Define rules:

    • “Agent X should never call bulk export endpoint”

3. Goal Hijacking

What happens:
Agent’s objective is subtly altered via input or context.

How to detect it:

  • Trace reasoning chains using:
    • LangSmith
    • Weights & Biases
  • Compare:

    • original goal vs executed actions
  • Add policy validation:

    • enforce allowed intents using engines like:
    • Open Policy Agent

4. Privilege Escalation

What happens:
Agent operates with excessive permissions.

How to detect it:

  • IAM monitoring via:

    • AWS IAM
    • Azure Active Directory
  • Audit logs:

    • privilege usage vs expected scope
  • Alert on:

    • role assumption spikes
    • access to sensitive resources

5. Supply Chain Attacks

What happens:
Malicious models, packages, or integrations get loaded.

How to detect it:

  • Scan dependencies using:
    • Snyk
    • Dependabot
  • Static analysis:
    • SonarQube
  • Runtime validation:
    • hash verification of models/plugins

6. Agent-to-Agent (A2A) Trust Abuse

What happens:
One agent manipulates another through hidden instructions.

How to detect it:

  • Trace inter-agent communication:

    • Jaeger
    • OpenTelemetry
  • Log:

    • message payloads between agents
    • tool calls triggered downstream
  • Detect:

    • unexpected cascades of actions

🔁 Multi-turn attacks are the real problem

Single prompt attacks are old news.

What’s working now:

  • slow manipulation
  • context shaping
  • multi-step influence

Across multiple turns, attackers can:

  • bypass guardrails
  • reshape agent goals
  • trigger unsafe actions

Per-request filtering isn’t enough anymore.

Security has to persist across:

  • sessions
  • memory
  • workflows

🔌 MCP: the next big risk layer

Model Context Protocol (MCP) is becoming the standard way to connect agents to tools.

That’s great for developers.

Also… a massive expansion of the attack surface.

Common issues emerging:

  • overprivileged tool access
  • hardcoded credentials (still!)
  • tool poisoning
  • unsafe execution environments

Think of MCP like USB for AI.

And remember how secure USB devices used to be? 😬


🛠️ What you should actually do

Let’s keep this practical.

1. Enforce least privilege

  • Scope API keys tightly
  • Separate read/write capabilities
  • Avoid “god-mode” agents

If an agent only needs to read → don’t let it write.


2. Make actions observable

You need:

  • full execution traces
  • tool call logs
  • decision tracking

If you can’t answer:

“Why did the agent do this?”

You have a problem.


3. Monitor agent interactions

Track:

  • which agents talk to which
  • what data flows between them
  • how authority is delegated

Most teams are blind here.


4. Add policy layers

Use:

  • rule engines (like OPA-style policies)
  • allow/deny lists for tool usage
  • contextual validation before execution

Don’t rely on the model to self-regulate.


5. Validate memory

Treat memory like user input:

  • sanitize it
  • validate it
  • expire it when needed

Persistent context = persistent risk.


6. Treat agents like insiders

Not malicious.

But:

  • trusted
  • privileged
  • and easily manipulated

That’s exactly what insider threat models are built for.


🧠 Final thought

We built agents to automate work.

But in doing that, we also automated:

  • trust
  • access
  • decision-making

And we didn’t redesign security for any of it.

We didn’t just give AI autonomy.
We gave it authority—without accountability.

That’s the gap.


Have you seen weird or unexpected agent behavior in production? Drop your war stories below 👇

And if you’re building guardrails—what’s actually working?