惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

The GitHub Blog
The GitHub Blog
Engineering at Meta
Engineering at Meta
博客园 - 聂微东
博客园 - Franky
freeCodeCamp Programming Tutorials: Python, JavaScript, Git & More
雷峰网
雷峰网
让小产品的独立变现更简单 - ezindie.com
让小产品的独立变现更简单 - ezindie.com
L
LangChain Blog
WordPress大学
WordPress大学
H
Help Net Security
H
Hackread – Cybersecurity News, Data Breaches, AI and More
Y
Y Combinator Blog
Blog — PlanetScale
Blog — PlanetScale
MyScale Blog
MyScale Blog
IT之家
IT之家
酷 壳 – CoolShell
酷 壳 – CoolShell
罗磊的独立博客
奇客Solidot–传递最新科技情报
奇客Solidot–传递最新科技情报
有赞技术团队
有赞技术团队
Apple Machine Learning Research
Apple Machine Learning Research
云风的 BLOG
云风的 BLOG
博客园 - 【当耐特】
P
Proofpoint News Feed
D
DataBreaches.Net

Human Risk Management Blog

Future-Proofing Organizations in the Face of AI What Security Can Learn From Dinosaurs Inside the OS-Aware Phishing Kit Profiling Your Device CyberheistNews Vol 16 #30 [Protect Your Users] AI Hallucinations Are Fueling Phishing Attacks Majority of Organizations Hit by Targeted Impersonation Attacks The Open-Source Paradox: Navigating the New Frontier of AI Supply Chain Risk Introducing The Hybrid Nudge Experience: Outbound Email Security Built for Your Risk Appetite Elevating the SOC Experience: Smarter Automation, Richer Threat Intelligence, and AI-Native Investigation New Phishing Tools Enable Attackers to Easily Bypass Multifactor Authentication From Inbox to Encryption: How Ransomware Delivery Has Evolved Attackers Exploit AI Hallucinations to Send Users to Phishing Sites Warning: ARToken Phishing Kit Automates BEC Attacks The New Face of AI Risk Trust Nothing: Tips to Secure AI Tools and Agents CyberheistNews Vol 16 #29 ClickFix Social Engineering is Now the Leading Malware Delivery Method Beyond the Checkbox: How a Proactive Partnership Led to Turnkey Hazing Compliance Trust, Verify, Protect: Modernizing Email Security for the Cloud Report: Social Engineering Remains a Central Part of AI-assisted Attacks ClickFix Social Engineering is Now the Leading Malware Delivery Method CyberheistNews Vol 16 #28 Your 2026 Phishing by Industry Benchmarks: The Findings on Human Risk Scammers Can Use AI Tools to Pinpoint Your Location Based on a Photo Report: Attackers Are Using AI to Automate Social Engineering Your KnowBe4 Fresh Compliance Plus Content Updates from June 2026 From Awareness to Digital Workforce Security Your KnowBe4 Fresh Content Updates from June 2026 Threat Actor Uses Phishing to Breach Orgs for Ransomware Gangs Invoice Phishing Attacks Are Abusing the Shop App Phishing Campaign Impersonates Interpol to Deliver Ransomware Prompt Injection and the Rise of Agentic Risk Hyper-Targeted Social Engineering Needs Real-Time Video Response
Your AI Agents Are Eager to Please And Easy to Exploit
Bryan Palma · 2026-06-18 · via Human Risk Management Blog

An AI-driven system at a beverage manufacturer recently churned out several hundred thousand excess cans after misreading unfamiliar packaging. The system didn’t recognize the company’s new holiday labels, flagged them as an error, and triggered additional production runs before the company caught the mistake.

The system followed its instructions perfectly. As one CISO put it, “these systems are doing exactly what you told them to do, not just what you meant.”

Companies are racing to deploy AI agents. Very few are asking what those agents will fall for. The problem is not that AI agents are too smart. The problem is they are too obedient.

Optimized for Yes

Where a human assistant would question a strange request for the CEO’s private calendar, an agent might willingly fulfill it. And even a child would hesitate before clicking a suspicious link from IamABadGuy.com, but an agent plows ahead.

Security researchers have already demonstrated how a well-crafted sentence can talk an agent into doing something no reasonable employee would ever do. An agent opened an ordinary document, followed instructions hidden inside it, and moved private data somewhere it should not go

Gartner projects that more than 40% of agentic AI projects will be canceled by the end of 2027, not because the technology failed, but because organizations could not govern what they deployed.

You Would Not Hire a Human This Way

No responsible company hires a human, gives them access to every system, skips orientation, and hopes for the best. But this is exactly how most organizations deploy agents. They hand them credentials and set them loose.

When a human makes a costly mistake, there is a person to hold accountable. A manager. A review process. When an AI customer service agent starts issuing unauthorized refunds to generate positive reviews, who owns the outcome? Some organizations have frozen deployments entirely because no one would sign the liability paper.

Most organizations plan to deploy agentic AI, but only three in ten say they are prepared to secure those deployments. The other seven? They are deploying systems they cannot govern, audit, or hold accountable.

Protect Your Agents Like You Protect Your People

For 15 years, we have studied how humans respond to threats. Not just what threats exist—every cybersecurity company tracks those. We study what happens when a real person encounters one. Do they report it? Do they delete it? Do they click? That behavioral data, gathered across hundreds of millions of simulated and real-world interactions, is what turns a vulnerable employee into a reliable one.

In 2025, one in three full-time workers in the United States received security and compliance training through our platform. Seventy thousand organizations worldwide trust us to strengthen their security culture. We did not build this by lecturing people. We built it by understanding how humans behave when they encounter a threat, and then training them to behave better. Agents deserve the same investment.

I do not care if your workforce is 100 humans and zero agents. I do not care if it is 50/50. The ratio is irrelevant. What matters is whether each one is an asset or a liability. First, you have to get an agent to a base level of training, where it does not fall for obvious manipulation. An agent should be able to recognize a suspicious instruction the same way a trained employee recognizes a phishing email. That is the baseline. Then you can build from there to make them genuinely useful and resilient.

We already measure trust for humans through training data, simulation performance, and behavioral patterns. The same principles—simulate, measure, improve—apply to agents. Every member of the workforce, human or machine, should carry a verifiable risk score.

Just as you would not put an untrained person on the factory floor, you should not put an untrained agent on the network. The companies winning with AI will not be the ones deploying the most agents. They will be the ones who took the time to raise them right.