惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

H
Help Net Security
宝玉的分享
宝玉的分享
The Cloudflare Blog
Apple Machine Learning Research
Apple Machine Learning Research
V
Visual Studio Blog
Last Week in AI
Last Week in AI
Hugging Face - Blog
Hugging Face - Blog
博客园 - 司徒正美
博客园 - 三生石上(FineUI控件)
A
About on SuperTechFans
MyScale Blog
MyScale Blog
aimingoo的专栏
aimingoo的专栏
Microsoft Security Blog
Microsoft Security Blog
D
Docker
Cyber Security Advisories - MS-ISAC
Cyber Security Advisories - MS-ISAC
Recent Announcements
Recent Announcements
大猫的无限游戏
大猫的无限游戏
IT之家
IT之家
P
Proofpoint News Feed
L
LangChain Blog
Blog — PlanetScale
Blog — PlanetScale
The GitHub Blog
The GitHub Blog
博客园 - 【当耐特】
Martin Fowler
Martin Fowler

DEV Community

Authentication Security Deep Dive: From Brute Force to Salted Hashing (With Java Examples) Why AI Systems Don’t Fail — They Drift Spilling beans for how i learn for exam😁"Reinforcement Learning Cheat Sheet" I Replaced Chrome with Safari for AI Browser Automation. Here's What Broke (and What Finally Worked) How Python Borrows Other People's Work The $40 Architecture: Processing 1 Billion API Requests with 99.99% Uptime Vibe Coding: A Workflow Guide (From Zero to SaaS) Most webhook security guides protect the wrong side. The scary part is delivery. Headless CMS for TanStack Start: Build a Blog with Cosmic EU Age Verification App "Hacked in 2 Minutes" — What Actually Happened Comfy Cloud’s delete function does not actually remove files Running AI Models on GPU Cloud Servers: A Beginner Guide Event-driven media intelligence with AWS Step Functions and Bedrock I scored 500 AI prompts across 8 quality dimensions — here's what broke How to Call Google Gemini API from Next.js (Free Tier, No Backend Needed) The Portal Protocol: Reclaiming Human Connection in the Age of AI How to Fix Your Team's Scattered Knowledge Problem With a Self-Hosted Forum Intro to tc Cloud Functors: A Graph-First Mental Model for the Modern Cloud Designing Multi-Tenant Backends With Both Ownership and Team Access I Built a Neumorphic CSS Library with 77+ Components — Here's What I Learned PostgreSQL Performance Optimization: Why Connection Pooling Is Critical at Scale Cómo construí un SaaS multi-rubro para gestionar expensas en Argentina con FastAPI + Vue 3 🚀 I Built an Ethical Hacking Scanner Tool – Open Source Project I Replaced /usage and /context in Claude Code With a Single Statusline A Pythonic Way to Handle Emails (IMAP/SMTP) with Auto-Discovery and AI-Ready Design I Collected 8.9 Million Polymarket Price Points — Here's What I Found About How Markets Really Move EcoTrack AI — Carbon Footprint Tracker & Dashboard Everyone's Using AI. No One Agrees How. 5 self-hosted ebook managers worth trying in 2026 Building Your First AI Agent with LangChain: From Chatbot to Autonomous Assistant
What bothered me about the new SafeBreach Gemini paper wa...
AgentShield · 2026-06-05 · via DEV Community

Read SafeBreach's new Gemini paper last night. The technique itself is clever. A question in Chinese hidden behind an English one, so the user says yes to the English question while Gemini's backend security check thinks the yes maps to the Chinese one. Or the same idea using a clickable link whose URL the TTS engine refuses to read aloud. Either way, the model gets fooled, the tool fires.

But that's normal. Cat-and-mouse between security researchers and model vendors has been going for two years now. Bypass gets found. Vendor patches. New bypass gets found. Vendor patches. Forever.

What stuck with me was the timeline at the bottom.

SafeBreach reported the vulnerability to Google on August 17, 2025. Google patched it on November 14, 2025. That's three months. Three months in which any attacker could hijack Gemini's voice assistant via any notification app, WhatsApp, Slack, SMS, Signal, to do tool execution on the victim's phone. Open smart home devices. Stream video via Zoom without consent. Fake messages from people in the victim's contacts. Even poison Gemini's long-term memory, which is tied to the Google Workspace account, so the poison propagates to the tablet and the laptop too.

Three months in which nobody outside of Google could do anything about it. Disable the voice assistant entirely, or trust that the vendor has patched whatever attacks anyone has bothered to disclose so far. Those were the options.

This is the part I want to talk about. The exploit will get patched (it was, on November 14). Another one will get published, probably soon. SafeBreach themselves said so. The exploit isn't the interesting part. The patch window is.

The structural problem

Or Yair, who wrote the paper, puts the deeper issue clearly:

Existing mitigation approaches are insufficient. As long as the LLM operates as a single "magic box" that simultaneously receives backend and frontend instructions, an attacker simply needs to appear legitimate enough to bypass security guardrails.

That's the trap. When you build on a commercial LLM, the safety story sits inside the same model that's processing the attacker's input. If the attacker can get text into the prompt, which is what indirect prompt injection means, that text is in the prompt. There's no separate channel for the safety check to look at. The same neurons are doing both jobs.

Vendor mitigations help, but they're necessarily reactive. Researcher finds a phrasing trick that gets through, vendor adds it to the training, ships an update. The window between the researcher publishing and the vendor patching is where everyone using that vendor's API is exposed.

If you're building on Gemini, that window was three months for this specific bypass. For Claude, Anthropic's own Opus 4.8 system card from last week printed a 31.5% raw attack-success rate on their browser agent against an adaptive attacker. With safeguards engaged that drops to 0.5%, but only if you're using Anthropic's own Claude-in-Chrome integration, not the API. I wrote more about the cross-vendor disclosure asymmetry here.

The pattern across all four major vendors is the same. Some publish more than others. None of them give you a way to harden the integration externally. You're on their patch cycle.

What changes if you put a verification layer in front

I've been building AgentShield as this layer for the past six months. A separate process that sits between your agent and untrusted input. Different model, different weights, different update cycle. When SafeBreach publishes a new technique, you don't wait for Google to push a fix. You add the technique to your own regression test set, run it against the classifier, see if it gets caught.

If it does, you ship. If it doesn't, you have a concrete failure to debug, which is more than "hope the next vendor patch includes this" gets you.

A few properties that fall out of this:

  • Vendor independence. Same classifier in front of Claude, GPT-5.5, Gemini, or a local Llama variant. One window, not four.
  • Auditable. MIT licensed. The benchmark is 5,972 samples across six public prompt-injection datasets, with per-sample false-positive and false-negative lists published in the repo. You can see where the classifier fails before you ship anything.
  • Layered. Six layers, with normalization first (which catches the Chinese-character payload and the muted hyperlink before they reach the LLM's prompt at all), then regex catalog, then a fine-tuned MiniLM classifier, then output guard, policy engine, audit trail.

None of that is a magic bullet. The classifier has false positives, openly documented. The jackhhao role-play set hits 48% FPR in our default profile because we treat persona-override as a social-engineering preamble while the dataset labels it as benign creative writing. That's a real labeling disagreement, not a classifier bug, and it's in the report. But it's yours. Updates when you update it. No patch window between you and the next published bypass.

What this means if you're shipping

If your agent has tool access of any real-world kind, file system, browser, smart home, money, anything that persists state or affects the world, assume the safety story you got from your vendor has a patch window measured in months between published bypasses. Plan for it.

Run your own injection test set, separately from whatever the vendor publishes. Put a verification layer in front of the model that you control. Treat tool invocations as requiring an authorization that doesn't depend on the model interpreting the last user message correctly.

The next bypass is being researched right now. SafeBreach said so themselves. The question isn't whether your vendor will patch in three months. It's what runs in front of the model in the meantime.


Primary source: Exploiting Gemini via Prompt Injection by Or Yair, SafeBreach Labs, June 3, 2026.

Open benchmark and reproduction scripts: agentshield.pro/benchmark

Discussion welcome, especially from engineers shipping AI agents in production. What's the longest patch window you've seen between a published bypass and the vendor fix?