惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

TaoSecurity Blog
TaoSecurity Blog
L
LINUX DO - 最新话题
Help Net Security
Help Net Security
N
News | PayPal Newsroom
www.infosecurity-magazine.com
www.infosecurity-magazine.com
cs.AI updates on arXiv.org
cs.AI updates on arXiv.org
The Last Watchdog
The Last Watchdog
S
Security @ Cisco Blogs
W
WeLiveSecurity
C
CXSECURITY Database RSS Feed - CXSecurity.com
Webroot Blog
Webroot Blog
T
Troy Hunt's Blog
V
Vulnerabilities – Threatpost
Google Online Security Blog
Google Online Security Blog
N
News and Events Feed by Topic
T
Threat Research - Cisco Blogs
Security Archives - TechRepublic
Security Archives - TechRepublic
钛媒体:引领未来商业与生活新知
钛媒体:引领未来商业与生活新知
T
Tor Project blog
freeCodeCamp Programming Tutorials: Python, JavaScript, Git & More
D
Darknet – Hacking Tools, Hacker News & Cyber Security
PCI Perspectives
PCI Perspectives
Google DeepMind News
Google DeepMind News
T
Tailwind CSS Blog
让小产品的独立变现更简单 - ezindie.com
让小产品的独立变现更简单 - ezindie.com
Apple Machine Learning Research
Apple Machine Learning Research
IT之家
IT之家
S
SegmentFault 最新的问题
J
Java Code Geeks
P
Privacy & Cybersecurity Law Blog
Threat Intelligence Blog | Flashpoint
Threat Intelligence Blog | Flashpoint
博客园 - 【当耐特】
博客园_首页
H
Hacker News: Front Page
T
Threatpost
Jina AI
Jina AI
博客园 - Franky
月光博客
月光博客
L
LINUX DO - 热门话题
The Cloudflare Blog
H
Heimdal Security Blog
博客园 - 司徒正美
酷 壳 – CoolShell
酷 壳 – CoolShell
Cloudbric
Cloudbric
雷峰网
雷峰网
Hugging Face - Blog
Hugging Face - Blog
S
Secure Thoughts
T
Tenable Blog
I
Intezer
OSCHINA 社区最新新闻
OSCHINA 社区最新新闻

DEV Community

Authentication Security Deep Dive: From Brute Force to Salted Hashing (With Java Examples) Why AI Systems Don’t Fail — They Drift Spilling beans for how i learn for exam😁"Reinforcement Learning Cheat Sheet" I Replaced Chrome with Safari for AI Browser Automation. Here's What Broke (and What Finally Worked) How Python Borrows Other People's Work The $40 Architecture: Processing 1 Billion API Requests with 99.99% Uptime Vibe Coding: A Workflow Guide (From Zero to SaaS) Most webhook security guides protect the wrong side. The scary part is delivery. Headless CMS for TanStack Start: Build a Blog with Cosmic EU Age Verification App "Hacked in 2 Minutes" — What Actually Happened Comfy Cloud’s delete function does not actually remove files Running AI Models on GPU Cloud Servers: A Beginner Guide Event-driven media intelligence with AWS Step Functions and Bedrock I scored 500 AI prompts across 8 quality dimensions — here's what broke How to Call Google Gemini API from Next.js (Free Tier, No Backend Needed) The Portal Protocol: Reclaiming Human Connection in the Age of AI How to Fix Your Team's Scattered Knowledge Problem With a Self-Hosted Forum Intro to tc Cloud Functors: A Graph-First Mental Model for the Modern Cloud Designing Multi-Tenant Backends With Both Ownership and Team Access I Built a Neumorphic CSS Library with 77+ Components — Here's What I Learned PostgreSQL Performance Optimization: Why Connection Pooling Is Critical at Scale Cómo construí un SaaS multi-rubro para gestionar expensas en Argentina con FastAPI + Vue 3 🚀 I Built an Ethical Hacking Scanner Tool – Open Source Project I Replaced /usage and /context in Claude Code With a Single Statusline A Pythonic Way to Handle Emails (IMAP/SMTP) with Auto-Discovery and AI-Ready Design I Collected 8.9 Million Polymarket Price Points — Here's What I Found About How Markets Really Move EcoTrack AI — Carbon Footprint Tracker & Dashboard Everyone's Using AI. No One Agrees How. 5 self-hosted ebook managers worth trying in 2026 Building Your First AI Agent with LangChain: From Chatbot to Autonomous Assistant Common SOC 2 Failures (Real World) Stop Vibe-Checking Your AI App: A Practical Guide to Evals How to Use SonarQube and SonarScanner Locally to Level Up Your Code Quality Your Next To-Do App Is Dead — I Replaced Mine with an OpenClaw AI Sign a Nostr event in 60 lines of Python using coincurve — no nostr-sdk, no nbxplorer, no rust toolchain ITGC Audit Explained Like You’re in Big 4 Patch Tuesday abril 2026: Microsoft parcha 163 vulnerabilidades y un zero-day en SharePoint Stop scraping everything: a better way to track competitor price changes Listing on MCPize + the Official MCP Registry while routing payments OUTSIDE the marketplace — how I kept 100% of my x402 revenue Building an AI-Powered Risk Intelligence System Using Serverless Architecture Why We Ripped Function Overloading Out of Our AI Toolchain Testing AI-Generated Code: How to Actually Know If It Works SaaS Churn Is Killing Your Business. Here Is What to Do About It (Without a Support Team) The Speed of AI Is No Longer Linear - And Self-Improving Models Are Why How to Implement RBAC for MCP Tools: A Practical Guide for Engineering Teams From Standard Quote to Persuasive Proposal: AI Automation for Arborists I built a CLI that scaffolds complete multi-tenant SaaS apps Axios CVE-2025–62718: The Silent SSRF Bug That Could Be Hiding in Your Node.js App Right Now The dashboard that ended our friendship Data Pipelines Explained Simply (and How to Build Them with Python) The Hidden Cost of AI Systems Nobody Talks About. undefined vs undeclared, and how typeof behaves Switching from file-based jobs to NATS/Kafka in Rust without changing code io_uring Adventures: Rust Servers That Love Syscalls Why Agentic AI is Killing the Traditional Database The POUR principles of web accessibility for developers and designers Quantum Neural Network 3D — A Deep Dive into Interactive WebGL Visualization How To Install Caveman In Codex On macOS And Windows Automation Pipeline Reliability: Why Your Workflow Breaks When Nobody Is Watching I Built an 'Open World' AI Coding Agent — It Works From ANY Folder From Freelancing to Product: A Tech Service Company's SaaS Transformation China's AI Giants: Adding Tencent Hunyuan & ByteDance Doubao to AI University (74 Providers) On the Vibe Coders and Their Lies clerk: Auto-Summarize Your Claude Code Sessions AI Weekly — 2026/04/10–04/17 | The Model Lockdown Is Here, but the Toolchain Is the Real Battleground AI 週報 — 2026/04/10–2026/04/17 模型封鎖潮來了,但工具鏈才是真戰場 Maybe this is how Open-Source apps are born... 🚀 Fine-Tune LLMs with LoRA and QLoRA: 2026 Guide tRPC v11 + Next.js App Router: End-to-End Type Safety Without the Boilerplate ShadCN UI in 2026: Why I Stopped Installing Component Libraries and Started Owning My Components SaaS Billing in React Server Components: Stripe + Supabase Without a Single `useEffect` Join our DEV Weekend Challenge — $1,000 in Prizes Across TEN winners! Submissions Due April 20 at 6:59 AM UTC. Implementing FSRS Spaced Repetition in Flutter + Supabase — Adding Memory Science to an AI Learning App "I Texted My Localhost From the Train — Claude Code Fixed the Bug Before I Got Home" I Built a Sales Prep AI and It Went Deeper Than Expected Design to Code #2: One JSON, Eleven Outputs Solving the 100M-Row Problem: A Summary Table Pattern for High-Volume Push Notification Logs Flutter Web With Wasm: What Actually Changes For Developers I Built 50 Royalty-Free Soundtracks for My Side Project in a Weekend Using AI Music Generation The Vibe Coding Security Checklist: 7 Things to Check Before You Ship Stop Letting Googlebot Guess Fix Your React App's SEO Right Desconstruindo o Streaming do LinkedIn: Como Criar um Engine de Extração de Vídeo de Alta Performance com HLS e FFmpeg (EDA Part-1) EDA (Exploratory Data Analysis) Explained With Real Life — Why Looking at Your Data Is the Most Important Step in Machine Learning Brand Relationship Management at Scale: Our 4-Touch Outreach System for 200+ Brands Why String.fromEnvironment() Might Return an Empty String in Dart JGuardrails 1.0.0 — Hardening Java LLM Apps Against Jailbreaks, Toxicity, and Prompt Injection Plan and Schedule a Full Week of Threads Content From One Claude Conversation Coding Cat Oran Ep3, Five Tables Changed Everything Updated: BFF Pattern I'm done watching freelancers get buried by 200 proposals. So I'm building the alternative. This is my first post BFS Algorithm in Java Step by Step Tutorial with Examples Tracking LLM Pricing Monthly: An Open Dataset for 22 AI Models How We Measure Content ROI on a Comparison Site: Revenue Attribution Without Perfect Data Introducing Nova AI Ops: The AI-Native Operating System for SRE Teams I built a free desktop video downloader for Windows — Grabbit How Talkie OCR Helps Vision-Impaired & Dyslexic Users Read the World Around Them VRCFaceTracking安装和iPhone面捕配置教程,有bug Even CrowdStrike Can't See Your Agents The Automation Gold Rush: What n8n Workflows and Claude Are Opening Up for Developers Right Now
Stratagems #1: Mark Johnson Walked Into an AI Audit. The Benchmark Had Everything Figured Out — Except the Truth.
xulingfeng · 2026-06-24 · via DEV Community

Complete preparation breeds complacency. What is seen every day no longer raises suspicion. The hidden lies within the open — not opposed to it.
— The 36 Stratagems, "Deceive the Heavens to Cross the Sea"

The phone rang at 3:50 AM.


12 Years as a Prompt

The company extracted his 12 years of infrastructure expertise into an AI Skill. 96.8% diagnostic accuracy. The CEO sent a company-wide email: "Twelve years of experience, now available as a Prompt." Then they laid Mark off.

Six weeks later, the company migrated from RabbitMQ to Kafka. Nobody re-ran the validation. The AI Skill executed its old 450ms retry logic — dead right for RabbitMQ, catastrophic for Kafka. At 4:12 AM, the CTO called. He was offering five times Mark's old monthly salary for a two-week onsite contract.

Those two weeks ended. Mark didn't stop. Over the next two years, he took eleven contracts. The industry whisper network gave him a nickname: the one-man audit team. He got the calls nobody else got — companies burned by AI platforms, too embarrassed to say it out loud. Every contract made him more certain of one thing: nobody rushing AI into production had actually understood their own systems.

Then a message landed in his LinkedIn inbox. A partner at a VC firm.


$18M, Not $18K

"The company is called Pulse AI." The partner's voice had that fast-clip rhythm investors always have. "AI testing platform. Series B. Legal DD cleared. Technical DD — we need someone who actually knows what they're looking at."

"What are you suspicious of?"

"Not suspicious of anything. The CEO's reports are gorgeous — papers published, benchmarks run, claiming 89% production defect detection. But we're writing a check for $18 million, not $18K. Go take a look."

Before hanging up, he added: "Their CTO is someone named Torres. Ring a bell?"

Mark didn't answer. He hung up, then opened a browser tab he'd bookmarked two months ago — a technical architecture post by Pulse AI's CTO. He scrolled to the data pipeline topology diagram, zoomed in, and read the component naming convention: /pulse/ingestion/{env}/{source}. Slash-delimited hierarchy, environment variable in the middle, source as the tail — the exact same naming convention he'd seen in the AI Skill pipeline docs at his old company before they let him go.

Not a coincidence.

He replied to the partner: "I'm in. Two weeks."


The Same Sticker

Technical DD kicked off Tuesday morning.

Pulse AI gave them a conference room on the fourth floor — no windows, one monitor, company values poster on the wall. CTO Torres was early forties, navy polo shirt, handshake like a vise. Mark had seen him before — four years ago, at an industry conference. Front row. Asked three questions after the talk. Mark noticed the blue sticker on Torres's laptop — identical to the IT asset tags the ops team at his old company all used. Mark set his backpack by his feet, pulled out a worn black travel mug from the side pocket, and placed it on the table.

Same mug.

Mark didn't say anything about knowing him. Mentally, he added the thread to his notes.

Torres demoed Pulse Benchmark. Pipeline-style — code commit triggers tests, test results flow into the evaluation set, the evaluation set gets matched against the defect database, and a detection rate pops out. Clean. Closed-loop. Automated. Mark nodded along, but his brain was somewhere else: the sticker on Torres's laptop — palm rest, bottom right, 3 o'clock position — exact same placement as the one he'd seen four years ago.

Not a coincidence anymore.


Wait for the Crack

Mark asked the question everyone should have asked: "Can I see the evaluation set data?"

"Sure." Torres answered fast. "I'll have someone prep it."

Then he waited. All day. Wednesday morning Torres emailed: "Data prep in progress, this afternoon." Afternoon became evening. Mark didn't push — he wasn't waiting for the data. He was waiting for the cracks that show up when someone's scrambling to clean things up.

Wednesday, 3 PM. The evaluation set arrived. 1,247 defect samples. Each one a JSON — source code snippet, stack trace, error severity classification, reproduction steps. At a distance, it looked gorgeous. Clean enough to frame.

Every JSON had an extra line in the metadata: processed_by: Apex-Lens-Cleaner v1.0.0. Cleaner tools in data prep pipelines are normal. But Mark stared at that module name for two extra seconds. Never seen it before. Filed.

He went through them one by one. At sample 30, he stopped.

A Java null pointer exception. Stack trace pointed precisely to a service-layer method, parameter was null. Reproduction steps: "Call foo(null) to trigger." Too textbook. Every NPE Mark had ever seen in production had at least seven or eight layers of stack trace — log threads, GC pauses, truncated variable values mixed in. This one had four layers. Zero noise.

Production data is dirty. This data isn't.

He wrote a keyword search script and cross-referenced the evaluation set against three open-source defect databases. Ran it twice. Same result both times.

44 exact matches against public defect databases — source snippets, stack trace line numbers, exception types, line for line. 54 with clear signs of handcrafted construction — code structures that were "too clean," nowhere to be found in any public repo, but the engineering fingerprint was too heavy to hide.

He color-coded the samples: red (exact match with public DB), yellow (suspected handcrafted), green (undetermined).

Red plus yellow: 98. Out of 1,247. 7.9%.

That's enough to call it. This isn't about the percentage. It's about what the percentage means.

He closed his laptop and walked to the break room for water. Passing Torres's desk, Torres was on a call — voice low, but a single line drifted out just as Mark walked by: "…I don't care how. Just get the number where it needs to be before the board."

Where does he need the number to be?

Mark walked back to the conference room, water glass in hand. In his memo, he wrote a line only he would understand: "44+54. Torres wants a number, not the truth."

He wasn't in a hurry. A cat doesn't rush when it knows the mouse can't get away.


Questioning the PhDs

The next morning, Mark scheduled a meeting with the evaluation team.

Three people. All PhDs. All visibly proud of their work. No PM, no Torres. Mark asked one question: "How many rounds of edits does a defect go through, on average, from production report to sample?"

The team lead hesitated. "…Two or three, usually. Mostly noise removal. Format standardization."

He stopped, looked at Mark. "Is that a problem?" — with that defensive edge PhDs get when an outsider questions their domain. Mark's stomach dropped: this PhD wasn't even sure himself whether the provenance of those samples was clean.

"Noise removal." Mark repeated the phrase in his head. A 48-line null pointer exception, after "noise removal," becomes 12 lines. What got deleted wasn't noise. It was the fingerprints of real production data.

He didn't call it out in the meeting. That wasn't his style.

After the meeting, Mark pretended to take a wrong turn — Pulse had an open floor plan, ops team sat deepest in. Walking past, he scanned the desks — keyboard tray angle, acrylic badge holder placement — identical to his old company.

Not a coincidence anymore. It was habit. You can't pick up an entire system architecture and move it. But you can pick up someone else's naming conventions. Mark went back to the conference room and added a line to his notes: Didn't build from scratch. Transplanted.


Not a Coincidence. A Copy.

That night, Mark did something the VC wasn't paying him to do.

He reverse-engineered the data pipeline topology from Pulse Benchmark's paper. The paper claimed the evaluation set came from "real production defect reports." But where was the raw data stored? Who wrote the collection scripts? None of that information was there. But the third paragraph of the Methodology section had one sentence: "The evaluation set was manually curated from production defect reports over a 14-month period."

Mark placed that sentence next to the AI Skill training set documentation he'd saved before he got laid off.

Not "similar." Verbatim.

Same people wrote it. Or the same people's documents were open on a Pulse desktop.

He wrote a note. Five lines:

  • Benchmark evaluation set: 44 exact matches against public DBs + 54 handcrafted. 7.9% hard evidence.
  • Data pipeline naming: /pulse/ingestion/{env}/{source} — identical to old company's AI Skill pipeline.
  • Workspace standards + asset tags: Transplanted.
  • Paper language: "manually curated from production defect reports" — verbatim copy.
  • Apex-Lens-Cleaner v1.0.0: Processed the evaluation set. But this name doesn't appear anywhere in Pulse's public architecture. A module that doesn't officially exist is running.

He didn't put those notes in the email. The VC hadn't asked for that.

He wrote the partner one paragraph:

"Pulse Benchmark evaluation set: 1,247 defect samples. Minimum 44 are exact matches against public defect databases — line-for-line identical. An additional 54 show clear signs of manual fabrication. Combined: 98 samples, 7.9%. Recommendation: re-run the Benchmark after removing all samples overlapping with public databases."

He hit send. Closed the laptop. The partner didn't wait until morning. The email was forwarded to Pulse's CEO's inbox at 1 AM.

Those 44 were just the tip of the iceberg — run fuzzy matching, variable renaming, control-flow equivalent transforms, and the number you'd catch would at least triple. He didn't put that in the email. Let your opponent wonder what else you're holding. It works better than showing all your cards.

The CEO forwarded it to Torres. The phone rang at 3:50 AM.


Three Seconds

Mark glanced at the caller ID and picked up.

Torres didn't speak. The silence lasted about ten seconds.

Then he spoke. Quiet. No preamble. "The CEO wants me to get the Benchmark number to 95% before Series C. I have six months. Those 44 — my evaluation team pulled them from public databases. GitHub Issues, Stack Overflow, CVE database. The 54 — couldn't find suitable replacements, so we wrote them ourselves."

A long pause.

"I'm not trying to steal VC money. I'm trying to get the number there first, raise the round, then spend a year building a real production pipeline."

He'd rehearsed that line.

Mark didn't engage. He asked a question Torres hadn't prepared for: "Who built your ingestion pipeline?"

Silence on the other end. One second. Two. Three.

The length of the silence was the answer.

"…How do you know about that?" Torres's voice had changed.

"I won't dig into it," Mark said. "But I've seen /pulse/ingestion/{env}/{source} before. Before I left my old company, the AI Skill pipeline was called /knowledge/ingestion/{env}/{source}. You were there. "

Torres didn't answer.

Mark waited five seconds. Then he hung up.


Just a Ticket

He didn't have direct proof the two pipelines were built by the same person. But Torres hadn't denied it. On a 3:50 AM phone call, staring at a data pipeline name he had no business recognizing — silence is confirmation.

He opened his laptop and added a new line below those five notes:

  • Torres didn't deny it. The silence is the answer.

Still dark outside. The VC partner sent a reply — 3:51 AM. "Keep going."

Mark shut his laptop.

He didn't tell the partner the real reason he'd taken this job. It wasn't the VC's money. It was what he'd known the moment he saw that architecture post two months ago — that pipeline naming convention was a signature he'd recognize anywhere. Caleb's handwriting. Slash hierarchy, env-in-the-middle, source-suffix — the mark left by the engineer who sat across from him for three months, the one who always asked "Why 450 milliseconds?" You can't teach it. And you can't forget it. Caleb had vanished after the big layoffs. LinkedIn silent. GitHub frozen. Like he'd evaporated from the industry. And then his naming convention showed up in the data pipeline of a company called Pulse.

The VC's DD was just a way in.

He picked up the worn black travel mug from the table — the one he'd refilled three times during the meeting. Last time he'd been walked out of an office, he had nothing in his hands. This time, he had a thread. A line he could follow.

This is deceiving the heavens to cross the sea.


🤖 AI Post-Match Analysis

[36 Stratagems Database v3.1] Loaded
[Match Target] Deceive the Heavens to Cross the Sea
[Analysis Mode] Full-spectrum scan
━━━━━━━━━━━━━━━━━━━━
Tactic Match: 92.3%
Subject: Mark Johnson
Action: Covert audit objective disguised as routine technical DD workflow
Target: Torres / Pulse AI
Outcome: Achieved

Counter-Detection:
  - Torres team: Concurrent application of same stratagem
  - Forged samples: 98/1,247 (7.9%) processed through Apex-Lens-Cleaner pipeline
  - Source: 44 from public DBs + 54 handcrafted

Situation Assessment:
  - Mark Johnson: 12yr experience → AI Skill → redeployed as AI Kill. Legitimate identity, offensive audit.
  - Torres team: Defective data embedded in evaluation set. Defensive concealment.

Verdict: Tactic-neutral. Legitimacy determined by deployment vector. Defensive concealment ≠ offensive exposure.


Next stratagem: Besiege Wei to Rescue Zhao

P.S. English isn't my first language. I use AI to polish the writing and help with storycraft. Thanks for reading. ☕ Buy me a coffee