惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

GbyAI
GbyAI
Y
Y Combinator Blog
F
Fortinet All Blogs
H
Hackread – Cybersecurity News, Data Breaches, AI and More
N
Netflix TechBlog - Medium
T
Tailwind CSS Blog
aimingoo的专栏
aimingoo的专栏
博客园 - Franky
T
The Blog of Author Tim Ferriss
D
DataBreaches.Net
量子位
博客园 - 三生石上(FineUI控件)
I
InfoQ
Engineering at Meta
Engineering at Meta
WordPress大学
WordPress大学
阮一峰的网络日志
阮一峰的网络日志
爱范儿
爱范儿
D
Docker
美团技术团队
雷峰网
雷峰网
U
Unit 42
Stack Overflow Blog
Stack Overflow Blog
Recent Announcements
Recent Announcements
人人都是产品经理
人人都是产品经理

DEV Community

Authentication Security Deep Dive: From Brute Force to Salted Hashing (With Java Examples) Why AI Systems Don’t Fail — They Drift Spilling beans for how i learn for exam😁"Reinforcement Learning Cheat Sheet" I Replaced Chrome with Safari for AI Browser Automation. Here's What Broke (and What Finally Worked) How Python Borrows Other People's Work The $40 Architecture: Processing 1 Billion API Requests with 99.99% Uptime Vibe Coding: A Workflow Guide (From Zero to SaaS) Most webhook security guides protect the wrong side. The scary part is delivery. Headless CMS for TanStack Start: Build a Blog with Cosmic EU Age Verification App "Hacked in 2 Minutes" — What Actually Happened Comfy Cloud’s delete function does not actually remove files Running AI Models on GPU Cloud Servers: A Beginner Guide Event-driven media intelligence with AWS Step Functions and Bedrock I scored 500 AI prompts across 8 quality dimensions — here's what broke How to Call Google Gemini API from Next.js (Free Tier, No Backend Needed) The Portal Protocol: Reclaiming Human Connection in the Age of AI How to Fix Your Team's Scattered Knowledge Problem With a Self-Hosted Forum Intro to tc Cloud Functors: A Graph-First Mental Model for the Modern Cloud Designing Multi-Tenant Backends With Both Ownership and Team Access I Built a Neumorphic CSS Library with 77+ Components — Here's What I Learned PostgreSQL Performance Optimization: Why Connection Pooling Is Critical at Scale Cómo construí un SaaS multi-rubro para gestionar expensas en Argentina con FastAPI + Vue 3 🚀 I Built an Ethical Hacking Scanner Tool – Open Source Project I Replaced /usage and /context in Claude Code With a Single Statusline A Pythonic Way to Handle Emails (IMAP/SMTP) with Auto-Discovery and AI-Ready Design I Collected 8.9 Million Polymarket Price Points — Here's What I Found About How Markets Really Move EcoTrack AI — Carbon Footprint Tracker & Dashboard Everyone's Using AI. No One Agrees How. 5 self-hosted ebook managers worth trying in 2026 Building Your First AI Agent with LangChain: From Chatbot to Autonomous Assistant
Add a CI Gate for MCP Contract Coverage in 10 Minutes
Kioi · 2026-06-18 · via DEV Community

Kioi

Your PR is green. tools/call still breaks on Tuesday.

That gap is familiar: CI validates what you ship, not what your agent consumes. Cursor and Claude read mcp.json (or .cursor/mcp.json) and trust whatever tools/list returns today. When a vendor removes a tool or tightens inputSchema, your pipeline does not notice — because nothing in Git ever referenced that contract.

We already covered the failure mode in why MCP integrations break silently and walked a hands-on lab in ToolSchema Kit. This post is the CI half: wire a progressive gate so every mcp.json endpoint is either watched or explicitly ignored before merge.


What you are adding

DriftGuard CI is a hook → preview → trial → paid gate funnel. You can stop at any layer:

Layer Action API key Blocks CI?
1 — Hook drift-diff / compare_json No On breaking fixture diff only
2 — Preview drift-coverage-preview No No (writes Step Summary + trial link)
3 — Trial gate drift-coverage + trial session Trial secret Yes — 1 endpoint max
4 — Pro gate drift-coverage + API key dg_… Yes — plan limit (50 on Pro)

Layer 2 is the fastest win: zero secrets, scans your repo, prints which MCP URLs are not monitored. Layer 4 is what teams adopt after one postmortem like MCP tool removed over the weekend.

Full reference: docs/CI.md in the open-source repo.


Step 1 — Copy the starter workflow

Create .github/workflows/driftguard.yml:

name: DriftGuard

on:
  pull_request:
  push:
    branches: [main]

jobs:
  schema-hook:
    runs-on: ubuntu-latest
    steps:
      - uses: kioie/driftguard/.github/actions/drift-diff@v0.3.3
        with:
          before: '{"status":"ok","data":{"id":1,"name":"test"}}'
          after: '{"status":"ok","data":{"id":1}}'

  coverage-preview:
    runs-on: ubuntu-latest
    steps:
      - uses: actions/checkout@v4
      - uses: kioie/driftguard/.github/actions/drift-coverage-preview@v0.3.3
        with:
          scan-paths: mcp.json,.cursor/mcp.json,package.json

Pin @v0.3.3 (or current release) — never @main in production pipelines.

Open a PR. The DriftGuard check runs two jobs:

  1. schema-hook — proves the diff action works (swap in your own before/after fixtures later).
  2. coverage-preview — reads scan-paths, discovers MCP and API URLs, writes a GitHub Step Summary with unmonitored endpoints and one-click console links.

No files-json boilerplate — scan-paths walks the repo for you.


Step 2 — Read the Step Summary

After the preview job finishes, expand Summary on the workflow run. You should see something like:

Discovered endpoints: 3
Watched: 0
Missing: 3

→ https://driftguard.org/ci/setup?from=ci&import=…

That link opens CI setup: mint a trial session, copy DRIFTGUARD_TRIAL_SESSION into GitHub secrets, and import the first missing watch without leaving the browser.

Preview is non-blocking by default — it nudges without breaking existing repos. When you are ready to enforce, keep reading.


Step 3 — Trial gate (one endpoint)

Add a secret DRIFTGUARD_TRIAL_SESSION (from Step Summary or POST /api/trial/session). Uncomment a third job:

  coverage-gate:
    runs-on: ubuntu-latest
    steps:
      - uses: actions/checkout@v4
      - uses: kioie/driftguard/.github/actions/drift-coverage@v0.3.3
        with:
          trial-session: ${{ secrets.DRIFTGUARD_TRIAL_SESSION }}
          scan-paths: mcp.json,.cursor/mcp.json,package.json

Trial intentionally limits you to one watched endpoint. If preview finds three MCP servers and only one is covered, the gate fails with an upgrade message. That is the funnel working — not a bug.

For a single-server team (one Stripe MCP, one internal ops server), trial gate is enough to block merges until that URL is on a schedule.


Step 4 — Pro gate (multi-dependency repos)

After pricing → activate, replace the trial header with your API key:

  coverage-gate:
    runs-on: ubuntu-latest
    steps:
      - uses: actions/checkout@v4
      - uses: kioie/driftguard/.github/actions/drift-coverage@v0.3.3
        with:
          api-key: ${{ secrets.DRIFTGUARD_API_KEY }}
          scan-paths: mcp.json,.cursor/mcp.json,package.json

One dg_… key unlocks assert_coverage in MCP, the hosted API, and CI. Failures include upgrade.console URLs to bulk-import missing watches.

Local equivalent (useful in pre-commit or agent loops):

export DRIFTGUARD_API_KEY=dg_…
driftguard coverage assert --mcp-json .cursor/mcp.json

Exit code 1 when a discovered dependency is not watched.


What this does not replace

Tool Role
oasdiff Diff your OpenAPI specs at merge time
MockDrift / ToolChange Gate packages for fixtures and MCP manifest lint — see gate ladder
APM / synthetics Latency and 5xx on your HTTP surface

The CI gate answers: "Every URL in mcp.json that our agents depend on — is it on a watch?" Scheduled polling and breaking-classified alerts are hosted; the diff engine stays open source.


Suggested progression

Week 1   drift-diff on PRs (fixture or snapshot you control)
Week 2   drift-coverage-preview (see the gap, no secrets)
Week 3   Trial gate on one critical MCP server
Week 4   Pro gate when preview lists 2+ production dependencies

Optional: turn preview blocking early with fail-on-missing: true once the team agrees every discovered URL should be watched or removed from config.


Open core boundary

Free in GitHub Actions Hosted (trial / Pro)
drift-diff, compare_json register_watch, scheduled polls
drift-coverage-preview Alerts, drift history, console
Step Summary + /ci/setup deep links assert_coverage enforcement

Clone path until npm publish is fully wired: github.com/kioie/driftguardnpm ci && npm run build.


Try it

  1. Copy driftguard-starter.yml into your repo.
  2. Open a PR and read the Step Summary.
  3. Start a trial if preview lists URLs you care about.

Question for you: Do you gate third-party dependencies in CI today — OpenAPI only, MCP included, or not at all? I read every reply and will link follow-up posts (agent embedding, contract drift monitoring) based on what teams are actually running.


Series links

GitHub: kioie/driftguard · Hosted: driftguard.org