惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

C
Cisco Blogs
NISL@THU
NISL@THU
G
GRAHAM CLULEY
T
Threatpost
I
Intezer
D
Darknet – Hacking Tools, Hacker News & Cyber Security
P
Proofpoint News Feed
L
Lohrmann on Cybersecurity
Cisco Talos Blog
Cisco Talos Blog
P
Privacy & Cybersecurity Law Blog
Security Latest
Security Latest
P
Palo Alto Networks Blog
L
LINUX DO - 热门话题
Cyberwarzone
Cyberwarzone
AI
AI
Help Net Security
Help Net Security
Forbes - Security
Forbes - Security
T
The Exploit Database - CXSecurity.com
月光博客
月光博客
The GitHub Blog
The GitHub Blog
aimingoo的专栏
aimingoo的专栏
C
CERT Recently Published Vulnerability Notes
CTFtime.org: upcoming CTF events
CTFtime.org: upcoming CTF events
N
News and Events Feed by Topic
Recent Commits to openclaw:main
Recent Commits to openclaw:main
Scott Helme
Scott Helme
A
About on SuperTechFans
N
Netflix TechBlog - Medium
TaoSecurity Blog
TaoSecurity Blog
V
V2EX
MongoDB | Blog
MongoDB | Blog
AWS News Blog
AWS News Blog
Google DeepMind News
Google DeepMind News
Google Online Security Blog
Google Online Security Blog
O
OpenAI News
Y
Y Combinator Blog
S
Securelist
GbyAI
GbyAI
D
Docker
SecWiki News
SecWiki News
The Hacker News
The Hacker News
有赞技术团队
有赞技术团队
T
Tenable Blog
WordPress大学
WordPress大学
S
SegmentFault 最新的问题
P
Privacy International News Feed
S
Security Affairs
让小产品的独立变现更简单 - ezindie.com
让小产品的独立变现更简单 - ezindie.com
Hacker News - Newest:
Hacker News - Newest: "LLM"
H
Hackread – Cybersecurity News, Data Breaches, AI and More

Hacker News: Show HN

PurrrrrFocus: Pomodoro Timer App - App Store Workflow Engine — Multi-Step Orchestration for Bun RapidPhoto: Pro Photo Editor App - App Store GitHub - DheerG/swarms: Achieve extraordinary results with claude code across a variety of tasks SPICE simulation → oscilloscope → verification with Claude Code — Lucas Gerads Show HN: VCoding – A 5 MB native Windows IDE with no dynamic dependencies Show HN: LLMs don't hallucinate because they're bad at math, it's the format GitHub - Agent-FM/agentfm-core: AgentFM is a peer-to-peer network that turns everyday computers into a decentralized AI supercomputer. AgentFM lets you run massive AI workloads directly across a global mesh of idle CPUs and GPUs. Show HN: Tracking Top US Science Olympiad Alumni over Last 25 Years GitHub - Potarix/agent-hub: One place to talk to all your agents Show HN: Runtime security for AI agents(injection,tool abuse, data exfiltration) GitHub - dubeyKartikay/lazyspotify: Terminal Spotify client for macOS and Linux GitHub - the-banana-tool/king-louie: Easy to use GUI Personal AI Assistant. Win/Linux/Mac. Show HN I made my vacation rental bookable by AI agents–no Airbnb, 0% commission GitHub - basteez/jsf-autoreload: maven plugin to enable hot reload on jsf projects uvm32/hosts/host-gdbstub at main · ringtailsoftware/uvm32 GitHub - labsai/EDDI: Config-driven engine that turns JSON into production-grade AI agents. Multi-agent orchestration, 12+ LLM providers, MCP/A2A protocols, RAG, persistent memory, and enterprise compliance (EU AI Act, GDPR, HIPAA). Built on Quarkus. GitHub - glitchnsec/fortyone-oss: AI Executive Assistant Platform Quickstart | Alien GitHub - muxshed/shed: One stream in, or many. Every destination, simultaneously. No cloud middleman, no per-channel fees, no limits. GitHub - ocrbase-hq/ocrbase: 📄 PDF/IMG ->.MD/JSON Document OCR API for PaddleOCR and GLMOCR. Self-hostable. GitHub - impactjo/home-memory: MCP server that lets your AI assistant remember everything about your home. GitHub - Sets88/dbcls: DbCls is a powerful terminal database client that supports various databases GitHub - neptun2000/heor-agent-mcp GitHub - SeanFDZ/macmind: Single-layer transformer in HyperTalk for the classic Macintosh RollQuation: Math Puzzles - Apps on Google Play GitHub - dropbox/witchcraft Show HN: Agent-cache – Multi-tier LLM/tool/session caching for Valkey and Redis GitHub - opentalon/opentalon: OpenTalon is an open-source platform built from the ground up in Go as a robust alternative to OpenClaw LinkedIn™ 职位抓取工具 - Chrome 应用商店 GitHub - EdoardoBambini/Agent-Armor-Iaga: AI agents are getting tool access — shell, file system, databases, APIs, secrets. But **nobody is governing what they actually do with it**. Frameworks like LangChain, CrewAI, AutoGen, and Claude Code give agents the power to execute. Agent Armor gives you the power to control, audit, and approve every single action before it happens. HN Vibes — Week 15, Apr 7–13 2026 GitHub - chojs23/ec: Easy terminal-native 3-way git mergetool vim-like workflow GitHub - SethPyle376/hiraeth: Local AWS emulator focused on fast integration testing, with SQS support, SQLite-backed state, and a debug-friendly web UI. GitHub - JakOb-dotcom/cloud-sandbox-security-analysis: Technical analysis and Proof of Concept (PoC) regarding environment variable exfiltration in containerized cloud sandboxes via side-channel data leaks. Springboards - Flint Alpha Show HN: A simpler coding agent harness GitHub - audiodude/sudomake-friends GitHub - 256thFission/mini-mythos: OSS clone of Anthropic’s Mythos harness to locate C/C++ memory vulnerabilities Show HN: OpenParallax: OS-level privilege separation for AI agent execution Hacker News Sorted - Chrome 应用商店 Show HN: How to Install Docker on Ubuntu 24.04 LTS: Complete 2026 Guide GitHub - himanshudongre/smriti GitHub - sverrirsig/claude-control: macOS desktop dashboard for monitoring and managing multiple Claude Code sessions GitHub - ory/dockertest: Write better integration tests! Dockertest helps you boot up ephermal docker images for your Go tests with minimal work. Chiral - Chrome 应用商店 Show HN: Two Claudes collaborating through shared memory on a $100 mini-PC GitHub - pmichaillat/latex-cv: Minimalist LaTeX template for academic CVs GitHub - oguzbilgic/posse: A web UI for Anthropic Managed Agents. GitHub - sshiraz/depsly: Dependency risk analysis tool for npm packages ABI Add safari/agent-harness — Safari browser automation via safari-mcp by achiya-automation · Pull Request #212 · HKUDS/CLI-Anything GitHub - Halfblood-Prince/trustcheck: Verify PyPI package attestations and improve Python supply-chain security GitHub - oguzbilgic/kern-ai: Agents that do the work and show it. GitHub - bruits/satteri: High-performance Markdown and MDX processing for the JavaScript ecosystem GitHub - tylergibbs1/feedstock: High-performance web crawler and scraper for TypeScript, powered by Bun and Playwright GitHub - Grimm67123/grimmbot: The self-improving sandboxed and open-source AI agent. With persistent memory and scheduling. GitHub - whitevanillaskies/whitebloom: Local whiteboard that blooms. GitHub - hwdsl2/docker-whisper: Docker image for a self-hosted Whisper speech-to-text server with speaker diarization and OpenAI-compatible transcription and translation APIs. Powered by faster-whisper. Supports all Whisper models, NVIDIA GPU (CUDA) acceleration, JSON/SRT/VTT output, SSE streaming, offline mode, and multi-arch (amd64, arm64). GitHub - yisding/reviewwiggum GitHub - MarwanAlsoltany/serrors: Structured errors for Go: sentinel hierarchies, typed data, custom formatting, and slog integration. GitHub - soatok/age-php GitHub - Luthiraa/markitme GitHub - stagas/rtdiff: realtime git diff gui and AI-assisted commits GitHub - tombedor/excalicharts GitHub - wh1le/excalidraw-edit: Open and edit .excalidraw files from the terminal. Offline, auto-saves to disk. MalExt Sentry - Malicious Extension Scanner - Chrome 应用商店 GitHub - syi0808/asciianimesvg: Generate animated ASCII art SVGs from text. CLI, Rust library, WASM, and web editor. GitHub - zaina-ml/ml_forge: A visual-based graph node editor for training computer vision models. GitHub - anakin87/llm-rl-environments-lil-course: 🌱 A little course on Reinforcement Learning Environments for evaluating and training Language Models GitHub - takaakit/superpowers-uml: Superpowers-UML modifies Superpowers to ensure a software development workflow in which AI agents design through UML modeling. AdriByte Studio - Sviluppo Web e Soluzioni Digitali GitHub - chouligi/angel-copilot: Your personalized Angel Investment Advisor Show HN: MoodSense AI (ML and FastAPI and Gradio, Deployed on Hugging Face) Moodsense Ai - a Hugging Face Space by aman179102 GitHub - agenteractai/lodmem: Level Of Detail Context Management for Agents GitHub - ostefani/subnetlens: A fast, concurrent network scanner with a TUI and plain-text CLI, built in Go. It discovers live hosts on your network, scans their open ports, resolves hostnames, and fingerprints operating systems—delivered. Cyber Pulse: Agentic Intel - Apps on Google Play Whisper API: Self-Hostable Speech to Text Transcription The Agent-Web Protocol Stack: A Research Thesis GitHub - msmarkgu/RelayFreeLLM: A restful API designed to route user prompts to various AI model providers. Show HN: Provepy – A Python decorator that proves your code using Lean and LLMs Show HN: Pardonned.com – A searchable database of US Pardons GitHub - patrickdappollonio/dux: Dux is a terminal UI that lets you run multiple AI coding agents side by side, each in its own git worktree, with full companion terminals, macros, commit generation, and a command palette that knows more tricks than you do. kMC Crystal Simulator Show HN: HyperFlow – A self-improving agent framework built on LangGraph GitHub - stef41/vibescore: 🎵 Grade your vibe-coded project. One command, instant letter grade across security, quality, dependencies, and testing. GitHub - stef41/lmscan: 🔍 Detect AI-generated text and fingerprint which LLM wrote it. Open-source GPTZero alternative. Zero dependencies, works offline. imgur.com GitHub - visionscaper/collabmem: Enabling long-term collaboration with Agentic AI - building up episodic and world model memory over time with in-context awareness 在 Steam 上购买 FriedrichAI: Offline AI 立省 10% GitHub - atripati/ark: AI Runtime Kernel — a context operating system for AI agents. Eliminates tool bloat, loads only what’s needed, and gives LLMs their reasoning space back. GitHub - nowork-studio/toprank: Open-source Claude Code skills for SEO, SEM, Google Ads GitHub - tacomanator/sash: Lightweight macOS menu bar app for reliably cycling through windows of the current application. Appents | Social Media Management for Product-First Teams GitHub - pnhoang/youtube-spam-blocker: Automatically detects and hides spam messages in YouTube Live chat. Set rate limits, keyword filters, and block repeat offenders. GitHub - decisionnode/DecisionNode: CLI + Local MCP - A shared structured memory store across Claude Code, Cursor, Windsurf, Antigravity, and every MCP client. Semantically queryable. GitHub - AvaCodeSolutions/django-email-learning: An open source Django app for creating email-based learning platforms with IMAP integration and React frontend components. The $100K Gap in Kubernetes Security Tooling Function Calling Harness: From 6.75% to 100%
GitHub - gagarwal304/databridge: DataBridge is an open-source MCP server that gives AI agents (Claude, GPT, Gemini, and any MCP-compatible agent) reliable, safe, and intelligent access to heterogeneous databases.
gagarwal123 · 2026-06-24 · via Hacker News: Show HN

DataBridge — The Intelligent Database Layer for AI Agents

One MCP server. Any database. Benchmark-proven.

DataBridge is an open-source MCP server that gives AI agents (Claude, GPT, Gemini, and any MCP-compatible agent) reliable, safe, and intelligent access to heterogeneous databases. It sits between your agent and your data — handling connections, enforcing safety, learning schema, normalizing cross-database joins, and running post-query transforms so the agent gets answers, not raw data engineering problems.

Benchmarked on DataAgentBench (DAB) — the UC Berkeley + Hasura benchmark for real-world data agents across 12 datasets and 4 database systems.


Why DataBridge Exists

Enterprise data lives across multiple systems simultaneously — PostgreSQL for transactions, MongoDB for documents, DuckDB for analytics, SQLite for local state. Answering a single business question often requires querying all of them together.

Current AI agents fail at this in four specific ways:

1. Silent wrong answers. An agent joins PostgreSQL's integer subscriber_id: 12345 with MongoDB's string "CUST-0012345", gets zero rows, and confidently reports "no results found." No error. No warning. Wrong answer delivered with certainty.

2. No safety layer. Agents given database access can — and do — execute destructive operations. A misunderstood task becomes a DELETE FROM orders with no WHERE clause. Prompt-based safety instructions are insufficient. A deterministic enforcement layer is required.

3. Cold start every session. Every new agent session re-discovers schema from scratch — re-reading table definitions, re-learning join patterns, re-discovering that customer_id in PostgreSQL maps to _id in MongoDB. This wastes tokens, time, and produces inconsistent results.

4. Raw row fetching. Agents pull full tables into context when they should push aggregation to the database. A SELECT * on a 500,000-row table is a context window disaster.

The Evidence

DataAgentBench tests agents on 54 realistic queries across 12 real-world datasets spanning PostgreSQL, MongoDB, SQLite, and DuckDB:

System DAB Pass@1
DataBridge + GLM-5.2 61.37%
MinusX + Claude Sonnet 4.6 + GPT-5.5-mini + Claude Haiku 4.5 65.2%
Altimate Code + GPT-5.5 + Claude Sonnet 4.6 63.1%
Spacedock (Recce) + Claude Opus 4.8 67.2%
Altimate Code + Claude Sonnet 4.6 68.2%
Altimate Code + Claude Sonnet 4.6 68.2%
Altimate Code + GPT-5.5 + Claude Sonnet 4.6 71.7%

DataBridge with a significantly lower cost model matches frontier models


What DataBridge Does

DataBridge exposes a single MCP interface that any agent calls with a natural language question or structured intent.

Agent: "Which customers bought product X in Q1 but not Q2, and what was
        their average order value?"

DataBridge:
  → Identifies: orders in PostgreSQL, customer profiles in MongoDB
  → Plans: two sub-queries + cross-DB join
  → Normalizes: integer customer_id (PG) ↔ string "CUST-XXXXX" (Mongo)
  → Safety check: read-only enforcement at parser level
  → Executes: sub-queries, merges results
  → Returns: clean structured JSON

Agent receives: the answer, not the data engineering problem.

Features

Universal Connection

Connect any combination of databases by listing their URIs in a single environment variable — comma-separated, no config files required.

Supported databases: PostgreSQL · MongoDB · SQLite · DuckDB

DATABRIDGE_DATABASE_URIS=postgresql://user:pass@localhost:5432/mydb,sqlite:////absolute/path/to/file.db

Pass it in your MCP client config, in a .env file, or directly in the shell. SQLite and DuckDB paths must be absolute (4 slashes: sqlite:////).


Safety Enforcement

Deterministic safety. Not prompt-based instructions.

  • All queries are read-only by default — enforced at the SQL parser level
  • DML (INSERT, UPDATE, DELETE) and DDL (CREATE, DROP, ALTER) blocked unconditionally
  • No prompt injection can override parser-level enforcement

Schema Memory

Persistent, versioned knowledge about your databases.

  • Schema scanner: introspects all connected databases, stores column types, row counts, null rates
  • Schema cache: persists to local SQLite — no re-scanning on every session
  • Diff detection: flags schema changes since last scan

Cross-database join registry:

Auto-discovers join keys between databases using column name similarity (WordNet + rapidfuzz) and value sampling with a transform grammar. Covers common format differences like 12345"CUST-0012345" without API calls. Human confirmation flow for ambiguous pairs.

{
  "join_id": "orders_customers",
  "source": { "db": "prod_postgres", "table": "orders", "column": "customer_id" },
  "target": { "db": "prod_mongodb", "collection": "users", "field": "_id" },
  "transform": "CUST-{zero_pad(value, 7)}",
  "confidence": 0.97
}

Query Intelligence

Cross-database query planning and execution.

Sub-query spec format — run queries across multiple databases in one call:

{
  "sub_queries": [
    {"db": "sqlite",  "query": "SELECT Name, Version FROM packageinfo WHERE IsRelease=1", "key": "pkg"},
    {"db": "duckdb",  "query": "SELECT Name, Version, ProjectName, Project_Information FROM project_packageversion JOIN project_info ...", "key": "ppv"}
  ],
  "join_on": [["pkg.Name", "ppv.Name"], ["pkg.Version", "ppv.Version"]],
  "transform": [
    {"op": "extract_number", "column": "Project_Information", "metric": "stars", "output": "stars"},
    {"op": "top_n_with_ties", "column": "stars", "n": 5}
  ]
}

Post-query transform pipeline — agents declare what to compute; DataBridge executes it:

Transform What it does
extract_number Pulls a numeric metric from prose text ("38,715 stars", "94k")
top_n_with_ties Returns top-N rows including all tied items — LIMIT N silently truncates ties
sort Sorts rows by column, ascending or descending
cast_number Strips commas/spaces from a text column and casts to integer
compute_ema Exponential moving average per group, sorted by a time column
parse_date Extracts year/decade from prose text containing embedded dates
round_down Rounds a numeric column down to the nearest N (e.g. decade)

Agents never write TRY_CAST(REPLACE(regexp_extract(...), ',', '') AS BIGINT). They call {"op": "extract_number", "metric": "stars"} and DataBridge handles it.

Math compute — fetch data and compute in one call:

# Standard deviation without pulling rows to agent context
math_compute(
    query="SELECT value AS v FROM measurements", databases=["mydb"],
    expression="math.sqrt(sum((x - sum(v)/len(v))**2 for x in v) / len(v))"
)

# EMA over time-series data
math_compute(
    sub_queries=[{"db":"patents","query":"SELECT code, year, COUNT(*) AS cnt FROM t GROUP BY code, year","key":"k"}],
    operation="ema", group_col="code", sort_col="year", value_col="cnt", alpha=0.3
)

# Chi-square test
math_compute(
    sub_queries=[...],
    operation="chi_square", row_col="category", col_col="flag", count_col="cnt"
)

Result Verification

Catch silent failures before the agent acts on wrong answers.

  • Zero-row results on tables with known large row counts → flagged as suspicious
  • Query provenance: which databases were queried, which joins were applied
  • Failure classification: wrong join key / schema mismatch / empty vs failed

Audit Log

Append-only log of every query: timestamp, session ID, query text, rows returned, execution time. Queryable by session or recent N entries. Supports query replay for debugging.


MCP Tools

Tool Description
db_query Execute SQL or a multi-DB spec across connected databases
db_schema Get schema for a database, table, or column
db_joins List and manage cross-database join relationships
db_plan Get the execution plan for a query without running it
db_verify Check plausibility of a result set
db_audit Query history for the current session
db_connections List active database connections and health status

Architecture

┌──────────────────────────────────────────────────┐
│  MCP CLIENT (Claude / GPT / any MCP agent)       │
└────────────────────┬─────────────────────────────┘
                     │ MCP tool calls
┌────────────────────▼─────────────────────────────┐
│  DATABRIDGE MCP SERVER                           │
│                                                  │
│  ┌─────────────────────────────────────────┐    │
│  │  Query Intelligence                     │    │
│  │  multi-DB planning · transforms · math  │    │
│  └──────────────────┬──────────────────────┘    │
│                     │                            │
│  ┌──────────────────▼──────────────────────┐    │
│  │  Safety Enforcement                     │    │
│  │  read-only at parser level              │    │
│  └──────────────────┬──────────────────────┘    │
│                     │                            │
│  ┌──────────────────▼──────────────────────┐    │
│  │  Connection Layer                       │    │
│  │  unified driver · pooling               │    │
│  └──────────────────┬──────────────────────┘    │
│                     │                            │
│  ┌──────────────────▼──────────────────────┐    │
│  │  Schema Memory & Verification           │    │
│  │  schema cache · join registry · audit   │    │
│  └─────────────────────────────────────────┘    │
│                                                  │
└──────────────────────────────────────────────────┘
         │              │              │
   PostgreSQL       MongoDB        DuckDB / SQLite

Getting Started

Prerequisites

  • Python 3.11+
  • At least one running database (PostgreSQL, MongoDB, SQLite, or DuckDB)
  • An MCP-compatible agent (Claude Desktop, Cursor, Windsurf, or any MCP client)

Installation

git clone https://github.com/gaviventures/databridge.git
cd databridge
pip install -e .

Add to your MCP client

Edit ~/Library/Application Support/Claude/claude_desktop_config.json (Mac) and add:

{
  "mcpServers": {
    "databridge": {
      "command": "databridge",
      "args": ["serve"],
      "env": {
        "DATABRIDGE_DATABASE_URIS": "postgresql://user:pass@localhost:5432/mydb,sqlite:////absolute/path/to/file.db"
      }
    }
  }
}

Restart Claude Desktop. DataBridge scans your schema on first use and caches it for subsequent sessions.

Multiple databases are comma-separated in DATABRIDGE_DATABASE_URIS. SQLite paths must be absolute (4 slashes: sqlite:////).


See it in action

Once connected, ask Claude a natural language question that spans your databases. DataBridge handles the rest:

"Which decade of publication has the highest average rating among detailed reviews?"

Claude calls db_connections  → PostgreSQL + SQLite live
Claude calls db_schema       → finds books_info (PostgreSQL), review (SQLite)
Claude calls db_query        → samples rows, discovers publication dates are prose text
                               in details field ("May 8, 2012") and join is purchase_id ↔ book_id
Claude calls db_query        → extracts years via regex, joins tables, aggregates ratings by decade
Claude answers               → "The 1990s has the highest average rating at 4.32"

No connection strings in the prompt. No schema explanation needed. No JOIN syntax across database engines.


Database Hints (Benchmark)

When running the benchmark, DataBridge reads a db_description.txt (or db_description_withhint.txt) from each dataset directory and prepends it to the query context — useful for non-obvious join relationships or column semantics the model can't infer from schema alone.

This is a planned feature for the hosted MCP server. Join the waitlist →


Getting to 100% Accuracy

DataBridge out of the box handles schema discovery, join detection, and query planning automatically. But for production use on your specific data, accuracy improves significantly with a few targeted tuning steps:

1. Confirm or correct join relationships Auto-discovery finds joins based on column name similarity and value sampling, but it can miss non-obvious relationships (e.g. purchase_idbook_id) or propose false positives. Ask Claude to call db_joins to list all discovered candidates — it will show each join with its confidence score and transform. Tell Claude to confirm joins that are correct (confirm=<join_id>) or reject ones that aren't (reject=<join_id>). Confirmed joins are shown to the model in every subsequent query as trusted facts, eliminating the need to re-discover them.

2. Add database hints Document non-obvious relationships, column semantics, and business logic in plain text. Examples: which ID fields map across databases, what free-text columns contain embedded dates, what enum values mean. The model uses this context on every query.

3. Normalize your data Inconsistent ID formats (12345 vs "CUST-0012345"), missing foreign keys, nulls in join columns, and mixed date formats all reduce accuracy. The closer your schema is to clean relational data, the better the results.

4. Add ontology and lookup tables Queries that require domain knowledge — category hierarchies, code-to-name mappings, status enumerations — benefit from explicit lookup tables the model can join against rather than having to infer meaning from raw codes.

5. Tune the query context For schemas with many tables, explicitly describing which tables are relevant for which query types reduces the model's search space and improves answer quality.

Need help setting this up for your databases? Write to hello@gaviventures.com — we'll help you configure DataBridge for your specific schema.


Benchmark

DataBridge is built to be measured. We run against DataAgentBench on every release.

System DAB Pass@1
DataBridge + GLM-5.2 61.37%
MinusX + Claude Sonnet 4.6 + GPT-5.5-mini + Claude Haiku 4.5 65.2%
Altimate Code + GPT-5.5 + Claude Sonnet 4.6 63.1%
Spacedock (Recce) + Claude Opus 4.8 67.2%
Altimate Code + Claude Sonnet 4.6 68.2%
Altimate Code + Claude Sonnet 4.6 68.2%
Altimate Code + GPT-5.5 + Claude Sonnet 4.6 71.7%

Reproducible eval scripts are in /benchmark. See TESTING.md for full instructions.

Running the Benchmark

1. Clone DataAgentBench

git clone https://github.com/ucbepic/DataAgentBench.git

2. Set your API key

export TOGETHER_API_KEY=your_key   # or ANTHROPIC_API_KEY, OPENAI_API_KEY, etc.

3. Run a single dataset to verify setup

databridge benchmark run \
  --dab-root /path/to/DataAgentBench \
  --provider together \
  --model zai-org/GLM-5.2 \
  --dataset bookreview

4. Run all 12 official datasets (one run)

databridge benchmark run \
  --dab-root /path/to/DataAgentBench \
  --provider together \
  --model zai-org/GLM-5.2 \
  --official \
  --run 0

5. Run all 5 trials for leaderboard submission

for i in 0 1 2 3 4; do
  databridge benchmark run \
    --dab-root /path/to/DataAgentBench \
    --provider together \
    --model zai-org/GLM-5.2 \
    --official \
    --run $i
done

Results are written incrementally to benchmark/results/submission_{model}.json — a crash mid-run won't lose completed queries. Re-running a specific --run index overwrites only that run's entries.

Supported providers: anthropic · openai · together · groq · kimi · ollama


Roadmap

  • PostgreSQL, MongoDB, SQLite, DuckDB connectors
  • Read-only safety enforcement (parser level)
  • Schema scanner and cache
  • Cross-database join registry (auto-discovery + human confirmation)
  • Multi-DB sub-query spec with join and transform pipeline
  • Post-query transforms (extract_number, top_n_with_ties, compute_ema, parse_date, ...)
  • Math compute (EMA, chi-square, arbitrary Python expressions)
  • Result plausibility verification
  • Audit log with query replay
  • DAB benchmark eval harness
  • 61.1% on DataAgentBench with GLM-5.1

DataBridge Cloud — coming soon

Hosted MCP endpoint — no self-hosting required. Add databases via UI, share with your team, tune join discovery, view eval logs. Join the waitlist →


Design Principles

Safety is deterministic, not instructional. Read-only enforcement happens at the SQL parser level. No prompt can override it.

Silent failures are the real enemy. A wrong answer delivered confidently is worse than an error. DataBridge catches zero-row results on populated tables, type mismatches, and plausibility failures before the agent acts.

Computation is cheap. Context is expensive. Value sampling, join confidence scoring, post-query transforms, and math operations all happen inside tool calls. The agent sees a result, not the process that produced it.

Benchmark-first development. Every feature is evaluated against DAB. If it doesn't move the score, it doesn't ship.

Open core. The MCP server, connectors, safety enforcement, schema memory, and benchmark tooling are open source (Apache 2.0) forever.


Contributing

DataBridge welcomes contributors, especially:

  • Database connector implementations (BigQuery, Snowflake, Supabase, Neon)
  • DAB benchmark improvements
  • Safety layer hardening
  • Schema learning algorithms

License

Apache 2.0 — free to use, modify, and distribute. Commercial use permitted.


Built by Gavi Ventures