惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

The GitHub Blog
The GitHub Blog
Y
Y Combinator Blog
B
Blog RSS Feed
大猫的无限游戏
大猫的无限游戏
J
Java Code Geeks
钛媒体:引领未来商业与生活新知
钛媒体:引领未来商业与生活新知
博客园 - 【当耐特】
MongoDB | Blog
MongoDB | Blog
Hugging Face - Blog
Hugging Face - Blog
有赞技术团队
有赞技术团队
T
The Blog of Author Tim Ferriss
B
Blog
小众软件
小众软件
T
Tailwind CSS Blog
MyScale Blog
MyScale Blog
I
InfoQ
Engineering at Meta
Engineering at Meta
Blog — PlanetScale
Blog — PlanetScale
P
Proofpoint News Feed
H
Help Net Security
雷峰网
雷峰网
S
SegmentFault 最新的问题
V
Visual Studio Blog
爱范儿
爱范儿

DEV Community

Authentication Security Deep Dive: From Brute Force to Salted Hashing (With Java Examples) Why AI Systems Don’t Fail — They Drift Spilling beans for how i learn for exam😁"Reinforcement Learning Cheat Sheet" I Replaced Chrome with Safari for AI Browser Automation. Here's What Broke (and What Finally Worked) How Python Borrows Other People's Work The $40 Architecture: Processing 1 Billion API Requests with 99.99% Uptime Vibe Coding: A Workflow Guide (From Zero to SaaS) Most webhook security guides protect the wrong side. The scary part is delivery. Headless CMS for TanStack Start: Build a Blog with Cosmic EU Age Verification App "Hacked in 2 Minutes" — What Actually Happened Comfy Cloud’s delete function does not actually remove files Running AI Models on GPU Cloud Servers: A Beginner Guide Event-driven media intelligence with AWS Step Functions and Bedrock I scored 500 AI prompts across 8 quality dimensions — here's what broke How to Call Google Gemini API from Next.js (Free Tier, No Backend Needed) The Portal Protocol: Reclaiming Human Connection in the Age of AI How to Fix Your Team's Scattered Knowledge Problem With a Self-Hosted Forum Intro to tc Cloud Functors: A Graph-First Mental Model for the Modern Cloud Designing Multi-Tenant Backends With Both Ownership and Team Access I Built a Neumorphic CSS Library with 77+ Components — Here's What I Learned PostgreSQL Performance Optimization: Why Connection Pooling Is Critical at Scale Cómo construí un SaaS multi-rubro para gestionar expensas en Argentina con FastAPI + Vue 3 🚀 I Built an Ethical Hacking Scanner Tool – Open Source Project I Replaced /usage and /context in Claude Code With a Single Statusline A Pythonic Way to Handle Emails (IMAP/SMTP) with Auto-Discovery and AI-Ready Design I Collected 8.9 Million Polymarket Price Points — Here's What I Found About How Markets Really Move EcoTrack AI — Carbon Footprint Tracker & Dashboard Everyone's Using AI. No One Agrees How. 5 self-hosted ebook managers worth trying in 2026 Building Your First AI Agent with LangChain: From Chatbot to Autonomous Assistant
Building a self-hosted deep-research agent with Claude Code
Wouter Van S · 2026-05-02 · via DEV Community

Every year the same problem... what to buy for her birthday. While standing in line at the bakery, I started a GitHub Issue. By the time I got back to my desk, a fancy html overview was published to my GitHub Pages with a fallback to the dry markdown research. In there was this gem "Hunt A Killer: a six-month serialized murder-mystery" (she'll love that)!

Atlas published page

I built Scout, a MIT open-source research engine that runs Claude Code on your hardware and takes your one-line topic from a GitHub Issue to a cited markdown on a site you own. This post is about the four design decisions that made it actually useful, not just a demo.

The pain

I wanted a research loop that fits the way ideas arrive.

Most of my research curiosities show up on a phone — on a train, in line, mid-conversation. I'd then act on the result at my desk, often inside a Claude Code session, using the research as context for whatever I'm building. The loop I wanted: on the go capture, desk-side payoff.

What it is, in one diagram

Scout flow

→ Open a GitHub Issue
→ Sharpen & Sub-Topics selection (optional)
→ Fancy HTML pages selection (optional)

Decision 1: GitHub Issues as the UX

Thank you GitHub for not having to build a UI!

I already have the account, it's tightly linked with the source code,
gave me Auth, and a way to converse with Claude Code and checkboxes to
get Claude started.

Decision 2: Sharpen before research

The biggest single quality lever in the system isn't the model or the search backend — it's the sharpening step that runs before any research starts.

A user types "best NAS to buy in 2026." That's three different questions in a trench coat: best for what budget? Replacing what? Optimizing for storage capacity, idle wattage, or both? Without sharpening, Claude charges off in one direction and the output ignores two thirds of what the user actually meant.

So skills/scout/sharpen.md runs first: read the topic, propose a tightened framing as a comment ("Survey for replacing a Synology NAS in 2026, optimised for AVX2 + ECC, comparing UGREEN / Beelink / Minisforum and TrueNAS / Unraid / Proxmox…"), wait for tick ✓ or a steering reply. Only then does research start.

The lesson generalizes: agents that ask one clarifying question before working produce output an order of magnitude better than agents that don't. Sharpening is cheap (one model call), and it eliminates the most common (and expensive!) failure mode — answering the wrong question.

Decision 3: Decompose wide topics into parallel sub-agent expeditions

Some questions are atomic ("best static-site generator in 2026"). Some are containers ("everything I need to leave Synology"). Trying to answer the latter in one pass produces a 4-page jumble.

For expedition depth, the sharpener also proposes 2–8 sub-topics ("hardware shortlist", "OS/storage stack", "DSM migration playbook", "remote access"). Each becomes its own independent expedition, dispatched as a sub-agent in parallel. After they all finish, a synthesis pass produces a parent overview page that links each child.

This is map-reduce, but applied at the research-question level rather than the data level. Two non-obvious things matter:

  1. Sub-topics must be independently coherent. If sub-topic 3 needs sub-topic 1's conclusions, you've decomposed wrong — collapse them.
  2. The synthesis pass is where most value lives. Without it, you have N disconnected pages. With it, the parent page reconciles disagreements between children and ends with a recommendation.

Decision 4: "Every claim carries its URL inline" as a skill rule

The single rule that does the most work: every factual claim, number, or quote must have its source URL next to the claim.

Why: when claims and citations are decoupled, LLMs hallucinate. The citations look real, but they don't actually back the specific sentence above them. Forcing inline URLs ([[1]](https://...)) turns hallucination into a typing constraint the model can't fudge. If it can't find a URL, it can't make the claim.

This rule is enforced in skills/scout/SKILL.md and re-injected on every output pass. It's the cheapest, most effective hallucination-defense I've shipped in any agent.

What it costs

Measured per-run from my own Atlas (Sonnet 4.6 API):

Tier Mode Time Cost median (range) n
recon one-page ~2 min $0.83 ($0.73–$0.93) 4
survey single page 5–10 min $2.56 ($1.99–$3.99) 24
expedition single deep 12–20 min $8.64 ($7.23–$14.90) 16
expedition multi-angle 35–70 min $28 ($12–$35) 9

On a Pro/Max subscription, runs consume your existing quota — no incremental cost.

Try it

curl -fsSL https://raw.githubusercontent.com/Laoujin/Scout/main/install.sh \
  | bash -s -- --config=s5.cartography.v1

Enter fullscreen mode Exit fullscreen mode

What's reusable

Sharpen first. Decompose wide topics. Inline citations as a hard rule. Use GitHub Issues so you don't build a UI. Those four ideas port to any agent that produces long-form output — the rest of Scout is plumbing.

MIT-licensed, three-repo split (Scout / Atlas / Compass), one-line install. Fork it, take the patterns, make it your own.

github.com/Laoujin/Scout if you'd find this useful — that's the signal that tells me whether to keep building.