惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

K
Kaspersky official blog
Engineering at Meta
Engineering at Meta
D
DataBreaches.Net
Stack Overflow Blog
Stack Overflow Blog
Microsoft Security Blog
Microsoft Security Blog
Y
Y Combinator Blog
B
Blog RSS Feed
GbyAI
GbyAI
P
Proofpoint News Feed
aimingoo的专栏
aimingoo的专栏
MyScale Blog
MyScale Blog
D
Docker
阮一峰的网络日志
阮一峰的网络日志
Cyber Security Advisories - MS-ISAC
Cyber Security Advisories - MS-ISAC
Recorded Future
Recorded Future
美团技术团队
The Register - Security
The Register - Security
V
Visual Studio Blog
H
Hackread – Cybersecurity News, Data Breaches, AI and More
T
Tailwind CSS Blog
爱范儿
爱范儿
freeCodeCamp Programming Tutorials: Python, JavaScript, Git & More
T
The Blog of Author Tim Ferriss
博客园 - 司徒正美
量子位
B
Blog
F
Fortinet All Blogs
Martin Fowler
Martin Fowler
博客园 - 【当耐特】
MongoDB | Blog
MongoDB | Blog
A
About on SuperTechFans
I
InfoQ
钛媒体:引领未来商业与生活新知
钛媒体:引领未来商业与生活新知
有赞技术团队
有赞技术团队
雷峰网
雷峰网
大猫的无限游戏
大猫的无限游戏
J
Java Code Geeks
L
LangChain Blog
Latest news
Latest news
S
SegmentFault 最新的问题
Exploit-DB.com RSS Feed
Exploit-DB.com RSS Feed
Blog — PlanetScale
Blog — PlanetScale
Threat Intelligence Blog | Flashpoint
Threat Intelligence Blog | Flashpoint
Cisco Talos Blog
Cisco Talos Blog
F
Full Disclosure
C
Cisco Blogs
D
Darknet – Hacking Tools, Hacker News & Cyber Security
W
WeLiveSecurity
T
Tenable Blog
T
Tor Project blog

Hacker News: Show HN

PurrrrrFocus: Pomodoro Timer App - App Store Workflow Engine — Multi-Step Orchestration for Bun RapidPhoto: Pro Photo Editor App - App Store GitHub - DheerG/swarms: Achieve extraordinary results with claude code across a variety of tasks SPICE simulation → oscilloscope → verification with Claude Code — Lucas Gerads Show HN: VCoding – A 5 MB native Windows IDE with no dynamic dependencies Show HN: LLMs don't hallucinate because they're bad at math, it's the format GitHub - Agent-FM/agentfm-core: AgentFM is a peer-to-peer network that turns everyday computers into a decentralized AI supercomputer. AgentFM lets you run massive AI workloads directly across a global mesh of idle CPUs and GPUs. Show HN: Tracking Top US Science Olympiad Alumni over Last 25 Years GitHub - Potarix/agent-hub: One place to talk to all your agents Show HN: Runtime security for AI agents(injection,tool abuse, data exfiltration) GitHub - dubeyKartikay/lazyspotify: Terminal Spotify client for macOS and Linux GitHub - the-banana-tool/king-louie: Easy to use GUI Personal AI Assistant. Win/Linux/Mac. Show HN I made my vacation rental bookable by AI agents–no Airbnb, 0% commission GitHub - basteez/jsf-autoreload: maven plugin to enable hot reload on jsf projects uvm32/hosts/host-gdbstub at main · ringtailsoftware/uvm32 GitHub - labsai/EDDI: Config-driven engine that turns JSON into production-grade AI agents. Multi-agent orchestration, 12+ LLM providers, MCP/A2A protocols, RAG, persistent memory, and enterprise compliance (EU AI Act, GDPR, HIPAA). Built on Quarkus. GitHub - glitchnsec/fortyone-oss: AI Executive Assistant Platform Quickstart | Alien GitHub - muxshed/shed: One stream in, or many. Every destination, simultaneously. No cloud middleman, no per-channel fees, no limits. GitHub - ocrbase-hq/ocrbase: 📄 PDF/IMG ->.MD/JSON Document OCR API for PaddleOCR and GLMOCR. Self-hostable. GitHub - impactjo/home-memory: MCP server that lets your AI assistant remember everything about your home. GitHub - Sets88/dbcls: DbCls is a powerful terminal database client that supports various databases GitHub - neptun2000/heor-agent-mcp GitHub - SeanFDZ/macmind: Single-layer transformer in HyperTalk for the classic Macintosh RollQuation: Math Puzzles - Apps on Google Play GitHub - dropbox/witchcraft Show HN: Agent-cache – Multi-tier LLM/tool/session caching for Valkey and Redis GitHub - opentalon/opentalon: OpenTalon is an open-source platform built from the ground up in Go as a robust alternative to OpenClaw LinkedIn™ 职位抓取工具 - Chrome 应用商店 GitHub - EdoardoBambini/Agent-Armor-Iaga: AI agents are getting tool access — shell, file system, databases, APIs, secrets. But **nobody is governing what they actually do with it**. Frameworks like LangChain, CrewAI, AutoGen, and Claude Code give agents the power to execute. Agent Armor gives you the power to control, audit, and approve every single action before it happens. HN Vibes — Week 15, Apr 7–13 2026 GitHub - chojs23/ec: Easy terminal-native 3-way git mergetool vim-like workflow GitHub - SethPyle376/hiraeth: Local AWS emulator focused on fast integration testing, with SQS support, SQLite-backed state, and a debug-friendly web UI. GitHub - JakOb-dotcom/cloud-sandbox-security-analysis: Technical analysis and Proof of Concept (PoC) regarding environment variable exfiltration in containerized cloud sandboxes via side-channel data leaks. Springboards - Flint Alpha Show HN: A simpler coding agent harness GitHub - audiodude/sudomake-friends GitHub - 256thFission/mini-mythos: OSS clone of Anthropic’s Mythos harness to locate C/C++ memory vulnerabilities Show HN: OpenParallax: OS-level privilege separation for AI agent execution Hacker News Sorted - Chrome 应用商店 Show HN: How to Install Docker on Ubuntu 24.04 LTS: Complete 2026 Guide GitHub - himanshudongre/smriti GitHub - sverrirsig/claude-control: macOS desktop dashboard for monitoring and managing multiple Claude Code sessions GitHub - ory/dockertest: Write better integration tests! Dockertest helps you boot up ephermal docker images for your Go tests with minimal work. Chiral - Chrome 应用商店 Show HN: Two Claudes collaborating through shared memory on a $100 mini-PC GitHub - pmichaillat/latex-cv: Minimalist LaTeX template for academic CVs GitHub - oguzbilgic/posse: A web UI for Anthropic Managed Agents. GitHub - sshiraz/depsly: Dependency risk analysis tool for npm packages ABI Add safari/agent-harness — Safari browser automation via safari-mcp by achiya-automation · Pull Request #212 · HKUDS/CLI-Anything GitHub - Halfblood-Prince/trustcheck: Verify PyPI package attestations and improve Python supply-chain security GitHub - oguzbilgic/kern-ai: Agents that do the work and show it. GitHub - bruits/satteri: High-performance Markdown and MDX processing for the JavaScript ecosystem GitHub - tylergibbs1/feedstock: High-performance web crawler and scraper for TypeScript, powered by Bun and Playwright GitHub - Grimm67123/grimmbot: The self-improving sandboxed and open-source AI agent. With persistent memory and scheduling. GitHub - whitevanillaskies/whitebloom: Local whiteboard that blooms. GitHub - hwdsl2/docker-whisper: Docker image for a self-hosted Whisper speech-to-text server with speaker diarization and OpenAI-compatible transcription and translation APIs. Powered by faster-whisper. Supports all Whisper models, NVIDIA GPU (CUDA) acceleration, JSON/SRT/VTT output, SSE streaming, offline mode, and multi-arch (amd64, arm64). GitHub - yisding/reviewwiggum GitHub - MarwanAlsoltany/serrors: Structured errors for Go: sentinel hierarchies, typed data, custom formatting, and slog integration. GitHub - soatok/age-php GitHub - Luthiraa/markitme GitHub - stagas/rtdiff: realtime git diff gui and AI-assisted commits GitHub - tombedor/excalicharts GitHub - wh1le/excalidraw-edit: Open and edit .excalidraw files from the terminal. Offline, auto-saves to disk. MalExt Sentry - Malicious Extension Scanner - Chrome 应用商店 GitHub - syi0808/asciianimesvg: Generate animated ASCII art SVGs from text. CLI, Rust library, WASM, and web editor. GitHub - zaina-ml/ml_forge: A visual-based graph node editor for training computer vision models. GitHub - anakin87/llm-rl-environments-lil-course: 🌱 A little course on Reinforcement Learning Environments for evaluating and training Language Models GitHub - takaakit/superpowers-uml: Superpowers-UML modifies Superpowers to ensure a software development workflow in which AI agents design through UML modeling. AdriByte Studio - Sviluppo Web e Soluzioni Digitali GitHub - chouligi/angel-copilot: Your personalized Angel Investment Advisor Show HN: MoodSense AI (ML and FastAPI and Gradio, Deployed on Hugging Face) Moodsense Ai - a Hugging Face Space by aman179102 GitHub - agenteractai/lodmem: Level Of Detail Context Management for Agents GitHub - ostefani/subnetlens: A fast, concurrent network scanner with a TUI and plain-text CLI, built in Go. It discovers live hosts on your network, scans their open ports, resolves hostnames, and fingerprints operating systems—delivered. Cyber Pulse: Agentic Intel - Apps on Google Play Whisper API: Self-Hostable Speech to Text Transcription The Agent-Web Protocol Stack: A Research Thesis GitHub - msmarkgu/RelayFreeLLM: A restful API designed to route user prompts to various AI model providers. Show HN: Provepy – A Python decorator that proves your code using Lean and LLMs Show HN: Pardonned.com – A searchable database of US Pardons GitHub - patrickdappollonio/dux: Dux is a terminal UI that lets you run multiple AI coding agents side by side, each in its own git worktree, with full companion terminals, macros, commit generation, and a command palette that knows more tricks than you do. kMC Crystal Simulator Show HN: HyperFlow – A self-improving agent framework built on LangGraph GitHub - stef41/vibescore: 🎵 Grade your vibe-coded project. One command, instant letter grade across security, quality, dependencies, and testing. GitHub - stef41/lmscan: 🔍 Detect AI-generated text and fingerprint which LLM wrote it. Open-source GPTZero alternative. Zero dependencies, works offline. imgur.com GitHub - visionscaper/collabmem: Enabling long-term collaboration with Agentic AI - building up episodic and world model memory over time with in-context awareness 在 Steam 上购买 FriedrichAI: Offline AI 立省 10% GitHub - atripati/ark: AI Runtime Kernel — a context operating system for AI agents. Eliminates tool bloat, loads only what’s needed, and gives LLMs their reasoning space back. GitHub - nowork-studio/toprank: Open-source Claude Code skills for SEO, SEM, Google Ads GitHub - tacomanator/sash: Lightweight macOS menu bar app for reliably cycling through windows of the current application. Appents | Social Media Management for Product-First Teams GitHub - pnhoang/youtube-spam-blocker: Automatically detects and hides spam messages in YouTube Live chat. Set rate limits, keyword filters, and block repeat offenders. GitHub - decisionnode/DecisionNode: CLI + Local MCP - A shared structured memory store across Claude Code, Cursor, Windsurf, Antigravity, and every MCP client. Semantically queryable. GitHub - AvaCodeSolutions/django-email-learning: An open source Django app for creating email-based learning platforms with IMAP integration and React frontend components. The $100K Gap in Kubernetes Security Tooling Function Calling Harness: From 6.75% to 100%
GitHub - aosmith/gremlin
aosmith · 2026-05-13 · via Hacker News: Show HN

A local, browser-native multi-agent coordinator. A TypeScript module routes all inter-agent messages; a Svelte UI lets you watch every conversation and inject human input at any point. No server required.


Getting started

Pick a provider, get a model, and run. Here are links for the most common setups:

Provider Type Get started
Ollama Local, free ollama.com — install, then ollama pull llama3.2
LM Studio Local, free lmstudio.ai — download a model, start the local server
WebLLM In-browser, free No install — select WebLLM in Settings, pick a model, runs via WebGPU (Chrome 113+)
OpenRouter Cloud, free tier openrouter.ai — create account, copy API key
Groq Cloud, free tier console.groq.com — create account, copy API key
OpenAI Cloud, paid platform.openai.com/api-keys
Anthropic Cloud, paid console.anthropic.com — create API key
Google Gemini Cloud, free tier aistudio.google.com — create API key
Together Cloud, paid api.together.xyz — create account, copy API key

Once you have a provider ready, open GREMLIN → Settings (⚙) → pick your provider → paste your key (if needed) → pick a model → Save. Type a task and hit Run.


Features

🧠 TypeScript coordinator In-memory agent state machine with message routing
🤝 Collaborative agents Agents have individual system prompts and message each other autonomously
🔍 Full visibility Every inter-agent message is shown in real time — nothing hidden
💬 Human-in-the-loop Click any agent during a run to read its thread and inject instructions
🗂 7 built-in modes General · Engineering · Finance · Industrial · Medicine · Networking · Prediction Markets
Dev mode Engineering agents write real files to your disk via the File System Access API
🔎 Web search DuckDuckGo out of the box — or configure Brave, Serper, Tavily, SearXNG
🌐 WebLLM Run quantised models entirely in the browser via WebGPU — no server or key needed
🖼 Multimodal Attach, paste, or drag-and-drop images into your task prompt
🔌 10 providers Ollama, LM Studio, WebLLM, OpenRouter, Groq, OpenAI, Anthropic, Gemini, Together, Custom
📦 Single HTML file dist/index.html has everything inlined — JS, CSS, all assets
🏠 Fully local No backend, no accounts; only outbound traffic is calls to your chosen LLM

Quick start

Prerequisites

Tool Version Install
Node.js 18+ nodejs.org

Run

git clone https://github.com/aosmith/gremlin.git
cd gremlin/web
npm install
npm run dev   # → http://localhost:5173

The Vite dev server is the runtime. It provides a built-in CORS proxy for web search, auto-starts Ollama (if installed), and launches the browser sidecar. Every user runs npm run dev locally — there is no separate production deployment step.

Build (optional)

npm run build   # → dist/index.html (single self-contained file)

The built file can be hosted statically, but loses the CORS proxy and sidecars. For the full experience, use npm run dev.


Modes

Switch modes with the tab bar below the navbar. Each mode loads a different set of agents. Agent configs are saved per-mode.

Mode Agents Use for
General 🌐 CEO · Researcher · Analyst · Critic · Writer · TDD Engineer · Editor · Chief of Staff Research, writing, analysis
Engineering CTO · Frontend Dev · Backend Dev · Full-Stack Dev · DevOps Eng · QA Engineer · Security Eng · Simplicity Eng · TDD Engineer · Editor · Staff Engineer Software projects
Finance 📈 Capital Allocator · Value Analyst · Quant Analyst · Filings Analyst · Risk Manager · Sector Analyst · TDD Engineer · Editor · Investment Strategist Investment research
Industrial 🏭 General Manager · Manufacturing Eng · Operations Manager · Supply Chain · Quality Engineer · Commercial Manager · TDD Engineer · Editor · Plant Controller Manufacturing, operations & supply chain
Medicine 🩺 Attending Physician · Internist · Radiologist · Lab Medicine · Clinical Pharmacist · Nurse Practitioner · Chief of Medicine Clinical reasoning, diagnosis, treatment
Networking 📡 NOC Director · Transport Engineer · IP/MPLS Engineer · Voice/UC Engineer · RF/Wireless Engineer · Security Analyst · TDD Engineer · Editor · Service Assurance Lead Telecom NOC, triage, routing
Prediction Markets 🔮 Market Strategist · Probability Modeler · News Scanner · Whale Tracker · Arbitrage Analyst · Risk Assessor · TDD Engineer · Editor · Trade Architect Forecasting, prediction markets
+ New Mode Snapshot of your current agents Any custom team

Click + New Mode to save your current agent configuration as a named mode. Custom modes can be deleted; the seven built-in ones cannot.


Dev mode (Engineering)

When the Engineering mode is active, a 📁 Open Folder button appears in the toolbar. Select a local project directory and the agents gain file system tools:

Tool Description
write_file(path, content) Create or overwrite a file (parent directories are created automatically)
read_file(path) Read a file's full content
list_directory(path) List files and subdirectories

Tool calls appear as messages in the Activity Monitor. Written files show up in a file tree in the left sidebar; click any file to open it in the code viewer panel.

The File System Access API requires Chrome 86+ or Edge 86+. Firefox does not support it.


Browser tools

Agents can interact with a live browser when a sidecar server is running at http://127.0.0.1:3131:

Tool Description
browse_navigate(url) Navigate to a URL; returns page title and HTTP status
browse_content(selector?) Extract text from the current page or a specific element
browse_click(selector) Click an element by CSS selector
browse_type(selector, text) Type into an input field; optionally submit
browse_evaluate(script) Run JavaScript in the page context
browse_assert(checks) Assert conditions about elements; returns PASS/FAIL
browse_links() List all links on the current page
browse_wait(selector) Wait for an element to appear (up to 10s)

Web search

Agents can search the web and fetch pages during a run. Two search tools are available:

Tool Description
web_search(query) Search the web via the configured provider
web_fetch(url) Fetch and extract text from any URL (max 30k chars)

DuckDuckGo is the default search provider — no API key needed. For better results, configure a provider in Settings:

Provider API key needed Notes
DuckDuckGo (default) No HTML scrape via CORS proxy
Brave Search Yes Free tier: 2,000 queries/mo
Serper (Google) Yes Free tier: 2,500 queries/mo
Tavily Yes AI-optimised, free tier: 1,000 queries/mo
SearXNG No Self-hosted; set your instance URL in Settings
Cloudflare Yes (Account ID + API token) Browser Rendering crawl — renders JS-heavy pages; also powers web_fetch

WebLLM (in-browser inference)

Select WebLLM 🌐 in Settings to run a quantised model entirely in your browser using WebGPU. No API key or external server needed.

Requirements: Chrome 113+ or Edge 113+ (WebGPU). Firefox and Safari do not support WebGPU by default.

Workflow:

  1. Open Settings → select WebLLM → pick a model
  2. Click Run — the model downloads to your browser cache on first use (~500 MB – 4 GB depending on model)
  3. A progress bar appears below the navbar during loading; subsequent runs use the cache instantly

Available models (curated list):

Model Size (approx) Notes
TinyLlama-1.1B-Chat-v1.0-q4f16_1-MLC ~700 MB Fastest; good for testing
Llama-3.2-1B-Instruct-q4f16_1-MLC ~800 MB Small, fast
Llama-3.2-3B-Instruct-q4f16_1-MLC ~2 GB Good balance (default)
Qwen2.5-3B-Instruct-q4f16_1-MLC ~2 GB Strong at reasoning
Phi-3-mini-4k-instruct-q4f16_1-MLC ~2 GB Microsoft's compact model
Phi-3.5-mini-instruct-q4f16_1-MLC ~2 GB Microsoft's newer compact model
gemma-2-2b-it-q4f16_1-MLC ~1.5 GB Google's 2B model
Qwen2.5-7B-Instruct-q4f16_1-MLC ~4 GB Higher quality
Mistral-7B-Instruct-v0.3-q4f16_1-MLC ~4 GB Strong general-purpose
Llama-3.1-8B-Instruct-q4f32_1-MLC ~4 GB Best quality locally

LLM providers

Open ⚙ Settings to pick a provider. The provider grid covers:

Provider Kind Notes
Ollama Local ollama pull llama3.2 · click ↺ Discover
LM Studio Local Start local server · click ↺ Discover
WebLLM In-browser WebGPU required; no key needed
OpenRouter Cloud 200+ models; free tier available
Groq Cloud Very fast inference; free tier
OpenAI Cloud GPT-4o and variants
Anthropic Cloud Claude models
Gemini Cloud Google Gemini; free tier
Together Cloud Open-source cloud models
Custom Cloud Any OpenAI-compatible endpoint

API keys are stored only in localStorage and never sent anywhere except your chosen endpoint.


Agent communication protocol

Agents respond with JSON. GREMLIN parses and routes the messages automatically:

{
  "analysis": "My reasoning goes here",
  "messages": [
    { "to": "critic",      "content": "Can you verify finding #3?" },
    { "to": "synthesizer", "content": "Final results: …" }
  ],
  "done": false,
  "result": null
}
  • "done": true marks the agent's task as complete
  • "result" contains the final output (the synthesizer's result is shown to the user)
  • Plain-text responses are accepted as a fallback — treated as a final result

Agents also have access to protocol tools (send_message, mark_done) for providers that support tool calling.


Architecture

┌──────────────────────────────────────────────────────────┐
│                         Browser                          │
│                                                          │
│  ┌─────────────────┐    ┌────────────────────────────┐   │
│  │  Svelte 5 UI    │───▶│  Coordinator (TypeScript)  │   │
│  │  (TypeScript)   │◀───│  • Agent registry          │   │
│  │                 │    │  • Message routing         │   │
│  │  Activity       │    │  • Session state           │   │
│  │  Monitor        │    └────────────────────────────┘   │
│  │  File Tree      │                                     │
│  │  Code Viewer    │                                     │
│  └────────┬────────┘                                     │
│           │                                              │
│  ┌────────▼────────┐    ┌────────────────────────────┐   │
│  │  AgentRunner.ts │    │  File System Access API    │   │
│  │  • Calls LLM    │    │  write_file / read_file /  │   │
│  │  • Tool loop    │───▶│  list_directory            │   │
│  │  • Routes msgs  │    │  (Engineering mode only)   │   │
│  │  • Web search   │    └────────────────────────────┘   │
│  └────────┬────────┘                                     │
│           │ fetch()  or  WebGPU (WebLLM)                 │
└───────────┼──────────────────────────────────────────────┘
            ▼
   ┌─────────────────────────────────┐
   │  LLM                            │
   │  Anthropic / OpenAI / Gemini    │
   │  Ollama / Groq / OpenRouter     │
   │  Together / WebLLM (WebGPU)     │
   └─────────────────────────────────┘

Project structure

gremlin/
├── web/
│   ├── src/
│   │   ├── App.svelte              # Main layout, navbar, mode bar, modals
│   │   ├── app.css                 # Glass-morphism design system
│   │   ├── lib/
│   │   │   ├── types.ts            # Types, providers, mode presets, agent configs
│   │   │   ├── coordinator.ts      # In-memory agent state & message router
│   │   │   ├── api.ts              # LLM call functions (all formats + tool loops)
│   │   │   ├── agentRunner.ts      # Multi-agent orchestration engine
│   │   │   ├── store.svelte.ts     # Reactive global state (Svelte 5 runes)
│   │   │   ├── filesystem.ts       # File System Access API wrapper
│   │   │   ├── tools.ts            # Tool definitions + executor (dev/search/protocol)
│   │   │   ├── webllm.ts           # WebLLM / WebGPU wrapper
│   │   │   ├── cleanContent.ts     # Protocol JSON → readable display text
│   │   │   ├── tableCards.ts       # Prose enhancement (tables, callouts)
│   │   │   ├── sanitize.ts        # DOMPurify XSS sanitization wrapper
│   │   │   ├── search.ts          # Web search implementation
│   │   │   ├── cloudflare.ts     # Cloudflare Browser Rendering crawl
│   │   │   ├── teamGenerator.ts   # Dynamic team generation
│   │   │   └── headless.ts        # Headless browser integration
│   │   └── components/
│   │       ├── ActivityMonitor.svelte  # Real-time message feed
│   │       ├── AgentCard.svelte        # Sidebar agent widget
│   │       ├── AgentPanel.svelte       # Agent detail + human input
│   │       ├── AgentEditModal.svelte   # Add/edit agent dialog
│   │       ├── SettingsModal.svelte    # Provider + API settings
│   │       ├── HelpModal.svelte        # Setup guide + onboarding
│   │       ├── SessionHistory.svelte   # Past session browser
│   │       ├── FileTree.svelte         # Project file tree (dev mode)
│   │       ├── CodeViewer.svelte       # File content viewer (dev mode)
│   │       └── NewModeModal.svelte     # Create custom mode dialog
│   ├── scripts/
│   │   └── smoke-test.mjs          # Post-build smoke test
│   ├── index.html
│   ├── package.json
│   └── vite.config.ts
├── proxy/
│   ├── worker.js                   # Cloudflare Worker CORS proxy
│   └── wrangler.toml
├── setup.sh                        # One-shot build script
└── package.json                    # Root npm scripts

Deployment

The recommended way to run GREMLIN is npm run dev on your local machine. The Vite dev server provides a CORS proxy, auto-starts Ollama, and launches the browser sidecar — none of which are available when hosting the built file statically.

Static hosting (advanced)

The built file (web/dist/index.html) can be hosted on Cloudflare Pages, GitHub Pages, Netlify, etc. Most LLM providers (OpenAI, Anthropic, OpenRouter, Gemini, Together) support browser CORS natively, so they work without a proxy. However, web search and some services (Groq, DuckDuckGo, Brave Search) need a CORS proxy.

To deploy your own proxy for static hosting:

cd proxy
npx wrangler login
npx wrangler deploy

Then update the proxy URL in Settings → Advanced.

Local LLM providers (Ollama, LM Studio)

If you host the site on a custom domain (e.g. gremlin.example.com) and want to use a local Ollama instance, you need to allow the origin:

OLLAMA_ORIGINS=https://gremlin.example.com ollama serve

Ollama only accepts requests from localhost by default. LM Studio has a similar CORS setting in its server preferences.


Troubleshooting

API 401 / 403 → Check your API key in Settings.

CORS error or Failed to fetch in browser console → Make sure you are running via npm run dev — the dev server provides the CORS proxy → If using the built HTML file: serve over HTTP, not file://, and configure a proxy URL in Settings → If using Ollama from a hosted site: set OLLAMA_ORIGINS=https://your-domain.com when starting Ollama

WebLLM: WebGPU is not available → Use Chrome 113+ or Edge 113+. Firefox and Safari do not support WebGPU by default.

WebLLM: model loads but produces garbled output → Some quantised models struggle with strict JSON. Switch to a larger model or use a server-side provider.

Agents produce plain text instead of JSON → Smaller or older models sometimes ignore the JSON format instruction. Try a larger or more instruction-tuned model.


License

PolyForm Noncommercial 1.0.0 — free for personal and noncommercial use.