惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

U
Unit 42
博客园 - 司徒正美
V
Visual Studio Blog
博客园 - 【当耐特】
T
Tailwind CSS Blog
美团技术团队
博客园 - 叶小钗
Jina AI
Jina AI
宝玉的分享
宝玉的分享
IT之家
IT之家
Hugging Face - Blog
Hugging Face - Blog
雷峰网
雷峰网
Stack Overflow Blog
Stack Overflow Blog
博客园_首页
人人都是产品经理
人人都是产品经理
T
The Blog of Author Tim Ferriss
P
Proofpoint News Feed
Microsoft Security Blog
Microsoft Security Blog
Y
Y Combinator Blog
GbyAI
GbyAI
大猫的无限游戏
大猫的无限游戏
Martin Fowler
Martin Fowler
让小产品的独立变现更简单 - ezindie.com
让小产品的独立变现更简单 - ezindie.com
腾讯CDC

Hacker News: Show HN

PurrrrrFocus: Pomodoro Timer App - App Store Workflow Engine — Multi-Step Orchestration for Bun RapidPhoto: Pro Photo Editor App - App Store GitHub - DheerG/swarms: Achieve extraordinary results with claude code across a variety of tasks SPICE simulation → oscilloscope → verification with Claude Code — Lucas Gerads Show HN: VCoding – A 5 MB native Windows IDE with no dynamic dependencies Show HN: LLMs don't hallucinate because they're bad at math, it's the format GitHub - Agent-FM/agentfm-core: AgentFM is a peer-to-peer network that turns everyday computers into a decentralized AI supercomputer. AgentFM lets you run massive AI workloads directly across a global mesh of idle CPUs and GPUs. Show HN: Tracking Top US Science Olympiad Alumni over Last 25 Years GitHub - Potarix/agent-hub: One place to talk to all your agents Show HN: Runtime security for AI agents(injection,tool abuse, data exfiltration) GitHub - dubeyKartikay/lazyspotify: Terminal Spotify client for macOS and Linux GitHub - the-banana-tool/king-louie: Easy to use GUI Personal AI Assistant. Win/Linux/Mac. Show HN I made my vacation rental bookable by AI agents–no Airbnb, 0% commission GitHub - basteez/jsf-autoreload: maven plugin to enable hot reload on jsf projects uvm32/hosts/host-gdbstub at main · ringtailsoftware/uvm32 GitHub - labsai/EDDI: Config-driven engine that turns JSON into production-grade AI agents. Multi-agent orchestration, 12+ LLM providers, MCP/A2A protocols, RAG, persistent memory, and enterprise compliance (EU AI Act, GDPR, HIPAA). Built on Quarkus. GitHub - glitchnsec/fortyone-oss: AI Executive Assistant Platform Quickstart | Alien GitHub - muxshed/shed: One stream in, or many. Every destination, simultaneously. No cloud middleman, no per-channel fees, no limits. GitHub - ocrbase-hq/ocrbase: 📄 PDF/IMG ->.MD/JSON Document OCR API for PaddleOCR and GLMOCR. Self-hostable. GitHub - impactjo/home-memory: MCP server that lets your AI assistant remember everything about your home. GitHub - Sets88/dbcls: DbCls is a powerful terminal database client that supports various databases GitHub - neptun2000/heor-agent-mcp GitHub - SeanFDZ/macmind: Single-layer transformer in HyperTalk for the classic Macintosh RollQuation: Math Puzzles - Apps on Google Play GitHub - dropbox/witchcraft Show HN: Agent-cache – Multi-tier LLM/tool/session caching for Valkey and Redis GitHub - opentalon/opentalon: OpenTalon is an open-source platform built from the ground up in Go as a robust alternative to OpenClaw LinkedIn™ 职位抓取工具 - Chrome 应用商店
Test LLMs Side-by-Side
dhavalt · 2026-06-17 · via Hacker News: Show HN

Iterate. Compare. Benchmark.

A local-first desktop client designed to test, grade, and benchmark prompts across major LLMs. Stop guessing how a model will perform and prove it against your datasets.

Parallel Model Testing

Send a single prompt template to GPT-4, Claude 3, and Gemini simultaneously. Instantly compare raw JSON outputs, latency metrics, and exact token consumption side-by-side without managing multiple browser tabs.

Local-First Privacy

Your API keys and prompt history are stored in a local SQLite database. Nothing touches our servers.

Automatic Prompt Checkpointing

Every iteration is automatically saved to your local database. Fork a prompt to test a new variable, track the exact changes that improved the output, and easily revert to past configurations.

Benchmark & Evaluate

Inject test data into your prompt templates to establish a baseline. When a new LLM drops, benchmark it against your historical data before trusting it in production.

Model Benchmarking

Run your prompt against a full test dataset across multiple models at once. Review the batch outputs side-by-side and assign pass/fail grades to see exactly which model handles your edge cases.

Version Control for Your Prompts.

Keep a clean history of your iterations. Fork a prompt to test a new variable, track the changes, and easily switch back to past versions.


Request-Level Debugging.

Chat interfaces hide the details. Inspect raw API responses, latency stats, and exact token usage for every single request.

Model Benchmarking

Run your prompt against a full test dataset across multiple models at once. Review the batch outputs side-by-side and assign pass/fail grades to see exactly which model handles your edge cases.

Bring Your Own Keys.

Keep your credentials on your machine. Your keys are encrypted via your OS keyring, saved to your local database, and sent strictly to the providers. We track nothing.


Credentials Vault

1. Provider Setup

Bring your own keys. Connect OpenAI, Anthropic, Mistral, Gemini and XAI in seconds. Toggle models on/off to keep your workspace clean.

2. Inference Settings

Adjust temperature, top_p, and frequency penalties to observe how different constraints impact your prompt results.

Under the Hood

We chose Electron for cross-platform support, but kept the stack as simple as possible.

Native Web Components

No heavy frameworks overhead. We built the interface using standard HTML, CSS, and vanilla JavaScript.

Local SQLite Database

Your data lives in a standard SQLite file on your disk. Backup, version control, or delete it whenever you want.

{
  "runtime": "Electron",
  "security": "Context Isolated",
  "frontend": "Vanilla JS + Web Components",
  "database": "SQLite3 (Local-only)"
}

Ship AI Features With Certainty.

Batch-test your datasets and prove model reliability before hitting production.

Download for Mac Download for Windows Download for Linux

Learn about our permanent licensing and early-adopter pricing:
View License Details →