惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

N
News | PayPal Newsroom
P
Proofpoint News Feed
Cyberwarzone
Cyberwarzone
C
Cisco Blogs
SecWiki News
SecWiki News
Know Your Adversary
Know Your Adversary
cs.AI updates on arXiv.org
cs.AI updates on arXiv.org
Vercel News
Vercel News
freeCodeCamp Programming Tutorials: Python, JavaScript, Git & More
罗磊的独立博客
NISL@THU
NISL@THU
WordPress大学
WordPress大学
Hacker News - Newest:
Hacker News - Newest: "LLM"
T
Threat Research - Cisco Blogs
AI
AI
Simon Willison's Weblog
Simon Willison's Weblog
Security Archives - TechRepublic
Security Archives - TechRepublic
有赞技术团队
有赞技术团队
L
LINUX DO - 热门话题
Hacker News: Ask HN
Hacker News: Ask HN
V
V2EX
G
GRAHAM CLULEY
TaoSecurity Blog
TaoSecurity Blog
Hugging Face - Blog
Hugging Face - Blog
D
Darknet – Hacking Tools, Hacker News & Cyber Security
F
Fortinet All Blogs
博客园 - 叶小钗
博客园 - 三生石上(FineUI控件)
云风的 BLOG
云风的 BLOG
Recorded Future
Recorded Future
Latest news
Latest news
The Hacker News
The Hacker News
aimingoo的专栏
aimingoo的专栏
T
Troy Hunt's Blog
S
Schneier on Security
I
Intezer
Google DeepMind News
Google DeepMind News
A
Arctic Wolf
Apple Machine Learning Research
Apple Machine Learning Research
Threat Intelligence Blog | Flashpoint
Threat Intelligence Blog | Flashpoint
T
Threatpost
爱范儿
爱范儿
The Register - Security
The Register - Security
S
SegmentFault 最新的问题
Blog — PlanetScale
Blog — PlanetScale
博客园 - 聂微东
宝玉的分享
宝玉的分享
Recent Commits to openclaw:main
Recent Commits to openclaw:main
美团技术团队
B
Blog RSS Feed

Hacker News - Newest: "LLM"

GitHub - lechmazur/position_bias: A benchmark for testing whether LLM judges keep the same preference when two lightly edited versions of the same story are shown in opposite orders. Flex routing (EU and EFTA) Dark Factories: Retooling for LLM Velocity Ask HN: What would be the impact of a LLM output injection attack? GitHub - AronDaron/dataset-generator: No-code desktop app for generating high-quality synthetic datasets to fine-tune LLMs — plan-then-execute pipeline, LLM-as-judge, HuggingFace upload. GitHub - Oaklight/llm-rosetta: Production-ready LLM API translation layer for Python — bidirectional conversion between OpenAI, Anthropic & Google formats via hub-and-spoke IR. Optional API gateway. Streaming & non-streaming. Zero core deps. Contributions welcome! GitHub - browser-use/browser-harness: Self-healing browser harness that enables LLMs to complete any task. GitHub - moeen-mahmud/remen: Remen turns thoughts into something you can return to Analyzing 156 LLM Launch Posts on Hacker News ChatGPT vs Gemini vs Claude: The Best LLM Subscription You Should Buy GitHub - salaamalykum/quran-semantic-search: High-density RAG Semantic Search Engine & Quran Corpus (GEO/SEO Architecture) GitHub - NVIDIA/TensorRT-LLM: TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way. The State of LLM Bug Bounties in 2026 Operational Readiness Criteria for Tool-Using LLM Agents Meshcore: Architecture for a Decentralized P2P LLM Inference Network How an LLM becomes more coherent as we train it GitHub - seetrex-ai/laimark GitHub - Jossifresben/BibCrit: AI-assited biblical textual criticism GitHub - wastedcode/memex: File system based wiki, maintained by Claude 99helpers.com GitHub - cliver-project/AITrigram GitHub - unbody-io/adapt: A self-evolving memory layer for AI agents. GitHub - hb20007/awesome-gen-ai-fails: A list of incidents where reliance on generative AI and LLMs resulted in harm to companies, individuals, or society GitHub - nevenkordic/localmind: Run any local LLM with persistent memory and context. CLI agent over Ollama with SQLite-backed hybrid recall. No cloud. Ask HN: What are the machine requirements for a LLM like Llama-3.1-8B? Faster LLM Inference via Sequential Monte Carlo grpo explained: group relative policy optimization for llm finetuning - cgft Stop comparing price per million tokens: the hidden LLM API costs · TensorZero Andrej Karpathy's LLM Wiki Is a Bad Idea GitHub - GG-QandV/mnemostroma: Offline RAM-first cognitive leer/coprocessor for AI agents and robotics. Solves "Context Abandonment" with 20-80ms latency using a dual-thread biomimetic memory architecture (ONNX + SQLite WAL). mempalace/agent at agent · skorotkiewicz/mempalace GitHub - Nyquest-ai/nyquest-rust-fullstack-pub: Nyquest — Semantic Compression Proxy for LLMs. 350+ rules, local LLM stage, 15-75% token savings. Full Rust stack. GitHub - TheoV823/mneme: Enforce architectural decisions in AI-assisted development. GitHub - klemenvod/TokenBrawl: A 1v1 Bomberman-style game where two LLM agents play autonomously against each other. No human plays — you watch the AIs fight. Each agent receives a text description of the board state, reasons about it, and outputs a move as JSON. The game engine executes it. Introducing the Common AI Provider: LLM and AI Agent Support for Apache Airflow Power Circuit AI: Designing Power Electronic Circuits for Motor Drives with Generative Artificial Intelligence Ask HN: How to program with IDE and LLM on CPU locally? Show HN: Agent-cache – Multi-tier LLM/tool/session caching for Valkey and Redis Bonsai 1-bit WebGPU - a Hugging Face Space by webml-community The LLM Fallacy: Misattribution in AI-Assisted Cognitive Workflows Ask HN: Simple tooling for local LLM code critique without IDE integration? Can a General LLM Diagnose a DICOM Slice? A 10-Case Public Benchmark Charts-of-Thought: Enhancing LLM Visualization Literacy (PDF, 2026) GitHub - Mesh-LLM/mesh-llm: Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat. GitHub - seamus-brady/springdrift: A persistent runtime for long-lived LLM agents Writing an LLM from scratch, part 32k -- Interventions: training a better model locally with gradient accumulation Ask HN: Which LLM model and agentic CLI are you using for local development? GitHub - wayneColt/modelcascade: Route local. Escalate smart. Never overspend. Open-source multi-model cascade routing for autonomous agents. LLM pricing is 100x harder than you think GitHub - asakin/llm-primer: Pre-warmed Claude Code sessions in tmux. No startup wait. GitHub - EggerMarc/chat-rs: A multi-provider LLM framework for Rust. GitHub - SynapseKit/SynapseKit: Minimal, async-first Python framework for production LLM apps- 2 hard deps, no magic, no SaaS. A Claude Skill that Makes LLM Paragraphs More Bearable Does Gas Town 'steal' usage from users' LLM credits & paid services to improve itself? What's Claude Code Actually Doing? Open the Black Box with the Arthur Engine Milla Jovovich's New Open Source LLM Memory App and the Dark Code Problem Your intuition of LLM token usage might be wrong Show HN: Bloomberg Terminal for LLM ops – free and open source GitHub - 0xchamin/mcptube: Transform YouTube videos into a compounding knowledge base with transcripts, vision analysis, and agentic search. Works as an MCP server for Claude, Copilot & more. Show HN: Open KB: Open LLM Knowledge Base Your LLM is a compiler, not a runtime GitHub - sapountzis/Unslop: A Web Feed That Deserves You crates.io: Rust Package Registry Beyond Karpathy's LLM-Wiki: The Necessity of Cognitive Governance GitHub - amitshekhariitbhu/llm-internals: Learn LLM internals step by step - from tokenization to attention to inference optimization. GitHub - parallem-ai/parallem: An expressive library for running agents with the Batch API. GitHub - stfurkan/pi-llm LLM-Wiki Show HN: Formal – Formal verification for AI-generated code using Lean 4 LRTS – Regression testing for LLM prompts (open source, local-first) LLM Wiki Skill: Build a Second Brain with Claude Code and Obsidian I built an LLM Wiki and RAG solution: here's a demo for a security KB The biggest advance in AI since the LLM Predict-Rlm: The LLM Runtime That Lets Models Write Their Own Control Flow the-synthetic-library/the-synthetic-mind at main · joshferrer1/the-synthetic-library GitHub - yisding/reviewwiggum GitHub - Donnyb369/mcp-spine: Context Minifier & State Guard — Local-first MCP middleware proxy GitHub - Beledarian/wgpu-llm: A from-scratch LLM inference engine that uses wgpu (the cross-platform WebGPU implementation) to dispatch WGSL compute shaders for every math operation a Transformer needs. No CUDA. No Python. No massive framework dependencies. Just Rust, raw shaders, and your GPU. GitHub - anitiue/Hindsight: An experience-driven self-improvement framework for LLM agents — 基于经验的 LLM Agent 自我改进框架 GitHub - stef41/lmscan: 🔍 Detect AI-generated text and fingerprint which LLM wrote it. Open-source GPTZero alternative. Zero dependencies, works offline. GitHub - alainnothere/AmdPerformanceTesting: Amd Performance Testing Ask HN: Is a purely Markdown-based CRM a terrible idea? Optimized for LLM agents Context Engineering - LLM Memory and Retrieval for AI Agents | Weaviate little_helper_tui/letter.md at main · sleepyeldrazi/little_helper_tui GitHub - EvanZhouDev/umr: The Unified Model Registry for all your local AI apps. GitHub - JordanCT/VigIA-Orchestrator Your Agent Is Mine: Measuring Malicious Intermediary Attacks on the LLM Supply Chain A Taxonomy of RL Environments for LLM Agents Llama LLM Network Feture GitHub - genedeng-ca/ai-mac-migration: AI-powered Mac-to-Mac migration tool - replace Apple Migration Assistant with intelligent, selective transfer using local LLMs GitHub - lunargate-ai/gateway: High-performance self-hosted AI gateway (OpenAI-compatible) with routing, retries, and streaming GitHub - AuthBits/webmcp: A lightweight, prompt-driven MCP web research server for high-quality LLM powered information extraction. Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineering Springdrift: An Auditable Persistent Runtime for LLM Agents with Case-Based Memory, Normative Safety, and Ambient Self-Perception High-Stakes Personalization: Rethinking LLM Customization for Individual Investor Decision-Making From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agents HUOZIIME: An On-Device LLM-enhanced Input Method for Deep Personalization TIDE: Token-Informed Depth Execution for Per-Token Early Exit in LLM Inference Characterizing WebGPU Dispatch Overhead for LLM Inference Across Four GPU Vendors, Three Backends, and Three Browsers LLM Targeted Underperformance Disproportionately Impacts Vulnerable Users
GitHub - jaquelinejaque/quorum-saas-starter: The only Next.js SaaS boilerplate with 11 LLM providers in semantic consensus, HSP fail-closed gate (Patent Pending), and EU AI Act audit-grade compliance. Production code from api.quorum-ai.dev.
jaquelinejaq · 2026-06-19 · via Hacker News - Newest: "LLM"

Multi-LLM SaaS Starter Kit

The only production-ready boilerplate that ships with 14 LLM providers in semantic consensus, EU AI Act audit-grade compliance, and 13 self-evolution loops out of the box. Built on the same code that powers api.quorum-ai.dev.

Why this exists

Every AI SaaS boilerplate on the market ships with one LLM provider — usually OpenAI, sometimes Anthropic. That's the easy part. The hard part is everything around it:

  • Routing queries across multiple providers without exploding costs
  • Detecting hallucination via semantic consensus instead of trusting a single model
  • Generating audit trails that pass EU AI Act Article 12/13 review
  • Building fail-closed gates for high-risk autonomous actions
  • Keeping per-user memory, RLHF feedback, and adaptive routing data isolated

This kit gives you all of that already wired, deployed, and battle-tested in production. You spend your engineering time on what makes your product different — not on rebuilding the orchestration layer everyone else stops at.

What's inside

Multi-LLM consensus engine

  • 14 provider integrations out of the box: OpenAI, Anthropic, Google Gemini, xAI Grok, Mistral, Cohere, NVIDIA, DeepSeek, Replicate, DashScope/Qwen, Zhipu/GLM, Moonshot/Kimi, Hermes (Nous) local, Llama local via Ollama
  • Semantic agreement scoring via cosine similarity on embeddings — not lexical overlap, not majority vote
  • Disagreement trace returned with every answer — your users see exactly which models agreed, which dissented, and why
  • Per-query cost log so you can show clients what each consensus cost in API tokens

Self-evolution loops (13 total)

Loop What it learns
RLHF tracker Per-user, per-query-class weight updates from thumbs-up/down
ELO competition Pairwise model wins → global ranking per query class
Hebbian co-activation Which models agree with each other (reduces redundant fan-out)
MoE router Picks the right subset of providers per query, not all every time
Hebbian memory Per-user vector memory with semantic recall
Genetic prompt evolution Mutates and selects system prompts that score highest on your eval set
Adversarial loop Red-team prompts to catch jailbreaks before users do
A/B testing Promotes new policies only when they beat the incumbent statistically
Distillation Promotes Llama checkpoints fine-tuned on your in-house data
Synthetic data Generates training pairs from real production traffic
Architecture search Evolves loop topology over generations
Federated learning Aggregates updates across tenants without sharing raw data
Web learner 4-source web ingestion (DDG + Wikipedia + HackerNews + arXiv) into a vector KB

Compliance & safety (all opt-in)

  • HSP fail-closed gate (opt-in) — wrap any high-risk function with requiresHspApproval() and it refuses unless a human-approved webhook signs off. Don't need compliance? Don't wrap. The kit doesn't force this on you. Toggle off globally with HSP_ENABLED=false even if a dependency does wrap it.
  • EU AI Act Article 12 audit trail (opt-in) — call writeAuditLine() from your business logic to log decisions; the audit cert generator reads this log
  • EU AI Act Article 13 audit certificate (opt-in) — SHA-256 hash-chained PDF generator, one call per audit period: generateAuditCert({...}). Useful when selling to regulated verticals (legal, fintech, health); ignorable otherwise.
  • Hosted vs local posture split — hosted deployment is fail-closed by infra-marker detection (Cloud Run, k8s, Lambda); local research mode opt-in via HSP_GATE_DEV_MODE=1
  • CUSTOMER_KEYS_ENCRYPTION_KEY — Fernet-encrypted BYOK provider keys, never logged, never leaked. Only relevant if you're letting your end users supply their own API keys.

Infrastructure

  • Auth — email magic links + OAuth-ready (Apple, Google), session cookies, JWT for API
  • Stripe billing — Pro tier subscription, Free tier metering, webhook handler with signature verification (Stripe Event SDK)
  • Resend email — transactional templates: welcome, billing, audit alerts
  • Firestore persistence — API keys, customer tiers, usage counters, encrypted BYOK keys
  • Cloud Run deploy — single command, autoscaling 0→N, regional failover ready
  • GitHub webhook receiver — HMAC SHA-256 signature verified, ready to dispatch audit jobs on push
  • Cloud Scheduler target — cron endpoint gated by shared secret, ready for nightly batch jobs

Deploy in one command

git clone https://github.com/jaquelinejaque/quorum-saas-starter
cd quorum-saas-starter
./scripts/setup.sh      # interactive: collects keys, creates Stripe products, configures Cloud Run
./scripts/deploy.sh     # gcloud run deploy + Firestore init + Stripe webhook registration

You ship to production in under 30 minutes.

What you build on top

The kit gives you the orchestration layer. You add the vertical:

  • AI Tax Assistant — your prompts + this kit's consensus = product
  • AI Code Reviewer — your evals + this kit's RLHF = product
  • AI Compliance Auditor — your domain knowledge + this kit's HSP gate = product
  • AI Legal Research — your case database + this kit's web learner = product

The hard infrastructure work is done. You focus on customers, prompts, and the niche-specific data only you have.

Licenses

Starter — £497

Single project deployment. Source code under modified Apache-2.0 (HSP commercial restriction). 3 months of updates. No support.

Pro — £997

  • 5 project deployments
  • Pre-trained MoE router weights (10,000+ production queries already shaped the policy table)
  • Genetic prompt evolution kit + 50 evolved seed prompts across common SaaS categories
  • 12 months of updates
  • Monthly recorded "office hours" video (no live calls — recordings only, accessible to all Pro+ buyers)
  • Read-only Discord access

Enterprise — £2,497

  • Unlimited project deployments
  • Commercial / white-label license — resell as your own product
  • EU AI Act Article 12/13 audit kit (forms, templates, cert generator)
  • 24 months of updates
  • Office hours archive (all past + future)

All tiers: source code only, no managed hosting, no live support. Buy what you can build on, not what you have to ask permission to use.

Why we charge this

The orchestration layer in this kit took 18 months and 60+ commits to get production-stable. It runs the Quorum API used in audit-grade compliance workflows. Pricing reflects what it would cost a senior engineer to rebuild from scratch: roughly 6 weeks of full-time work at standard contractor rates (~£25,000). At £497–£2,497 you're buying back that time.

Not for you if

  • You want managed hosting — go use Quorum hosted (£49/mo)
  • You want live support — this is code-only license
  • You want to vibe-code an AI app and ship in 2 hours — use Lovable or Vercel templates instead
  • You don't have a real product idea yet — this kit is for shipping, not learning

Refund policy

30 days, no questions asked, if the kit doesn't deploy successfully on your environment. After successful deployment, no refunds — you have the source code.


Built by Jaqueline Martins / Sovereign Chain Ltd. Patent Pending: HSP Protocol (PCT/US26/11908).