惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

T
Tenable Blog
P
Privacy International News Feed
L
LINUX DO - 热门话题
T
Threatpost
Latest news
Latest news
C
Cybersecurity and Infrastructure Security Agency CISA
Cisco Talos Blog
Cisco Talos Blog
Cyberwarzone
Cyberwarzone
Spread Privacy
Spread Privacy
Recent Announcements
Recent Announcements
C
CXSECURITY Database RSS Feed - CXSecurity.com
The Register - Security
The Register - Security
MongoDB | Blog
MongoDB | Blog
NISL@THU
NISL@THU
Cyber Security Advisories - MS-ISAC
Cyber Security Advisories - MS-ISAC
G
GRAHAM CLULEY
K
Kaspersky official blog
L
Lohrmann on Cybersecurity
V
Vulnerabilities – Threatpost
freeCodeCamp Programming Tutorials: Python, JavaScript, Git & More
Last Week in AI
Last Week in AI
Google DeepMind News
Google DeepMind News
Y
Y Combinator Blog
博客园 - 三生石上(FineUI控件)
WordPress大学
WordPress大学
H
Help Net Security
Threat Intelligence Blog | Flashpoint
Threat Intelligence Blog | Flashpoint
C
Cisco Blogs
Security Latest
Security Latest
博客园 - 叶小钗
博客园 - Franky
The Hacker News
The Hacker News
Engineering at Meta
Engineering at Meta
Scott Helme
Scott Helme
S
Securelist
The GitHub Blog
The GitHub Blog
云风的 BLOG
云风的 BLOG
博客园 - 【当耐特】
A
About on SuperTechFans
C
Cyber Attacks, Cyber Crime and Cyber Security
博客园_首页
B
Blog RSS Feed
D
Darknet – Hacking Tools, Hacker News & Cyber Security
月光博客
月光博客
有赞技术团队
有赞技术团队
T
The Blog of Author Tim Ferriss
钛媒体:引领未来商业与生活新知
钛媒体:引领未来商业与生活新知
H
Hackread – Cybersecurity News, Data Breaches, AI and More
T
Tor Project blog
A
Arctic Wolf

Hacker News - Newest: "LLM"

GitHub - lechmazur/position_bias: A benchmark for testing whether LLM judges keep the same preference when two lightly edited versions of the same story are shown in opposite orders. Flex routing (EU and EFTA) Dark Factories: Retooling for LLM Velocity Ask HN: What would be the impact of a LLM output injection attack? GitHub - AronDaron/dataset-generator: No-code desktop app for generating high-quality synthetic datasets to fine-tune LLMs — plan-then-execute pipeline, LLM-as-judge, HuggingFace upload. GitHub - Oaklight/llm-rosetta: Production-ready LLM API translation layer for Python — bidirectional conversion between OpenAI, Anthropic & Google formats via hub-and-spoke IR. Optional API gateway. Streaming & non-streaming. Zero core deps. Contributions welcome! GitHub - browser-use/browser-harness: Self-healing browser harness that enables LLMs to complete any task. GitHub - moeen-mahmud/remen: Remen turns thoughts into something you can return to Analyzing 156 LLM Launch Posts on Hacker News ChatGPT vs Gemini vs Claude: The Best LLM Subscription You Should Buy GitHub - salaamalykum/quran-semantic-search: High-density RAG Semantic Search Engine & Quran Corpus (GEO/SEO Architecture) GitHub - NVIDIA/TensorRT-LLM: TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way. The State of LLM Bug Bounties in 2026 Operational Readiness Criteria for Tool-Using LLM Agents Meshcore: Architecture for a Decentralized P2P LLM Inference Network How an LLM becomes more coherent as we train it GitHub - seetrex-ai/laimark GitHub - Jossifresben/BibCrit: AI-assited biblical textual criticism GitHub - wastedcode/memex: File system based wiki, maintained by Claude 99helpers.com GitHub - cliver-project/AITrigram GitHub - unbody-io/adapt: A self-evolving memory layer for AI agents. GitHub - hb20007/awesome-gen-ai-fails: A list of incidents where reliance on generative AI and LLMs resulted in harm to companies, individuals, or society GitHub - nevenkordic/localmind: Run any local LLM with persistent memory and context. CLI agent over Ollama with SQLite-backed hybrid recall. No cloud. Ask HN: What are the machine requirements for a LLM like Llama-3.1-8B? Faster LLM Inference via Sequential Monte Carlo grpo explained: group relative policy optimization for llm finetuning - cgft Stop comparing price per million tokens: the hidden LLM API costs · TensorZero Andrej Karpathy's LLM Wiki Is a Bad Idea GitHub - GG-QandV/mnemostroma: Offline RAM-first cognitive leer/coprocessor for AI agents and robotics. Solves "Context Abandonment" with 20-80ms latency using a dual-thread biomimetic memory architecture (ONNX + SQLite WAL). mempalace/agent at agent · skorotkiewicz/mempalace GitHub - Nyquest-ai/nyquest-rust-fullstack-pub: Nyquest — Semantic Compression Proxy for LLMs. 350+ rules, local LLM stage, 15-75% token savings. Full Rust stack. GitHub - TheoV823/mneme: Enforce architectural decisions in AI-assisted development. GitHub - klemenvod/TokenBrawl: A 1v1 Bomberman-style game where two LLM agents play autonomously against each other. No human plays — you watch the AIs fight. Each agent receives a text description of the board state, reasons about it, and outputs a move as JSON. The game engine executes it. Introducing the Common AI Provider: LLM and AI Agent Support for Apache Airflow Power Circuit AI: Designing Power Electronic Circuits for Motor Drives with Generative Artificial Intelligence Ask HN: How to program with IDE and LLM on CPU locally? Show HN: Agent-cache – Multi-tier LLM/tool/session caching for Valkey and Redis Bonsai 1-bit WebGPU - a Hugging Face Space by webml-community The LLM Fallacy: Misattribution in AI-Assisted Cognitive Workflows Ask HN: Simple tooling for local LLM code critique without IDE integration? Can a General LLM Diagnose a DICOM Slice? A 10-Case Public Benchmark Charts-of-Thought: Enhancing LLM Visualization Literacy (PDF, 2026) GitHub - Mesh-LLM/mesh-llm: Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat. GitHub - seamus-brady/springdrift: A persistent runtime for long-lived LLM agents Writing an LLM from scratch, part 32k -- Interventions: training a better model locally with gradient accumulation Ask HN: Which LLM model and agentic CLI are you using for local development? GitHub - wayneColt/modelcascade: Route local. Escalate smart. Never overspend. Open-source multi-model cascade routing for autonomous agents. LLM pricing is 100x harder than you think GitHub - asakin/llm-primer: Pre-warmed Claude Code sessions in tmux. No startup wait. GitHub - EggerMarc/chat-rs: A multi-provider LLM framework for Rust. GitHub - SynapseKit/SynapseKit: Minimal, async-first Python framework for production LLM apps- 2 hard deps, no magic, no SaaS. A Claude Skill that Makes LLM Paragraphs More Bearable Does Gas Town 'steal' usage from users' LLM credits & paid services to improve itself? What's Claude Code Actually Doing? Open the Black Box with the Arthur Engine Milla Jovovich's New Open Source LLM Memory App and the Dark Code Problem Your intuition of LLM token usage might be wrong Show HN: Bloomberg Terminal for LLM ops – free and open source GitHub - 0xchamin/mcptube: Transform YouTube videos into a compounding knowledge base with transcripts, vision analysis, and agentic search. Works as an MCP server for Claude, Copilot & more. Show HN: Open KB: Open LLM Knowledge Base Your LLM is a compiler, not a runtime GitHub - sapountzis/Unslop: A Web Feed That Deserves You crates.io: Rust Package Registry Beyond Karpathy's LLM-Wiki: The Necessity of Cognitive Governance GitHub - amitshekhariitbhu/llm-internals: Learn LLM internals step by step - from tokenization to attention to inference optimization. GitHub - parallem-ai/parallem: An expressive library for running agents with the Batch API. GitHub - stfurkan/pi-llm LLM-Wiki Show HN: Formal – Formal verification for AI-generated code using Lean 4 LRTS – Regression testing for LLM prompts (open source, local-first) LLM Wiki Skill: Build a Second Brain with Claude Code and Obsidian I built an LLM Wiki and RAG solution: here's a demo for a security KB The biggest advance in AI since the LLM Predict-Rlm: The LLM Runtime That Lets Models Write Their Own Control Flow the-synthetic-library/the-synthetic-mind at main · joshferrer1/the-synthetic-library GitHub - yisding/reviewwiggum GitHub - Donnyb369/mcp-spine: Context Minifier & State Guard — Local-first MCP middleware proxy GitHub - Beledarian/wgpu-llm: A from-scratch LLM inference engine that uses wgpu (the cross-platform WebGPU implementation) to dispatch WGSL compute shaders for every math operation a Transformer needs. No CUDA. No Python. No massive framework dependencies. Just Rust, raw shaders, and your GPU. GitHub - anitiue/Hindsight: An experience-driven self-improvement framework for LLM agents — 基于经验的 LLM Agent 自我改进框架 GitHub - stef41/lmscan: 🔍 Detect AI-generated text and fingerprint which LLM wrote it. Open-source GPTZero alternative. Zero dependencies, works offline. GitHub - alainnothere/AmdPerformanceTesting: Amd Performance Testing Ask HN: Is a purely Markdown-based CRM a terrible idea? Optimized for LLM agents Context Engineering - LLM Memory and Retrieval for AI Agents | Weaviate little_helper_tui/letter.md at main · sleepyeldrazi/little_helper_tui GitHub - EvanZhouDev/umr: The Unified Model Registry for all your local AI apps. GitHub - JordanCT/VigIA-Orchestrator Your Agent Is Mine: Measuring Malicious Intermediary Attacks on the LLM Supply Chain A Taxonomy of RL Environments for LLM Agents Llama LLM Network Feture GitHub - genedeng-ca/ai-mac-migration: AI-powered Mac-to-Mac migration tool - replace Apple Migration Assistant with intelligent, selective transfer using local LLMs GitHub - lunargate-ai/gateway: High-performance self-hosted AI gateway (OpenAI-compatible) with routing, retries, and streaming GitHub - AuthBits/webmcp: A lightweight, prompt-driven MCP web research server for high-quality LLM powered information extraction. Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineering Springdrift: An Auditable Persistent Runtime for LLM Agents with Case-Based Memory, Normative Safety, and Ambient Self-Perception High-Stakes Personalization: Rethinking LLM Customization for Individual Investor Decision-Making From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agents HUOZIIME: An On-Device LLM-enhanced Input Method for Deep Personalization TIDE: Token-Informed Depth Execution for Per-Token Early Exit in LLM Inference Characterizing WebGPU Dispatch Overhead for LLM Inference Across Four GPU Vendors, Three Backends, and Three Browsers LLM Targeted Underperformance Disproportionately Impacts Vulnerable Users
GitHub - thefullnacho/hestia: Local-first, self-hosted home & records assistant: one LLM brain, scoped tools, durable memory. AGPL-3.0.
thefullnacho · 2026-06-28 · via Hacker News - Newest: "LLM"

A local-first, self-hosted assistant for your home. One stateful "brain" runs a local LLM on hardware you own, and every window into it — your phone, a terminal, the kitchen mic, Home Assistant — talks to that same brain. Nothing runs in the cloud, nothing is exposed to the internet, and your data never leaves the house.

The idea it's built on. Most "AI for the home" points the model at the things it's worst at: remembering a schedule, watching a threshold, firing a reminder at the right minute. Hestia does the opposite. Anything deterministic — a chore is due, the soil is dry, the trash goes out Tuesday — is handed to something dumb and reliable: a timer, a record, a row in a database. The LLM is left to do the one thing it's genuinely good at, which is judgment and conversation. The goal was never a smarter brain. It's a more reliable one. (ARCHITECTURE.md is the long version; MEMORY-DESIGN.md covers the memory plan.)

What it actually is.

  • A brain (brain/) — an OpenAI-compatible endpoint (POST /v1/chat/completions) wrapping a local LLM (Ollama, qwen3:14b) with an agent loop. Every client speaks one dialect.
  • Eight scoped toolshome (control Home Assistant), media (Plex + *arr), memory, records, reminder, search, status, weather. There is deliberately no shell tool: the brain can act in your house but cannot run arbitrary commands.
  • Memory that grows — markdown soft-facts plus a SQLite record of the things in your life (pets, garden, wildlife, chores), and a background note-taker that proposes durable facts for you to approve rather than writing them silently.
  • A media appliance — Plex + the *arr stack + Bazarr subtitles + qBittorrent behind a fail-closed VPN kill-switch.
  • Voice — talk to it through Home Assistant's Assist pipeline or the browser.

What it isn't. A cloud service, a wrapper around someone else's API, or anything you should put on the public internet. It runs rootless on your own box and never phones home.

⚠️ Read SECURITY.md before running it. The brain has no built-in authentication and can control your devices, so it must stay on a private network (Tailscale or LAN). That's a deliberate trade-off, not an oversight — the doc explains the trust model.

Hestia is part of the Forager / Homesteader Labs constellation, alongside forager_ml, forager-field-station, and the Homesteader Labs site.

Status

  • Phase 0 — Reach + brain ✅ — talk to your home model from your phone (details below).
  • Phase 1 — Media appliance ✅ — Plex + qBittorrent + gluetun VPN kill-switch (verified) + the *arr automation layer (Prowlarr/Sonarr/Radarr + FlareSolverr + Bazarr subtitles). Full loop: search → download (via VPN) → hardlink → Plex.
  • Phase 2 — House (Home Assistant) ✅ — HA running; lights and devices reachable via the home tool.
  • Phase 3 — Voice ✅ — speak to Hestia through HA's Assist pipeline and a browser voice loop.
  • Phase 4 — The seam (memory + tools)core in place, still growing — the brain is a tool-calling agent with the eight tools above plus deterministic skill injection, and HA's conversation agent points at Hestia, so Assist and voice route through the brain (which can control HA back). It also gets smarter over time via the note-taker (see Memory & learning). Next: vision (Eyes).

Phase 0 — Reach + brain

Win: talk to your home model from your phone.

The brain (brain/) is a thin OpenAI-compatible proxy onto Ollama. Every client — terminal, phone, kitchen mic — speaks one dialect (POST /v1/chat/completions). In Phase 0 it forces the chosen model, injects Hestia's system prompt (persona + the hardened safety rules from the benchmark A/B), and streams the reply back. Memory and tools land in Phase 4 behind this same URL.

What runs (GPU box)

Service What Bind GPU
hestia-ollama Ollama inference engine 127.0.0.1:11434 (localhost only) RTX 5080 only
hestia-brain Hestia /v1 proxy 0.0.0.0:8730 (reachable over Tailscale)

Both are user systemd services (no root), defined in deploy/systemd/ and installed into ~/.config/systemd/user/. Linger is enabled, so they survive logout/reboot. Ollama is pinned to the 5080 (CUDA_VISIBLE_DEVICES), leaving the 4060 Ti free for Phase 3 (Whisper/Piper) per the benchmark verdict.

Model: qwen3:14b (resident, thinking off) — the current pick after the model eval (brain/eval_models.py; qwen2.5:14b kept on disk as a fallback). See MODEL_EVAL.md.

Operate

Day to day, use deploy/hestiactl (symlinked into ~/.local/bin) — one command for the whole estate, run from the GPU box:

hestiactl status              # brain health + local units + every container on hl-relay
hestiactl health              # raw /health JSON
hestiactl up|down|restart X   # X: brain ollama | arr services | plex qbit ha adguard ... | all
hestiactl logs X [-f]         # journalctl (local) or docker logs (remote)
hestiactl vpn                 # verify the qBittorrent kill-switch

all covers only the Hestia-managed pieces (local units + arr stack); core containers (AdGuard = house DNS, gluetun, HA) are controlled one at a time and ask for confirmation before stopping.

The underlying commands, for when you need them directly:

# status / logs
systemctl --user status hestia-ollama hestia-brain
journalctl --user -u hestia-brain -f

# restart after editing brain code or a service file
systemctl --user daemon-reload          # only if you edited a .service
systemctl --user restart hestia-brain

# health (Ollama up + model present?) — brain binds the Tailscale IP, not localhost
curl -s 127.0.0.1:8730/health | jq

# talk to it
curl -s 127.0.0.1:8730/v1/chat/completions -H 'content-type: application/json' \
  -d '{"messages":[{"role":"user","content":"hello Hestia"}]}' | jq -r .choices[0].message.content

If you edit a deploy/systemd/*.service file, re-copy it into ~/.config/systemd/user/ before daemon-reload.

Reach it from the phone (Tailscale)

Tailscale is the one piece that needs root, so it isn't auto-installed. On the GPU box:

curl -fsSL https://tailscale.com/install.sh | sh
sudo tailscale up

Then on the phone: install the Tailscale app, sign in to the same tailnet. The brain is then reachable at http://<gpu-box-tailscale-name>:8730/v1 from any app that speaks OpenAI (set that as the base URL; any API key string works — Ollama ignores it). Nothing is exposed to the public internet.

Brain layout

brain/
  hestia.py       # the agent loop: /v1/chat/completions + /health, tools, memory, note-taker hook
  config.py       # single source of paths + secret loading; makes the brain relocatable
  prompt.py       # SYSTEM_PROMPT — persona + hardened safety rules
  records_store.py / memory_store.py   # SQLite entities+events / markdown soft facts
  note_taker.py   # background "gets smarter over time" extractor
  review_notes.py # CLI to review + promote the note-taker's proposals
  tools/          # home, media, memory, records, reminder, search, status, weather (+ skill router)
  tests/          # pytest: stores, dispatch, note-taker (run: uv run --project brain pytest)
  pyproject.toml  # deps + dev (pytest) + pytest config (uv-managed, isolated venv)

Relocatable. Every path derives from config.py's own location, so moving or restoring the repo to a new path needs no edits; HESTIA_ROOT overrides if needed. All service URLs, tokens, and thresholds stay env-overridable next to the tools that use them.


Phase 1 — Media appliance (Dell Micro = hl-relay)

Win: the media stack runs, independent of the brain.

Most of this already existed on the Micro before Hestia: Plex (hl-plex), qBittorrent behind gluetun (Surfshark, OpenVPN, NL) with a fail-closed VPN kill-switch, plus AdGuard, MQTT, and Home Assistant. The kill-switch is verified: qBittorrent's traffic egresses via the VPN datacenter IP, not the host's. Don't docker compose up the existing /opt/home/compose.yml blindly — its volume paths are literal /path/to/... host dirs that the running containers depend on.

Hestia added the missing automation layer as a separate, isolated stack (deploy/media/compose.yml, deployed to /opt/home/arr/): Prowlarr (:9696, indexer manager), Sonarr (:8989, TV), Radarr (:7878, movies). All reachable over Tailscale.

Also added FlareSolverr (:8191) so Prowlarr can reach Cloudflare-protected indexers, wired as a Prowlarr indexer-proxy (tag flaresolverr).

Wired via API: root folders point at the existing Plex library (/data/TV Shows, /data/Movies); a remote-path mapping (/downloads/data/downloads) lets Sonarr/Radarr hardlink from qBittorrent's downloads into the library (instant, no copy — both are one filesystem under /mnt/media); Prowlarr is connected to Sonarr + Radarr (fullSync). Five reputable public indexers added (The Pirate Bay, Knaben, LimeTorrents, plus 1337x + EZTV via FlareSolverr) and synced down to the apps. YTS deliberately excluded (history of feeding user data to copyright trolls).

qBittorrent is wired as the download client in both Sonarr (category tv-sonarr) and Radarr (radarr), tested OK. The full loop works: search → download through the VPN → hardlink into the Plex library. Both apps report no health warnings.

⚠️ Media currently lives on the Micro's 98 GB root disk (~66 GB free). Fine to start; plan a dedicated disk or NAS before the library grows.

Operate (on hl-relay)

cd /opt/home/arr
docker compose ps
docker compose pull && docker compose up -d   # update *arr

Phase 4 — the seam: HA conversation agent → Hestia

deploy/ha/custom_components/hestia/ is a thin custom HA integration: it registers a conversation agent (conversation.hestia) that forwards each utterance to Hestia's /v1 and speaks the reply. Hestia owns the loop (memory + tools, incl. controlling HA back); HA is just input + a tool. This is the architecture's keystone made real.

Wiring on hl-relay (not in this repo — lives in HA's config):

  • Integration files installed to /opt/home/ha_config/custom_components/hestia/.
  • A config entry points it at http://127.0.0.1:8730/v1/chat/completions (Hestia over Tailscale; the HA container can reach it).
  • The preferred Assist pipeline's conversation_engine is set to conversation.hestia, so the Assist chat and voice satellites route through the brain.

Verified: via HA's conversation API, "turn on the TV light" drove the real light and "what coffee should I buy?" recalled a memory — HA → Hestia → HA round trip.

Memory & learning — it gets smarter over time

Two stores back the brain: memory_store (markdown soft facts/preferences, git-auditable) and records_store (SQLite entities + a uniform event log: pets/lineage, wildlife, chores, service reminders, the garden). Both are injected into the system prompt per request, scoped to what the request implies.

The brain also learns passively. After each exchange — once the answer is already on the wire — a background note-taker (note_taker.py) reads the turn and proposes durable facts it heard ("trash pickup is Tuesday mornings"). True to propose, don't dispose, those land in a review inbox (memory/inbox/), not straight into live memory:

uv run --project brain python brain/review_notes.py list
uv run --project brain python brain/review_notes.py promote <id> | --all
uv run --project brain python brain/review_notes.py discard <id> | --all

It reuses the resident model by default and never blocks or breaks a request. Tuning knobs: HESTIA_NOTETAKER=0 disables it; HESTIA_NOTETAKER_AUTOWRITE=1 skips the review queue and writes durable memories directly; HESTIA_NOTETAKER_MODEL points it at a cheaper model (e.g. a second Ollama on the free 4060 Ti) to take the load off the brain.

License & security

Hestia is licensed under the GNU Affero General Public License v3.0 — see LICENSE. The AGPL is deliberate: Hestia is built to be self-hosted, so the copyleft keeps it open even for anyone who runs a modified version as a network service, while imposing nothing on you for running it at home.

Before running it, read SECURITY.md: the brain has no built-in authentication and can control your Home Assistant devices, so it must stay on a private network (Tailscale/LAN) and must never be exposed to the public internet. It deliberately has no shell tool.

© 2026 TheFullNacho and contributors.