惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

博客园_首页
爱范儿
爱范儿
罗磊的独立博客
V
V2EX
量子位
Last Week in AI
Last Week in AI
Hugging Face - Blog
Hugging Face - Blog
博客园 - 司徒正美
Jina AI
Jina AI
博客园 - 叶小钗
小众软件
小众软件
博客园 - 【当耐特】
Y
Y Combinator Blog
让小产品的独立变现更简单 - ezindie.com
让小产品的独立变现更简单 - ezindie.com
T
Tailwind CSS Blog
博客园 - 聂微东
Microsoft Security Blog
Microsoft Security Blog
美团技术团队
P
Proofpoint News Feed
Cyber Security Advisories - MS-ISAC
Cyber Security Advisories - MS-ISAC
有赞技术团队
有赞技术团队
MongoDB | Blog
MongoDB | Blog
Recent Announcements
Recent Announcements
酷 壳 – CoolShell
酷 壳 – CoolShell

Hacker News - Newest: "LLM"

GitHub - lechmazur/position_bias: A benchmark for testing whether LLM judges keep the same preference when two lightly edited versions of the same story are shown in opposite orders. Flex routing (EU and EFTA) Dark Factories: Retooling for LLM Velocity Ask HN: What would be the impact of a LLM output injection attack? GitHub - Oaklight/llm-rosetta: Production-ready LLM API translation layer for Python — bidirectional conversion between OpenAI, Anthropic & Google formats via hub-and-spoke IR. Optional API gateway. Streaming & non-streaming. Zero core deps. Contributions welcome! GitHub - browser-use/browser-harness: Self-healing browser harness that enables LLMs to complete any task. GitHub - moeen-mahmud/remen: Remen turns thoughts into something you can return to Analyzing 156 LLM Launch Posts on Hacker News ChatGPT vs Gemini vs Claude: The Best LLM Subscription You Should Buy GitHub - salaamalykum/quran-semantic-search: High-density RAG Semantic Search Engine & Quran Corpus (GEO/SEO Architecture) GitHub - NVIDIA/TensorRT-LLM: TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way. The State of LLM Bug Bounties in 2026 Operational Readiness Criteria for Tool-Using LLM Agents Meshcore: Architecture for a Decentralized P2P LLM Inference Network How an LLM becomes more coherent as we train it GitHub - seetrex-ai/laimark GitHub - Jossifresben/BibCrit: AI-assited biblical textual criticism GitHub - wastedcode/memex: File system based wiki, maintained by Claude 99helpers.com GitHub - cliver-project/AITrigram GitHub - unbody-io/adapt: A self-evolving memory layer for AI agents. GitHub - hb20007/awesome-gen-ai-fails: A list of incidents where reliance on generative AI and LLMs resulted in harm to companies, individuals, or society GitHub - nevenkordic/localmind: Run any local LLM with persistent memory and context. CLI agent over Ollama with SQLite-backed hybrid recall. No cloud. Ask HN: What are the machine requirements for a LLM like Llama-3.1-8B? Faster LLM Inference via Sequential Monte Carlo grpo explained: group relative policy optimization for llm finetuning - cgft Stop comparing price per million tokens: the hidden LLM API costs · TensorZero Andrej Karpathy's LLM Wiki Is a Bad Idea GitHub - GG-QandV/mnemostroma: Offline RAM-first cognitive leer/coprocessor for AI agents and robotics. Solves "Context Abandonment" with 20-80ms latency using a dual-thread biomimetic memory architecture (ONNX + SQLite WAL). mempalace/agent at agent · skorotkiewicz/mempalace
GitHub - gerritsxd/chatforge: Drag two conversations toge...
cyg2 · 2026-04-25 · via Hacker News - Newest: "LLM"

Drag two conversations together. The model remembers everything.

A local AI chat interface where conversations are living objects — merge them, compile them into weights, and build a model that compounds knowledge over time. Fully local, fully yours, nothing leaves your machine.

demo


What makes it different

Feature CHATFORGE typical local chat UI
Drag-to-merge conversations
Persistent cross-session memory
Auto fact extraction per exchange
Runs 100% locally on your GPU sometimes
LoRA compilation (coming) 🔜

Core concept

Most chat interfaces treat conversations as isolated sessions. CHATFORGE treats them as composable knowledge.

  • Merge — drag any two conversations onto each other. Their contexts combine chronologically into a single conversation. Ask questions that require facts from both.
  • Memory — after every exchange, the model silently extracts facts about you and stores them. Every future chat starts with that context already loaded.
  • Compile (Phase 4) — one-click LoRA fine-tuning bakes merged context permanently into model weights. No context window needed at inference time.

Requirements

  • Ollama with at least one model pulled
  • Python 3.9+
  • Node.js 18+
  • NVIDIA GPU recommended (runs on CPU too, just slower)

Tested on RTX 3060 Ti with qwen2.5:7b / qwen3.5 — fits in 8GB VRAM.


Quick start

1. Clone

git clone https://github.com/gerritsxd/chatforge
cd chatforge

2. Backend

cd backend
pip install -r requirements.txt
python -m uvicorn main:app --reload --port 8000

3. Frontend

cd frontend
npm install
npm run dev

4. Open http://localhost:5173

Make sure Ollama is running with at least one model:

ollama pull qwen2.5:7b

Usage

Chat

Select a model from the dropdown, type a message. Conversations are auto-saved.

Merge

Drag one conversation from the sidebar onto another. They combine into a new MERGE: conversation. The model now has both contexts — ask questions that span both chats.

Memory

Click the MEMORY button in the topbar to see what the model has learned about you. Click × on any fact to make it forget. Memory is automatically injected into every new conversation.


Project structure

chatforge/
├── backend/
│   ├── main.py          # FastAPI server, chat streaming, memory extraction
│   ├── db.py            # SQLite: conversations, messages, memories
│   └── requirements.txt
├── frontend/
│   ├── src/
│   │   ├── App.jsx
│   │   └── components/
│   │       ├── Sidebar.jsx      # drag-to-merge lives here
│   │       ├── ConvItem.jsx     # draggable/droppable conversation item
│   │       ├── ChatWindow.jsx
│   │       └── MemoryPanel.jsx
│   └── package.json
├── start.bat            # Windows: launches both servers
└── PLAN.md              # full roadmap

Roadmap

  • Phase 1 — Chat UI + Ollama streaming + SQLite persistence
  • Phase 2 — Drag-to-merge conversations
  • Phase 3 — Persistent memory with auto fact extraction
  • Phase 4 — LoRA compilation: one-click bake context into weights
  • Phase 5 — Docker container + hackathon demo polish

Stack

  • Backend: Python, FastAPI, SQLite, httpx
  • Frontend: React, Vite, dnd-kit
  • AI: Ollama (any local model)

License

MIT