惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

钛媒体:引领未来商业与生活新知
钛媒体:引领未来商业与生活新知
Stack Overflow Blog
Stack Overflow Blog
云风的 BLOG
云风的 BLOG
G
Google Developers Blog
J
Java Code Geeks
C
Check Point Blog
Last Week in AI
Last Week in AI
Microsoft Azure Blog
Microsoft Azure Blog
Blog — PlanetScale
Blog — PlanetScale
月光博客
月光博客
Vercel News
Vercel News
The GitHub Blog
The GitHub Blog
L
LangChain Blog
有赞技术团队
有赞技术团队
Cyber Security Advisories - MS-ISAC
Cyber Security Advisories - MS-ISAC
博客园 - 司徒正美
IT之家
IT之家
Martin Fowler
Martin Fowler
让小产品的独立变现更简单 - ezindie.com
让小产品的独立变现更简单 - ezindie.com
T
Tailwind CSS Blog
U
Unit 42
Jina AI
Jina AI
Microsoft Security Blog
Microsoft Security Blog
I
InfoQ

Hacker News - Newest: "LLM"

GitHub - lechmazur/position_bias: A benchmark for testing whether LLM judges keep the same preference when two lightly edited versions of the same story are shown in opposite orders. Flex routing (EU and EFTA) Dark Factories: Retooling for LLM Velocity Ask HN: What would be the impact of a LLM output injection attack? GitHub - AronDaron/dataset-generator: No-code desktop app for generating high-quality synthetic datasets to fine-tune LLMs — plan-then-execute pipeline, LLM-as-judge, HuggingFace upload. GitHub - Oaklight/llm-rosetta: Production-ready LLM API translation layer for Python — bidirectional conversion between OpenAI, Anthropic & Google formats via hub-and-spoke IR. Optional API gateway. Streaming & non-streaming. Zero core deps. Contributions welcome! GitHub - browser-use/browser-harness: Self-healing browser harness that enables LLMs to complete any task. GitHub - moeen-mahmud/remen: Remen turns thoughts into something you can return to Analyzing 156 LLM Launch Posts on Hacker News ChatGPT vs Gemini vs Claude: The Best LLM Subscription You Should Buy GitHub - salaamalykum/quran-semantic-search: High-density RAG Semantic Search Engine & Quran Corpus (GEO/SEO Architecture) GitHub - NVIDIA/TensorRT-LLM: TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way. The State of LLM Bug Bounties in 2026 Operational Readiness Criteria for Tool-Using LLM Agents Meshcore: Architecture for a Decentralized P2P LLM Inference Network How an LLM becomes more coherent as we train it GitHub - seetrex-ai/laimark GitHub - Jossifresben/BibCrit: AI-assited biblical textual criticism GitHub - wastedcode/memex: File system based wiki, maintained by Claude 99helpers.com GitHub - cliver-project/AITrigram GitHub - unbody-io/adapt: A self-evolving memory layer for AI agents. GitHub - hb20007/awesome-gen-ai-fails: A list of incidents where reliance on generative AI and LLMs resulted in harm to companies, individuals, or society GitHub - nevenkordic/localmind: Run any local LLM with persistent memory and context. CLI agent over Ollama with SQLite-backed hybrid recall. No cloud. Ask HN: What are the machine requirements for a LLM like Llama-3.1-8B? Faster LLM Inference via Sequential Monte Carlo grpo explained: group relative policy optimization for llm finetuning - cgft Stop comparing price per million tokens: the hidden LLM API costs · TensorZero Andrej Karpathy's LLM Wiki Is a Bad Idea GitHub - GG-QandV/mnemostroma: Offline RAM-first cognitive leer/coprocessor for AI agents and robotics. Solves "Context Abandonment" with 20-80ms latency using a dual-thread biomimetic memory architecture (ONNX + SQLite WAL).
GitHub - lunargate-ai/gateway: High-performance self-host...
2026-04-10 · via Hacker News - Newest: "LLM"

LunarGate

Self-hosted open-source AI gateway with OpenAI-compatible APIs, Ollama upstream support, routing, fallback, and observability-friendly data sharing.

Docs | API Reference | Examples | Website

License: MIT


Important

LunarGate is under active development. The core gateway is already usable today, but interfaces and configuration may still evolve.

LunarGate is a Go-based AI gateway that lets you expose one stable endpoint to your applications while routing requests to different upstream model providers behind the scenes.

What LunarGate does

  • Exposes an OpenAI-compatible API for client apps
  • Routes requests across providers and models with weighted or conditional rules
  • Adds retries, fallbacks, and circuit breakers at the gateway layer
  • Supports streaming and tool-calling flows
  • Keeps a small footprint: the standalone binary is typically around 10-12 MB depending on platform, and the container image is around 12 MB
  • Keeps data local by default, with optional prompt/response sharing for observability
  • Works with providers such as OpenAI, Anthropic, Ollama, and other OpenAI-compatible local backends

Supported endpoints

  • POST /v1/chat/completions
  • POST /v1/responses
  • POST /v1/embeddings
  • GET /v1/models

Provider support

LunarGate exposes an OpenAI-compatible client-facing API, but it can route to multiple upstream provider types behind the scenes, including:

  • OpenAI
  • Anthropic
  • Ollama
  • other OpenAI-compatible backends

That means your app can keep one stable client integration while the gateway talks to the upstream provider in the format it expects.

Documentation

Full documentation lives at docs.lunargate.ai.

Useful starting points:

Quick start

Choose one install path:

Homebrew (macOS)

brew tap lunargate-ai/tap
brew install lunargate

Install script (Linux)

curl -fsSL https://get.lunargate.ai/install.sh | sh

Build from source

make build

Minimal configuration

Create config.yaml:

providers:
  openai:
    api_key: "${OPENAI_API_KEY}"
    base_url: "https://api.openai.com/v1"
    default_model: "gpt-5.2"

routing:
  routes:
    - name: "default"
      targets:
        - provider: openai
          model: "gpt-5.2"

If you use environment placeholders such as ${OPENAI_API_KEY}, either export them in your shell or place them in a local .env file:

OPENAI_API_KEY=sk-xxxxxxxxx

Then start the gateway:

lunargate --config ./config.yaml

If you omit --config, LunarGate will look for config.yaml in the current directory.

Call the gateway

Point your OpenAI-compatible client at:

http://localhost:8080/v1

For a runnable client example, see gateway-examples/.

Observability

By default, LunarGate does not forward prompts or responses outside your infrastructure.

If you want to connect the gateway to LunarGate observability, create a gateway in the Gateways section of app.lunargate.ai and add the generated gateway API key to your environment:

LUNARGATE_GATEWAY_API_KEY=lgw_your_gateway_api_key

Then enable data_sharing in config.yaml:

data_sharing:
  enabled: true
  share_prompts: true
  share_responses: true
  remote_control: true
  api_key: "${LUNARGATE_GATEWAY_API_KEY}"

You can keep share_prompts and share_responses off if you want metrics-only forwarding.

Security

Basic inbound API-key authentication is available via the security section in config.yaml.

For now, treat that as a solid first layer for trusted internal clients, not as a finished public multi-tenant edge. If the gateway is internet-facing, keep an auth-enforcing proxy, API gateway, or service mesh in front of it.

License

MIT