GitHub - mirkolenz/llmhop: Tiny, stateless Go router that dispatches OpenAI-compatible requests to single-model vLLM and sglang backends with zero external dependencies
mlenz
·
2026-06-05
·
via Hacker News: Show HN
LLMhop is a tiny stateless proxy for LLM inference servers. It tackles an issue I faced when trying to serve…
此内容由惯性聚合(RSS阅读器)自动聚合整理,仅供阅读参考。 原文来自 — 版权归原作者所有。