惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

云风的 BLOG
云风的 BLOG
freeCodeCamp Programming Tutorials: Python, JavaScript, Git & More
博客园 - 叶小钗
OSCHINA 社区最新新闻
OSCHINA 社区最新新闻
V
V2EX
酷 壳 – CoolShell
酷 壳 – CoolShell
月光博客
月光博客
人人都是产品经理
人人都是产品经理
宝玉的分享
宝玉的分享
博客园 - 司徒正美
WordPress大学
WordPress大学
Microsoft Azure Blog
Microsoft Azure Blog
罗磊的独立博客
Vercel News
Vercel News
T
The Blog of Author Tim Ferriss
T
Tailwind CSS Blog
A
About on SuperTechFans
Apple Machine Learning Research
Apple Machine Learning Research
L
LangChain Blog
让小产品的独立变现更简单 - ezindie.com
让小产品的独立变现更简单 - ezindie.com
V
Visual Studio Blog
S
SegmentFault 最新的问题
Google DeepMind News
Google DeepMind News
博客园 - 聂微东

Hacker News - Newest: "LLM"

GitHub - lechmazur/position_bias: A benchmark for testing whether LLM judges keep the same preference when two lightly edited versions of the same story are shown in opposite orders. Flex routing (EU and EFTA) Dark Factories: Retooling for LLM Velocity Ask HN: What would be the impact of a LLM output injection attack? GitHub - Oaklight/llm-rosetta: Production-ready LLM API translation layer for Python — bidirectional conversion between OpenAI, Anthropic & Google formats via hub-and-spoke IR. Optional API gateway. Streaming & non-streaming. Zero core deps. Contributions welcome! GitHub - browser-use/browser-harness: Self-healing browser harness that enables LLMs to complete any task. GitHub - moeen-mahmud/remen: Remen turns thoughts into something you can return to Analyzing 156 LLM Launch Posts on Hacker News ChatGPT vs Gemini vs Claude: The Best LLM Subscription You Should Buy GitHub - salaamalykum/quran-semantic-search: High-density RAG Semantic Search Engine & Quran Corpus (GEO/SEO Architecture) GitHub - NVIDIA/TensorRT-LLM: TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way. The State of LLM Bug Bounties in 2026 Operational Readiness Criteria for Tool-Using LLM Agents Meshcore: Architecture for a Decentralized P2P LLM Inference Network How an LLM becomes more coherent as we train it GitHub - seetrex-ai/laimark GitHub - Jossifresben/BibCrit: AI-assited biblical textual criticism GitHub - wastedcode/memex: File system based wiki, maintained by Claude 99helpers.com GitHub - cliver-project/AITrigram GitHub - unbody-io/adapt: A self-evolving memory layer for AI agents. GitHub - hb20007/awesome-gen-ai-fails: A list of incidents where reliance on generative AI and LLMs resulted in harm to companies, individuals, or society GitHub - nevenkordic/localmind: Run any local LLM with persistent memory and context. CLI agent over Ollama with SQLite-backed hybrid recall. No cloud. Ask HN: What are the machine requirements for a LLM like Llama-3.1-8B? Faster LLM Inference via Sequential Monte Carlo grpo explained: group relative policy optimization for llm finetuning - cgft Stop comparing price per million tokens: the hidden LLM API costs · TensorZero Andrej Karpathy's LLM Wiki Is a Bad Idea GitHub - GG-QandV/mnemostroma: Offline RAM-first cognitive leer/coprocessor for AI agents and robotics. Solves "Context Abandonment" with 20-80ms latency using a dual-thread biomimetic memory architecture (ONNX + SQLite WAL). mempalace/agent at agent · skorotkiewicz/mempalace
agentgateway
John Roese · 2026-06-02 · via Hacker News - Newest: "LLM"

agentgateway agentgateway agentgateway

One high-performance gateway for service, LLM, and MCP traffic.

An open source HTTP and gRPC gateway that handles traditional application traffic and AI-native protocols in one data plane. Route, secure, observe, and govern services, LLM provider traffic, MCP tools, and agent-to-agent communication without stitching together separate gateways.

LLM Gateway

Route to OpenAI, Claude, Gemini, or any self-hosted model with credentialing and failover.

MCP

MCP / A2A

Native protocol support for Model Context Protocol and agent-to-agent traffic.

APIs & Services

HTTP, gRPC, and TCP traffic — observable by default with mTLS and OIDC built in.

SOURCES · CLIENTSAGENTGATEWAY · CONTROL PLANEDESTINATIONS · MODELS & AGENTSCLI / IDEClaude, Codex, OpenCodeAI agentsLangSmith, CrewAI, ADKApps & clientsAI agentsOpenAIAnthropicMCP / A2AAPIs / ServicesTraffic ManagementLLM GatewayInference RoutingMCP / A2A gatewayREQUEST · INBOUNDROUTE · SECURE · OBSERVE · GOVERNRESPONSE · OUTBOUND

Everything you need for agent traffic — in one binary.

One control plane for service traffic, LLM routing, MCP, A2A, and inference — with policy and observability that the platform team actually trusts.

Service Gateway

HTTP, gRPC, TCP — observable by default.

Run any north–south or east–west traffic through a single binary. Zero-config TLS, OIDC, mTLS-rotation, native Envoy compatibility for those who want it.

HTTP/2gRPCmTLSTLS-1.3

LLM Gateway

Route, fail over, and budget across 12+ model backends.

Drop-in OpenAI-compatible API in front of OpenAI, Anthropic, Bedrock, Gemini, Vertex, Cohere, OSS Llama runs — with per-team token budgets, semantic caching and prompt redaction.

OpenAIAnthropicBedrockGeminiVertex

Inference Routing

Smart routing across self-hosted GPU pools.

Latency-aware, cost-aware, model-aware routing for self-hosted inference. Plug-in vLLM, TGI, Triton; agentgateway picks the warmest replica.

vLLMTGITriton

MCP

MCP Gateway

A control plane for the Model Context Protocol.

Discover, sign, scope and observe every tool call your agents make. Treat MCP servers like microservices — with versioning, RBAC, and audit trails out of the box.

DiscoveryRBACAudit

A2A

A2A Gateway

Bridge agents written in any framework.

agentgateway speaks the Agent-to-Agent protocol natively. Route invocations between LangChain, CrewAI, ADK and your own runtime — with identity, tracing, and replay.

LangChainCrewAIADKIdentity

Security & Observability

Per-call traces, logs, and policy decisions.

OpenTelemetry by default. Per-tool, per-agent, per-tenant counters. OPA-evaluated allow/deny on every hop, with tamper-evident audit logs.

OTELOPAAuditPII-shield

# Install the agentgateway binary

$ curl -sL https://agentgateway.dev/install | bash

# Run with a config file

$ agentgateway -f config.yaml

# INFO agentgateway: Listening on 0.0.0.0:3000

# INFO agentgateway: Admin UI at http://localhost:15000/ui/

# yaml-language-server: $schema=https://agentgateway.dev/schema/config

binds:

- port: 3000

listeners:

- routes:

- policies:

cors:

allowOrigins: ["*"]

allowHeaders: [content-type, cache-control]

a2a: {}

backends:

- host: localhost:9999

# Install Gateway API CRDs

$ kubectl apply --server-side --force-conflicts \

-f https://github.com/kubernetes-sigs/gateway-api/releases/download/v1.5.0/standard-install.yaml

# Install agentgateway CRDs via Helm

$ helm upgrade -i agentgateway-crds \

oci://cr.agentgateway.dev/charts/agentgateway-crds \

--create-namespace --namespace agentgateway-system \

--version v1.1.0 \

--set controller.image.pullPolicy=Always

# Install agentgateway via Helm

$ helm upgrade -i agentgateway \

oci://cr.agentgateway.dev/charts/agentgateway \

--namespace agentgateway-system \

--version v1.1.0 \

--set controller.image.pullPolicy=Always \

--set controller.extraEnv.KGW_ENABLE_GATEWAY_API_EXPERIMENTAL_FEATURES=true \

--wait

# Run agentgateway in a container

$ docker run -p 3000:3000 -p 15000:15000 \

-v $(pwd)/config.yaml:/etc/agentgateway/config.yaml \

ghcr.io/agentgateway/agentgateway:latest \

-f /etc/agentgateway/config.yaml

Quick start

Get started with agentgateway in less than 5 minutes — local-first.

MCP

MCP connectivity guide

Connect agentgateway to MCP servers with built-in discovery and auth.

Deployment options

Binary, Docker, or Kubernetes — pick what fits your stack.

Popular integrations

AAIF

"The future won’t be built by standalone agents, MCP servers or LLMs — it’s shaped by their interconnection and ability to work together seamlessly. To unlock their full potential, we must apply policies, ensure control and maintain clear visibility into their interactions. This is where agentgateway plays a pivotal role — bridging not only agent-to-agent (A2A) communication but also agent-to-MCP servers, filling a critical gap in the ecosystem. I look forward to seeing the project’s continued momentum within the Linux Foundation."

global chief technology officer & chief AI officer, Dell

AAIF

"One of the biggest open security problems today is how to do MCP security effectively. While there are a lot of problems in this space that the community doesn't know how to address, the agentgateway project provides a first step toward addressing some of the important issues with basic role-based access control and visibility of actions to MCP servers. I look forward to seeing how this project adapts and evolves to handle the complex, evolving threats in this space under open source governance."

Jamie Capper · published in The New York Times