惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

S
SegmentFault 最新的问题
博客园 - 三生石上(FineUI控件)
WordPress大学
WordPress大学
博客园 - 【当耐特】
月光博客
月光博客
Vercel News
Vercel News
D
Docker
I
InfoQ
Apple Machine Learning Research
Apple Machine Learning Research
博客园 - 叶小钗
MongoDB | Blog
MongoDB | Blog
GbyAI
GbyAI
有赞技术团队
有赞技术团队
雷峰网
雷峰网
博客园 - 聂微东
小众软件
小众软件
Y
Y Combinator Blog
腾讯CDC
L
LangChain Blog
The GitHub Blog
The GitHub Blog
宝玉的分享
宝玉的分享
Stack Overflow Blog
Stack Overflow Blog
大猫的无限游戏
大猫的无限游戏
T
The Blog of Author Tim Ferriss

Hacker News - Newest: "AI"

AI can't read an investor deck AI as an attorney? Student uses ChatGPT, Gemini to sue UW over alleged racial discrimination Hacking MCP Servers in AI Systems – The Rug Pull: Tool Changes After Approval GitHub - MeepCastana/KubeezCut: Free Web based video editor Can AI judge journalism? A Thiel-backed startup says yes, even if it risks chilling whistleblowers Coming soon: 10 Things That Matter in AI Right Now DARPA built an AI to fact-check enemy weapons claims What explains heterogeneity in AI adoption? When AI Meets Muscle: Context-Aware Electrical Stimulation Promises a New Way to Guide Human Movements - Department of Computer Science AI Changed How We Build. It Did Not Change What Matters. Linux rules on using AI-generated code - Copilot is OK, but humans must take 'full responsibility for the… Meta spins up AI version of Mark Zuckerberg to engage with employees Code Mode: Let Your AI Write Programs, Not Just Call Tools | TanStack Blog GitHub - Delavalom/graft: Go framework for building AI agents. Type-safe tools, multi-provider (OpenAI, Anthropic, Gemini, Bedrock), zero vendor SDKs. India's TCS tops estimates, says new AI models did not dent services demand Gen Z's fading AI hype Strong feeling: we are in a folded AI reality GitHub - machinarii/total-recall-catalog: A reference catalog of latest knowledge retrieval, memory & RAG systems GitHub - mensfeld/code-on-incus: Give each AI agent its own isolated machine with root, Docker, and systemd. Active defense detects and stops threats automatically.. Quantization, LoRA, and the 8% Problem: Benchmarking Local LLMs for Production AI Iran war: We spoke to the man making Lego-style AI videos that experts say are powerful propaganda Powell, Bessent discussed Anthropic's Mythos AI cyber threat with major U.S. banks GitHub - immartian/bellamem: Persistent belief-graph memory for AI agents. Retrieves decisive context by importance — not recency, not RAG, not /compact. recursive-mode: The Repo-Native Operating System for AI Engineering After the attack on Sam Altman's home, will AI CEO's go on the offensive? The biggest advance in AI since the LLM Opus 4.6 vs GPT 5.4 One Prompt Unity World Generation Test “AI polls” are fake polls Client Challenge Can AI be a 'child of God'? Inside Anthropic's meeting with Christian leaders
GitHub - Skillful-Fox-Studio/grey-fox-community
SkilfulFox · 2026-06-22 · via Hacker News - Newest: "AI"

GreyFox Community Edition

GreyFox Community Edition is a self-hosted AI traffic proxy and local operator console for teams that want to control LLM token usage, enforce per-user limits, reuse exact cached responses, and keep AI traffic visibility inside their own infrastructure.

GreyFox runs as a local Docker box. No GreyFox-hosted control plane is required.

What You Get

  • OpenAI-compatible proxy endpoint at /v1/chat/completions
  • Local Admin UI served from the same container
  • Per-user token quota enforcement with X-App-User-Id
  • Mock mode for zero-cost onboarding and demos
  • Provider mode for OpenAI-compatible upstream APIs
  • Exact response cache for repeated non-streaming requests
  • Local SQLite storage for settings, users, logs, cache, and metrics
  • Traffic history, token analytics, manual cost calculator, and safe maintenance tools

Community Edition Limits

  • Up to 5 active managed users
  • Token monitoring is the authoritative usage signal
  • Cost estimates are manual and informational only
  • No hosted GreyFox cloud control plane
  • No automatic update checks or automatic container updates
  • No request detail drawer, exports, deeper diagnostics, or live traffic metrics

Requirements

  • Docker Desktop or Docker Engine with Docker Compose
  • One available host port, default 8080
  • A Provider API key only if you want to use live provider mode

You do not need Node.js, npm, Angular, Nx, or source code to run the Community Edition release.

Quick Start

Create a compose.yaml file:

services:
  greyfox:
    image: ghcr.io/skillful-fox-studio/grey-fox-community:0.1.0
    container_name: greyfox-community
    environment:
      OPENAI_BASE_URL: ${OPENAI_BASE_URL:-https://api.openai.com/v1}
      GREYFOX_DB_PATH: ${GREYFOX_DB_PATH:-data/greyfox.db}
      PORT: 3000
      GREYFOX_STATIC_ROOT: /app/public/admin-ui
    ports:
      - "${GREYFOX_HTTP_PORT:-8080}:3000"
    volumes:
      - greyfox-data:/app/data
    restart: unless-stopped

volumes:
  greyfox-data:

Start GreyFox:

Open the Admin UI:

Health check:

curl http://localhost:8080/api/health

Expected response:

{"status":"ok","service":"proxy-api"}

How GreyFox Fits Into Your App

GreyFox is a proxy layer. It does not install browser extensions, intercept your personal ChatGPT usage, or automatically capture traffic from unrelated applications. Your AI application must send its provider requests to GreyFox instead of sending them directly to the upstream provider.

Typical direct setup:

Your application
      |
      | HTTPS request with provider API key
      v
OpenAI-compatible provider

GreyFox setup:

Your application
      |
      | OpenAI-compatible request
      | Base URL: http://<greyfox-host>:<port>/v1
      | Header: X-App-User-Id: <your-end-user-id>
      v
GreyFox Community Edition
      |
      | Local checks:
      | - user token quota
      | - exact response cache
      | - prompt injection guard
      | - traffic logging
      v
OpenAI-compatible provider

The application still decides when to call AI. GreyFox only sees requests that are explicitly routed through its proxy endpoint.

Minimal Integration Checklist

In your application configuration:

  1. Change the AI provider base URL to GreyFox:

    If GreyFox runs on another server, use that host instead:

    http://greyfox.internal:8080/v1
    
  2. Keep using the OpenAI-compatible chat completions path:

    Full URL:

    http://localhost:8080/v1/chat/completions
    
  3. Add the end-user identifier header to every AI request:

    This should be your application's own user id, tenant user id, account id, or another stable identifier that lets GreyFox enforce limits per real end user.

  4. Configure Provider Settings in the GreyFox Admin UI:

    • use Mock mode for first validation;
    • switch to OpenAI-compatible provider when you are ready to forward real traffic;
    • enter your provider API key in the Admin UI.
  5. Send a test request and verify it appears in Dashboard and Traffic.

Common Deployment Shapes

Same machine demo

Use this for local evaluation:

App or curl -> http://localhost:8080/v1/chat/completions -> GreyFox -> Provider

Same Docker host

If your application also runs in Docker Compose, put both services on the same Compose network and call GreyFox by service name:

http://greyfox:3000/v1/chat/completions

Inside Docker, use the container port 3000. From the host machine, use the published port, usually 8080.

Internal server

For a team environment, run GreyFox on an internal host and point your application to it:

http://greyfox.internal:8080/v1/chat/completions

Keep the Admin UI and proxy endpoint reachable only inside your trusted network unless you intentionally place your own authentication, VPN, or gateway in front of it.

Client Configuration Examples

Most OpenAI-compatible SDKs let you override the base URL.

Conceptually, change this:

baseURL = "https://api.openai.com/v1"

to this:

baseURL = "http://localhost:8080/v1"

Then include:

The exact SDK option name depends on your application stack. Look for settings such as baseURL, baseUrl, apiBase, base_url, or OPENAI_BASE_URL.

Port Configuration

GreyFox uses one stable internal container port:

The host port is controlled by Docker port mapping. To run GreyFox on another host port:

GREYFOX_HTTP_PORT=9090 docker compose up -d

Then open:

Provider Settings

Open the Admin UI and go to Provider Settings.

Use:

  • Mock mode for zero-cost local demos and onboarding
  • OpenAI-compatible provider for live traffic forwarding

GreyFox expects an OpenAI-compatible upstream API in live provider mode. Other compatible providers such as OpenRouter, Groq, Together, DeepSeek, Mistral, Ollama, or LocalAI may connect successfully, but provider billing remains the source of truth for final accounting.

GreyFox stores provider settings locally in the container database volume. Saved provider keys are not shown again in full inside the UI.

Mock Demo Request

After enabling Mock mode in the Admin UI, send a test request:

curl http://localhost:8080/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "X-App-User-Id: demo-user-1" \
  -d "{\"model\":\"gpt-4o-mini\",\"messages\":[{\"role\":\"user\",\"content\":\"Reply with GreyFox OK\"}]}"

Refresh the Admin UI to see the request in Traffic and Dashboard.

Updating GreyFox

GreyFox does not auto-update.

To check releases manually, use About -> Check for updates in the Admin UI or visit the public release page.

To update the Docker image:

docker compose pull
docker compose up -d

Your local SQLite data is stored in the greyfox-data Docker volume and is not removed by a normal image update.

Data and Privacy

GreyFox Community Edition is designed to run inside your own infrastructure.

  • Prompts, completions, logs, settings, provider keys, and metrics stay in your local deployment unless you send them elsewhere.
  • Manual update checks make one browser request to GitHub Releases.
  • GreyFox does not require a hosted GreyFox control plane.
  • Connected upstream providers still process any traffic you send to them.

Support and Feedback

Public issues and Community releases:

https://github.com/skillful-fox-studio/grey-fox-community

Direct operator inquiries:

GreyFox is currently maintained by a solo indie developer. Email replies may take up to 3 days.

License

GreyFox Community Edition is proprietary commercial software made available as a free-to-use Community Edition. It is not open-source software.

See LICENSE.md and THIRD_PARTY_NOTICES.md.