惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

N
Netflix TechBlog - Medium
罗磊的独立博客
云风的 BLOG
云风的 BLOG
Last Week in AI
Last Week in AI
Y
Y Combinator Blog
小众软件
小众软件
Blog — PlanetScale
Blog — PlanetScale
T
The Blog of Author Tim Ferriss
freeCodeCamp Programming Tutorials: Python, JavaScript, Git & More
月光博客
月光博客
博客园 - Franky
F
Fortinet All Blogs
D
Docker
博客园 - 司徒正美
腾讯CDC
Recent Announcements
Recent Announcements
The Cloudflare Blog
B
Blog RSS Feed
GbyAI
GbyAI
T
Tailwind CSS Blog
雷峰网
雷峰网
Cyber Security Advisories - MS-ISAC
Cyber Security Advisories - MS-ISAC
博客园 - 三生石上(FineUI控件)
阮一峰的网络日志
阮一峰的网络日志

Hacker News - Newest: "LLM"

GitHub - lechmazur/position_bias: A benchmark for testing whether LLM judges keep the same preference when two lightly edited versions of the same story are shown in opposite orders. Flex routing (EU and EFTA) Dark Factories: Retooling for LLM Velocity Ask HN: What would be the impact of a LLM output injection attack? GitHub - Oaklight/llm-rosetta: Production-ready LLM API translation layer for Python — bidirectional conversion between OpenAI, Anthropic & Google formats via hub-and-spoke IR. Optional API gateway. Streaming & non-streaming. Zero core deps. Contributions welcome! GitHub - browser-use/browser-harness: Self-healing browser harness that enables LLMs to complete any task. GitHub - moeen-mahmud/remen: Remen turns thoughts into something you can return to Analyzing 156 LLM Launch Posts on Hacker News ChatGPT vs Gemini vs Claude: The Best LLM Subscription You Should Buy GitHub - salaamalykum/quran-semantic-search: High-density RAG Semantic Search Engine & Quran Corpus (GEO/SEO Architecture) GitHub - NVIDIA/TensorRT-LLM: TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way. The State of LLM Bug Bounties in 2026 Operational Readiness Criteria for Tool-Using LLM Agents Meshcore: Architecture for a Decentralized P2P LLM Inference Network How an LLM becomes more coherent as we train it GitHub - seetrex-ai/laimark GitHub - Jossifresben/BibCrit: AI-assited biblical textual criticism GitHub - wastedcode/memex: File system based wiki, maintained by Claude 99helpers.com GitHub - cliver-project/AITrigram GitHub - unbody-io/adapt: A self-evolving memory layer for AI agents. GitHub - hb20007/awesome-gen-ai-fails: A list of incidents where reliance on generative AI and LLMs resulted in harm to companies, individuals, or society GitHub - nevenkordic/localmind: Run any local LLM with persistent memory and context. CLI agent over Ollama with SQLite-backed hybrid recall. No cloud. Ask HN: What are the machine requirements for a LLM like Llama-3.1-8B? Faster LLM Inference via Sequential Monte Carlo grpo explained: group relative policy optimization for llm finetuning - cgft Stop comparing price per million tokens: the hidden LLM API costs · TensorZero Andrej Karpathy's LLM Wiki Is a Bad Idea GitHub - GG-QandV/mnemostroma: Offline RAM-first cognitive leer/coprocessor for AI agents and robotics. Solves "Context Abandonment" with 20-80ms latency using a dual-thread biomimetic memory architecture (ONNX + SQLite WAL). mempalace/agent at agent · skorotkiewicz/mempalace
GitHub - redcaller/voice-goat: A purposely vulnerable voi...
xmhatx · 2026-04-28 · via Hacker News - Newest: "LLM"

VoiceGoat

A purposely vulnerable voice agent application for security practitioners to practice exploiting voice-based AI systems.

OWASP LLM Top 10 License: MIT

Disclaimer

This application is intentionally vulnerable. It is designed for educational and security training purposes only. Do NOT deploy this in production or expose it to the public internet without proper safeguards. See Public Hosting Security Assessment for details.

Overview

VoiceGoat is a modular vulnerable voice agent platform that covers the OWASP Top 10 for LLM Applications. Security practitioners can use this platform to:

  • Learn about LLM vulnerabilities in a safe environment
  • Practice red team techniques against voice agents
  • Understand real-world attack vectors
  • Capture flags (CTF-style) for successful exploits

Vulnerability Coverage

Service OWASP Category Vulnerabilities
VoiceBank LLM01: Prompt Injection Direct, Indirect, Payload Splitting, Obfuscated
VoiceAdmin LLM06: Excessive Agency Excessive Functionality, Permissions, Autonomy
VoiceRAG LLM08: Vector/Embedding Cross-tenant leakage, RAG Poisoning, Access Bypass

Prerequisites

  • Docker & Docker Compose v2.0+ (required)
  • Python 3.11+ (optional, for local service development without Docker)
  • Node.js 20+ (optional, for dashboard development without Docker)
  • OpenAI API key (optional, only needed when using LLM_PROVIDER=openai)

Quick Start

# 1. Clone the repository
git clone https://github.com/redcaller/voice-goat.git
cd voice-goat

# 2. Create your environment file
cp .env.example .env
# Edit .env if you want to use a real LLM provider (default is mock)

# 3. Start all services
docker compose up -d

# 4. Verify services are healthy
curl http://localhost:8001/health   # VoiceBank
curl http://localhost:8002/health   # VoiceAdmin
curl http://localhost:8003/health   # VoiceRAG

# 5. Open the dashboard
open http://localhost:8000          # Via Nginx gateway (recommended)
# or  http://localhost:4000          # Direct to Next.js

Tip: The default LLM_PROVIDER=mock requires no API keys and is completely free. Switch to openai for realistic LLM behavior when you're ready.

Port Reference

Port Service Description
8000 Nginx Gateway Unified entry point (dashboard + API routes)
8001 VoiceBank LLM01 challenges
8002 VoiceAdmin LLM06 challenges
8003 VoiceRAG LLM08 challenges
8004 Voice Gateway Twilio voice integration
4000 Dashboard Next.js CTF interface (direct)
4001 Grafana Monitoring dashboards
5432 Postgres Database
6379 Redis Cache
9200 OpenSearch Vector DB
5601 OpenSearch Dashboards OpenSearch UI
4566 LocalStack AWS service mocks

Architecture

┌─────────────────────────────────────────────────────────────┐
│                      Docker Network                         │
├─────────────────────────────────────────────────────────────┤
│  ┌─────────────┐  ┌─────────────┐  ┌─────────────┐         │
│  │ VoiceBank   │  │ VoiceAdmin  │  │ VoiceRAG    │         │
│  │ (LLM01)     │  │ (LLM06)     │  │ (LLM08)     │         │
│  └──────┬──────┘  └──────┬──────┘  └──────┬──────┘         │
│         └────────────────┼─────────────────┘               │
│                   ┌──────┴──────┐                           │
│                   │   Shared    │                           │
│                   │   Library   │                           │
│                   └──────┬──────┘                           │
│              ┌───────────┼───────────┐                      │
│         ┌────┴────┐ ┌────┴────┐ ┌───┴─────┐               │
│         │LLM (Mock│ │LocalStack│ │  Redis  │               │
│         │/OpenAI/ │ │(DynamoDB │ │         │               │
│         │Bedrock) │ │ S3, SM)  │ │         │               │
│         └─────────┘ └─────────┘ └─────────┘               │
└─────────────────────────────────────────────────────────────┘

See Architecture Deep Dive for full details including data flows, network topology, and Terraform deployment.

Project Structure

voice-goat/
├── services/               # Python FastAPI services
│   ├── common/             # Shared config, LLM, flags, logging
│   ├── voicebank/          # LLM01: Prompt Injection
│   ├── voiceadmin/         # LLM06: Excessive Agency
│   ├── voicerag/           # LLM08: Vector Weaknesses
│   └── voice_gateway/      # Twilio voice integration
├── dashboard/              # Next.js CTF scoreboard & chat UI
├── docker/                 # Nginx, Postgres init, LocalStack init
├── terraform/              # AWS infrastructure as code
├── docs/                   # Documentation & challenge walkthroughs
├── docker-compose.yml      # Local development stack
├── pyproject.toml          # Python dependencies & tool config
└── .env.example            # Environment variable template

Gamification

Each vulnerability has an associated flag:

FLAG{CATEGORY_TYPE_ID}
Example: FLAG{LLM01_DIRECT_001}

Difficulty Levels

  • Easy: Obvious vulnerabilities, minimal obfuscation
  • Medium: Requires understanding of the vulnerability
  • Hard: Needs chaining, custom payloads, or deep knowledge

LLM Providers

VoiceGoat supports multiple LLM backends:

Provider Description Cost
mock Simulated responses (default) Free
openai OpenAI API (GPT-4o, GPT-4o-mini) Pay-per-use
bedrock AWS Bedrock (Claude, Titan) Pay-per-use

Configure via .env:

# Mock mode (default) -- free, no API keys needed
LLM_PROVIDER=mock

# OpenAI -- real LLM responses
LLM_PROVIDER=openai
OPENAI_API_KEY=sk-your-key-here
OPENAI_MODEL=gpt-4o-mini

# AWS Bedrock -- requires AWS credentials
LLM_PROVIDER=bedrock

You can also point OPENAI_BASE_URL at an Ollama instance or any OpenAI-compatible API for free local inference. See Model Considerations.

Voice Integration (Twilio)

VoiceGoat supports real phone calls via Twilio Media Streams.

# 1. Set OpenAI provider (required for speech processing)
export LLM_PROVIDER=openai
export OPENAI_API_KEY=sk-your-key
docker compose up -d

# 2. Expose voice gateway with ngrok
ngrok http 8004

# 3. Configure Twilio webhook to your ngrok URL
# 4. Call your Twilio number!

See Twilio Setup Guide for detailed instructions.

Speech Modes

Mode Description Use Case
text Text-only simulation (default) Local development, free
speech Full speech integration Realistic testing with Twilio
both Hybrid mode Best of both worlds

Set via environment variable: SPEECH_MODE=text

Troubleshooting

Services fail to start / connection refused
# Check service logs
docker compose logs voicebank

# Rebuild and restart
docker compose down
docker compose up -d --build
Postgres init fails

If you've previously run VoiceGoat and the Postgres data volume already exists, the init script won't re-run. Reset with:

docker compose down -v   # removes volumes
docker compose up -d
"OPENAI_API_KEY not set" errors

Make sure your .env file has LLM_PROVIDER=mock (the default) if you don't have an OpenAI key. Mock mode requires no API keys.

Dashboard shows "Error connecting"

The dashboard talks directly to service ports (8001-8003). Ensure those containers are running:

docker compose ps

Services may take 10-20 seconds to become healthy after starting.

Port conflicts

If ports 8000-8004, 4000-4001, 5432, 6379, or 9200 are already in use, stop the conflicting process or edit docker-compose.yml to remap ports.

Apple Silicon / ARM issues

All images used are multi-arch or have ARM variants. If you encounter issues, try docker compose build --no-cache.

Documentation

Security Considerations

  • Deploy only in isolated environments (local Docker or private VPCs)
  • Use VPN access for AWS deployments
  • Do not use real data or production credentials
  • Monitor for unintended exposure
  • See Public Hosting Security Assessment

References

License

MIT License - See LICENSE for details.