ๆƒฏๆ€ง่šๅˆ ้ซ˜ๆ•ˆ่ฟฝ่ธชๅ’Œ้˜…่ฏปไฝ ๆ„Ÿๅ…ด่ถฃ็š„ๅšๅฎขใ€ๆ–ฐ้—ปใ€็ง‘ๆŠ€่ต„่ฎฏ
้˜…่ฏปๅŽŸๆ–‡ ๅœจๆƒฏๆ€ง่šๅˆไธญๆ‰“ๅผ€

ๆŽจ่่ฎข้˜…ๆบ

P
Palo Alto Networks Blog
A
Arctic Wolf
T
Tor Project blog
V2EX - ๆŠ€ๆœฏ
V2EX - ๆŠ€ๆœฏ
T
Troy Hunt's Blog
cs.CL updates on arXiv.org
cs.CL updates on arXiv.org
C
CXSECURITY Database RSS Feed - CXSecurity.com
Scott Helme
Scott Helme
Cyberwarzone
Cyberwarzone
NISL@THU
NISL@THU
C
Cyber Attacks, Cyber Crime and Cyber Security
Project Zero
Project Zero
Know Your Adversary
Know Your Adversary
Attack and Defense Labs
Attack and Defense Labs
WordPressๅคงๅญฆ
WordPressๅคงๅญฆ
Recorded Future
Recorded Future
C
Cybersecurity and Infrastructure Security Agency CISA
Recent Commits to openclaw:main
Recent Commits to openclaw:main
ๅฐไผ—่ฝฏไปถ
ๅฐไผ—่ฝฏไปถ
T
Threatpost
Threat Intelligence Blog | Flashpoint
Threat Intelligence Blog | Flashpoint
Hugging Face - Blog
Hugging Face - Blog
ๅš
ๅšๅฎขๅ›ญ - ่‚ๅพฎไธœ
S
SegmentFault ๆœ€ๆ–ฐ็š„้—ฎ้ข˜
C
CERT Recently Published Vulnerability Notes
Google Online Security Blog
Google Online Security Blog
L
Lohrmann on Cybersecurity
V
Vulnerabilities โ€“ Threatpost
Spread Privacy
Spread Privacy
็ˆฑ่Œƒๅ„ฟ
็ˆฑ่Œƒๅ„ฟ
V
V2EX
่…พ
่…พ่ฎฏCDC
T
The Exploit Database - CXSecurity.com
Apple Machine Learning Research
Apple Machine Learning Research
The Cloudflare Blog
็ฝ—
็ฝ—็ฃŠ็š„็‹ฌ็ซ‹ๅšๅฎข
ๆœˆๅ…‰ๅšๅฎข
ๆœˆๅ…‰ๅšๅฎข
ๅš
ๅšๅฎขๅ›ญ - ๅธๅพ’ๆญฃ็พŽ
้˜ฎไธ€ๅณฐ็š„็ฝ‘็ปœๆ—ฅๅฟ—
้˜ฎไธ€ๅณฐ็š„็ฝ‘็ปœๆ—ฅๅฟ—
T
Tailwind CSS Blog
ไบ‘้ฃŽ็š„ BLOG
ไบ‘้ฃŽ็š„ BLOG
Vercel News
Vercel News
T
Threat Research - Cisco Blogs
MongoDB | Blog
MongoDB | Blog
M
MIT News - Artificial intelligence
Cyber Security Advisories - MS-ISAC
Cyber Security Advisories - MS-ISAC
T
Tenable Blog
Simon Willison's Weblog
Simon Willison's Weblog
G
GRAHAM CLULEY
็พŽ
็พŽๅ›ขๆŠ€ๆœฏๅ›ข้˜Ÿ

Hacker News - Newest: "AI"

AI can't read an investor deck AI as an attorney? Student uses ChatGPT, Gemini to sue UW over alleged racial discrimination Hacking MCP Servers in AI Systems โ€“ The Rug Pull: Tool Changes After Approval GitHub - MeepCastana/KubeezCut: Free Web based video editor GitHub - GenAI-Gurus/awesome-eu-ai-act: Curated tools, official sources, OSS, templates, and guides for EU AI Act compliance. Can AI judge journalism? A Thiel-backed startup says yes, even if it risks chilling whistleblowers Coming soon: 10 Things That Matter in AI Right Now DARPA built an AI to fact-check enemy weapons claims What explains heterogeneity in AI adoption? When AI Meets Muscle: Context-Aware Electrical Stimulation Promises a New Way to Guide Human Movements - Department of Computer Science AI Changed How We Build. It Did Not Change What Matters. Linux rules on using AI-generated code - Copilot is OK, but humans must take 'full responsibility for theโ€ฆ Meta spins up AI version of Mark Zuckerberg to engage with employees Code Mode: Let Your AI Write Programs, Not Just Call Tools | TanStack Blog GitHub - Delavalom/graft: Go framework for building AI agents. Type-safe tools, multi-provider (OpenAI, Anthropic, Gemini, Bedrock), zero vendor SDKs. India's TCS tops estimates, says new AI models did not dent services demand Gen Z's fading AI hype Strong feeling: we are in a folded AI reality GitHub - machinarii/total-recall-catalog: A reference catalog of latest knowledge retrieval, memory & RAG systems GitHub - mensfeld/code-on-incus: Give each AI agent its own isolated machine with root, Docker, and systemd. Active defense detects and stops threats automatically.. Quantization, LoRA, and the 8% Problem: Benchmarking Local LLMs for Production AI Iran war: We spoke to the man making Lego-style AI videos that experts say are powerful propaganda Powell, Bessent discussed Anthropic's Mythos AI cyber threat with major U.S. banks GitHub - immartian/bellamem: Persistent belief-graph memory for AI agents. Retrieves decisive context by importance โ€” not recency, not RAG, not /compact. recursive-mode: The Repo-Native Operating System for AI Engineering After the attack on Sam Altman's home, will AI CEO's go on the offensive? The biggest advance in AI since the LLM Opus 4.6 vs GPT 5.4 One Prompt Unity World Generation Test โ€œAI pollsโ€ are fake polls Client Challenge Can AI be a 'child of God'? Inside Anthropic's meeting with Christian leaders How to Switch AI Chatbots and Why You Might Want To GitHub - MattMessinger1/agentic_refund_guardrail: Safe refund policy layer for AI agents โ€” Python + TypeScript. Same behavior, shared tests. Adam/papers/emergent_values_whitepaper.md at master ยท strangeadvancedmarketing/Adam Ask HN: How do you stop playing 20 questions with your AI coding tools How far can automation and AI support psychotherapy? - @theU GitHub - stagas/rtdiff: realtime git diff gui and AI-assisted commits A Mac Studio for Local AI โ€” 6 Months Later A History of the Early Years of AI at the University of Edinburgh Why AI Coding Tools Still Feel Stuck on Localhost MSN AI Datacenters Are Becoming Strategic Targets twitter.com Penn Researchers Use AI to Surface Unreported GLP-1 Side Effects in Reddit Posts Show HN: MoodSense AI (ML and FastAPI and Gradio, Deployed on Hugging Face) Moodsense Ai - a Hugging Face Space by aman179102 AI models are terrible at betting on soccerโ€”especially xAI Grok GitHub - xialeistudio/echoic GitHub - HimashaHerath/github-dev-wrapped: AI-powered weekly GitHub activity reports deployed to GitHub Pages GitHub - alejandrobalderas/claude-code-from-source: Architecture, patterns & internals of Anthropic's AI coding agent โ€” reverse-engineered from source maps AI and Tech brief: Ireland ascendant GitHub - Titovilal/context0: Context0 - Never Surrender Training for a Marathon with an AI Coach: What Worked and What Didn't Cyber Pulse: Agentic Intel - Apps on Google Play I Built an AI PR Reviewer That Catches Bugs by Not Looking for Bugs Gen Z workers are so fearful AI will take their job theyโ€™re intentionally sabotaging their companyโ€™s AI rollout | Fortune How AI Is Reimagining the Game of Golfโ€“For Both Players and Courses GitHub - nattergabriel/reseed: A CLI tool for managing and distributing agent skills across projects Is SVG the final frontier? My AI workflow evolved from prompts to a near-autonomous workflow MLSharp Help - 3DGS Viewer & Generator I put my cognitive field based AI's runtime on GitHub Is Numble the first AI-proof game? A3: Kubernetes for autonomous AI agent fleets | Emergent Principles Deepali Vyas ("The Elite Recruiter") GitHub - msmarkgu/RelayFreeLLM: A restful API designed to route user prompts to various AI model providers. Unionized ProPublica staff are on strike over AI, layoffs, and wages Unleashing the Advantage of Quantum AI We're heading for an AI-fueled 'dementia crisis,' brain scientist warns The AI-Assisted Breach of Mexico's Government Infrastructure [pdf] GitHub - stef41/lmscan: ๐Ÿ” Detect AI-generated text and fingerprint which LLM wrote it. Open-source GPTZero alternative. Zero dependencies, works offline. MSN GitHub - visionscaper/collabmem: Enabling long-term collaboration with Agentic AI - building up episodic and world model memory over time with in-context awareness We gave an AI a 3 year retail lease in SF and asked it to make a profit | Andon Labs AI Code is Hollowing Out Open Source, and Maintainers are Looking the Other Way What leaked "SteamGPT" files could mean for the PC gaming platform's use of AI AI is the boss at this retail store. What could go wrong? GitHub - Wuzu11517/agentic-proxy: Local proxy meant to help reduce With Drones, Geophysics and ArtificiaI Intelligence, Researchers Prepare to Do Battle Against Land Mines A Single Operator, Two AI Platforms, Nine Government Agencies: The Full Technical Report ๅœจ Steam ไธŠ่ดญไนฐ FriedrichAI: Offline AI ็ซ‹็œ 10% GitHub - inevolin/resume-cli: Hit Claude usage limits? Resume any AI coding session elsewhere. Switch tools at zero friction. GitHub - atripati/ark: AI Runtime Kernel โ€” a context operating system for AI agents. Eliminates tool bloat, loads only whatโ€™s needed, and gives LLMs their reasoning space back. How to Build a Secure AI PR Reviewer with Claude, GitHub Actions, and JavaScript This Startup Wants You to Pay Up to Talk With AI Versions of Human Experts Intel Arc Pro B70 Brings 32GB VRAM to Local AI for $949 WordPress 7.0: The Good, the AI, and the Still Missing AI on the couch: Anthropic gives Claude 20 hours of psychiatry IatroBench: Pre-Registered Evidence of Iatrogenic Harm from AI Safety Measures AI Agents Know About Supabase. They Don't Always Use It Right. The history and future of AI at Google, with Sundar Pichai Inside an AIโ€‘enabled device code phishing campaign How Meta Used AI to Map Tribal Knowledge in Large-Scale Data Pipelines AI for Systems: Using LLMs to Optimize Database Query Execution Forecasting the Economic Effects of AI Introducing Tinker: Play with AI, bring your ideas to life AI sheds light on an ancient gaming mystery People really hate AI but not as much as Iranโ€”or Democrats | Fortune What is an AI Product Engineer? Phoebe Gates wants her $185 million AI startup to succeed with 'no ties to my privilege or my last name': 'I have a chip on my shoulder' | Fortune
GitHub - mahimairaja/voiceai: Set of ๐Ÿ“ with ๐Ÿ”— to help those building Voice AI agents ๐ŸŽ™๏ธ๐Ÿค–
mahimai ยท 2026-05-03 ยท via Hacker News - Newest: "AI"

Banner Image

A curated, developer friendly learning path for building real-time voice AI agents from your first STT call to scaling production telephony.

Voice AI has moved from research demos into shipping product in under three years. The modern stack is converging around a clear pattern: a real-time transport layer (WebRTC or telephony), a streaming pipeline of speech-to-text โ†’ LLM โ†’ text-to-speech, and a turn-taking model that decides when the agent should speak. This list is structured to mirror that learning order start with the foundations, pick a framework, then drill into individual components and production concerns.

Resources are tagged ๐ŸŸข Beginner, ๐ŸŸก Intermediate, or ๐Ÿ”ด Advanced. Prefer free official docs and vendor-neutral guides; flag where authors have commercial interests.


How to use this list

Read top-to-bottom if you're brand new. The recommended path:

  1. Foundations โ†’ understand the pipeline and latency budget
  2. Frameworks โ†’ pick one (LiveKit Agents or Pipecat are the safest open-source bets) and ship a hello-world
  3. Components (STT, TTS, LLM, VAD, turn detection) โ†’ swap pieces to learn what each layer does
  4. Transport & telephony โ†’ connect to a real phone number
  5. Evaluation, production, ethics โ†’ make it safe enough to ship

Table of contents

  1. Foundational concepts and learning paths
  2. Frameworks and orchestration platforms
  3. Speech-to-text (STT / ASR)
  4. Text-to-speech (TTS)
  5. LLMs for voice and real-time AI
  6. Voice activity detection and turn-taking
  7. WebRTC fundamentals
  8. Telephony and SIP
  9. Tutorials and hands-on projects
  10. GitHub starter repos and awesome lists
  11. Datasets and benchmarks
  12. Beginner-accessible research papers
  13. Evaluation and testing
  14. Production, deployment, and scaling
  15. Ethics, safety, and regulation
  16. Blogs and newsletters
  17. Podcasts
  18. Communities
  19. Conferences and events
  20. Hackathons and competitions

1. Foundational concepts and learning paths

Start here. These resources establish the mental model of the voice agent pipeline and the latency budget you'll fight for the rest of your career.

2. Frameworks and orchestration platforms

The frameworks below all let you wire STT, an LLM, and TTS together. For open-source production work, LiveKit Agents and Pipecat are the two safest bets; for managed dashboards, Vapi, Retell, and Bland win on time-to-first-call.

Open-source frameworks

  • LiveKit Agents Voice AI Quickstart Working assistant in <10 min via Python or TypeScript, runs on top of WebRTC. ๐ŸŸข Beginner
  • Pipecat Quickstart Scaffolds a Deepgram + OpenAI + Cartesia pipeline you can talk to in the browser in 5 minutes. ๐ŸŸข Beginner
  • Ultravox (fixie-ai/ultravox) Open-weight multimodal speech LLM (Llama/Gemma/Qwen variants) that skips the separate ASR stage for ~150 ms TTFT. ๐Ÿ”ด Advanced

Managed platforms

Realtime / speech-to-speech APIs

Vendor-neutral comparisons

3. Speech-to-text (STT / ASR)

Pick one streaming STT and learn it deeply before shopping around. Deepgram, AssemblyAI, and Whisper-derivatives cover most use cases.

Commercial APIs

Open source

  • openai/whisper The original repo and the de facto starting point for any DIY ASR project. ๐ŸŸข Beginner
  • SYSTRAN/faster-whisper CTranslate2 reimplementation up to 4ร— faster with INT8; recommended for self-hosted Whisper. ๐ŸŸก Intermediate
  • NVIDIA NeMo (Parakeet / Canary) Top-of-leaderboard open ASR models with streaming inference recipes. ๐Ÿ”ด Advanced
  • Moonshine Tiny on-device ASR (~190 MB) optimized for live streaming on edge devices. ๐ŸŸก Intermediate

Benchmarks and explainers

4. Text-to-speech (TTS)

Latency, not raw quality, is what kills voice agents prioritize providers offering true streaming with first-byte under 200 ms.

Commercial APIs

Open source

  • Coqui TTS (idiap fork) Maintained fork of Coqui-TTS / XTTS v2; the most battle-tested OSS TTS toolkit. ๐ŸŸก Intermediate
  • Piper (OHF-Voice/piper1-gpl) Fast local neural TTS optimized for Raspberry Pi; perfect for offline projects. ๐ŸŸข Beginner
  • Kokoro 82M Tiny Apache-licensed model that tops community ELO arenas; runs on CPU. ๐ŸŸข Beginner
  • F5-TTS Diffusion-transformer TTS with high-quality zero-shot voice cloning. ๐ŸŸก Intermediate
  • Orpheus-TTS Llama-3B-based emotive TTS with ~200 ms streaming and emotion tags. ๐ŸŸก Intermediate
  • Sesame CSM Conversational, context-aware multi-speaker TTS using a Llama backbone with the Mimi codec. ๐Ÿ”ด Advanced

Streaming and ethics

5. LLMs for voice and real-time AI

A voice agent's perceived intelligence is bounded by how fast the LLM streams its first token. Sub-300 ms TTFT changes the conversation feel entirely.

Low-latency inference

  • Groq LPU-based inference cloud delivering ~10ร— faster Llama tokens/sec than commodity GPUs. ๐ŸŸข Beginner
  • Cerebras Inference Wafer-scale chip inference with very high throughput on Llama models. ๐ŸŸข Beginner
  • SambaNova Cloud Reconfigurable Dataflow inference; stable throughput at low latency. ๐ŸŸข Beginner

Speech-to-speech models

  • OpenAI Realtime API guide Flagship S2S product with WebRTC/WebSocket transport. ๐ŸŸก Intermediate
  • Google Gemini Live Real-time multimodal voice/video with barge-in and 70-language support. ๐ŸŸก Intermediate
  • Moshi (kyutai-labs) Open-source full-duplex speech-text foundation model with 200 ms latency the premier OSS S2S model to study. ๐Ÿ”ด Advanced

Voice-specific prompting and tools

6. Voice activity detection and turn-taking

Pure VAD is no longer enough modern agents combine acoustic VAD with a small semantic model that predicts end-of-utterance from words and prosody.

7. WebRTC fundamentals

WebRTC is the default transport for voice agents that don't run over the phone network. Understanding ICE, STUN, TURN, and SFU architecture is non-negotiable for production work.

8. Telephony and SIP

The phone network has its own physics. Once you know which SIP trunk provider to point at LiveKit or Pipecat, you can ship.

9. Tutorials and hands-on projects

Pick one tutorial and finish it before starting another. Voice AI is unforgiving of half-built pipelines.

10. GitHub starter repos and awesome lists

Clone these instead of writing boilerplate from scratch.

11. Datasets and benchmarks

You'll rarely train from scratch, but knowing which dataset a model was trained on explains its accents, languages, and failure modes.

  • LibriSpeech ASR Corpus ~1,000 hours of English audiobooks; nearly every ASR paper benchmarks against it. ๐ŸŸข Beginner
  • Mozilla Common Voice Crowdsourced multilingual dataset (100+ languages); the easiest legal way to fine-tune ASR. ๐ŸŸข Beginner
  • Common Voice on HuggingFace One-line load_dataset() access for hands-on experiments. ๐ŸŸข Beginner
  • Open ASR Leaderboard Live comparison of 60+ ASR models on WER and real-time factor. ๐ŸŸข Beginner
  • Artificial Analysis Speech Independent benchmarks of commercial STT and TTS providers. ๐ŸŸข Beginner
  • LJSpeech Dataset ~24 hours of single-speaker English audio; baseline corpus for Tacotron 2 and VITS. ๐ŸŸข Beginner
  • VCTK Corpus ~110 English speakers with diverse accents; widely used for multi-speaker TTS. ๐ŸŸก Intermediate
  • VoxCeleb (Oxford VGG) Million-utterance "in the wild" dataset for speaker identification and verification. ๐ŸŸก Intermediate

12. Beginner-accessible research papers

These are the landmark papers behind the models you'll actually use. Read the Whisper and Common Voice papers first they're unusually approachable.

13. Evaluation and testing

You can't ship what you can't measure. Voice-agent evaluation is fundamentally probabilistic a single transcript can pass and fail across runs, so simulation and statistics matter more than fixed test cases.

14. Production, deployment, and scaling

Real production voice infrastructure is the hardest unsolved problem in this space. Read these before quoting anyone a per-minute price.

15. Ethics, safety, and regulation

If you're shipping a voice agent in 2026, disclosure and consent are no longer optional. The FCC and EU AI Act both have teeth.

16. Blogs and newsletters

Subscribe to two or three to stay current the field moves quickly.

17. Podcasts

18. Communities

19. Conferences and events

  • AI Engineer World's Fair Biggest AI-engineering conference; the Voice track has hosted major launches from ElevenLabs, Vapi, LiveKit, Pipecat, and Cartesia. ๐ŸŸข Beginner
  • AI Engineer YouTube channel All World's Fair and Summit talks are posted free; the best library of recent voice-AI talks. ๐ŸŸข Beginner
  • AI Engineer Summit Online Voice playlist Curated playlist including voice-track sessions from leading labs. ๐ŸŸข Beginner
  • AIEWF 2025 Recap (Latent Space) Written deep-dive into 2025's voice-track talks and major launches. ๐ŸŸข Beginner
  • VOICE & AI (Modev) Long-running voice technology conference with broader CX and voicebot focus. ๐ŸŸข Beginner
  • Project Voice Main U.S. event for conversational AI across voice, text, and chat. ๐ŸŸข Beginner
  • Interspeech Top academic speech-science conference; intimidating but worth knowing most landmark papers debut here. ๐Ÿ”ด Advanced

20. Hackathons and competitions

  • ElevenLabs Worldwide Hackathon Flagship global hackathon for conversational agents; 30+ cities and a $200K+ prize pool. ๐ŸŸข Beginner
  • ElevenHacks (weekly sprints) Weekly themed challenges with credits and prizes; low-pressure way to ship one project per week. ๐ŸŸข Beginner
  • AI Engineer World's Fair Hackathon Co-located with the conference; $10K prizes judged by 3,000+ AI engineers, with a strong voice track. ๐ŸŸก Intermediate
  • lablab.ai AI Hackathons Continuous calendar of short online hackathons frequently sponsored by voice-AI vendors. ๐ŸŸข Beginner
  • Devpost Voice AI Hackathons Centralized search for active voice-AI hackathons; the best way to find what's open right now. ๐ŸŸข Beginner

Suggested learning path

  1. Week 1 Foundations: Read the LiveKit pipeline post and Voice AI Illustrated Primer (sections 1, 7).
  2. Week 2 First agent: Finish the LiveKit or Pipecat quickstart end-to-end (sections 2, 9).
  3. Week 3 Components: Swap STT, TTS, and LLM providers; benchmark latency (sections 3, 4, 5).
  4. Week 4 Turn-taking & telephony: Add Silero VAD and a turn detector; connect a SIP trunk (sections 6, 8).
  5. Week 5 Production: Add evaluation, observability, and read the FCC/EU AI Act material (sections 13, 14, 15).
  6. Ongoing: Subscribe to two newsletters and join voice ai community in linkedin (sections 16, 17, 18).

Contributing

Pull requests welcome. Resources must be active in the last 12 months, accessible to developers, and vendor-neutral or clearly labeled when authored by a commercial party. Open an issue to suggest additions or removals.