惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

Cyber Security Advisories - MS-ISAC
Cyber Security Advisories - MS-ISAC
Vercel News
Vercel News
Microsoft Azure Blog
Microsoft Azure Blog
Stack Overflow Blog
Stack Overflow Blog
Martin Fowler
Martin Fowler
Hacker News - Newest:
Hacker News - Newest: "LLM"
Cyberwarzone
Cyberwarzone
Recorded Future
Recorded Future
H
Hackread – Cybersecurity News, Data Breaches, AI and More
T
Threat Research - Cisco Blogs
Know Your Adversary
Know Your Adversary
Recent Announcements
Recent Announcements
L
LINUX DO - 热门话题
D
DataBreaches.Net
K
Kaspersky official blog
T
Threatpost
F
Full Disclosure
T
The Exploit Database - CXSecurity.com
C
CERT Recently Published Vulnerability Notes
S
Securelist
I
Intezer
有赞技术团队
有赞技术团队
罗磊的独立博客
爱范儿
爱范儿
S
Schneier on Security
P
Privacy & Cybersecurity Law Blog
cs.CL updates on arXiv.org
cs.CL updates on arXiv.org
Cisco Talos Blog
Cisco Talos Blog
cs.CV updates on arXiv.org
cs.CV updates on arXiv.org
L
LangChain Blog
美团技术团队
G
Google Developers Blog
T
Tor Project blog
Project Zero
Project Zero
奇客Solidot–传递最新科技情报
奇客Solidot–传递最新科技情报
The Hacker News
The Hacker News
W
WeLiveSecurity
Engineering at Meta
Engineering at Meta
Apple Machine Learning Research
Apple Machine Learning Research
aimingoo的专栏
aimingoo的专栏
PCI Perspectives
PCI Perspectives
L
LINUX DO - 最新话题
MyScale Blog
MyScale Blog
阮一峰的网络日志
阮一峰的网络日志
酷 壳 – CoolShell
酷 壳 – CoolShell
V
V2EX
Hugging Face - Blog
Hugging Face - Blog
P
Proofpoint News Feed
Webroot Blog
Webroot Blog
T
Troy Hunt's Blog

DEV Community

Authentication Security Deep Dive: From Brute Force to Salted Hashing (With Java Examples) Why AI Systems Don’t Fail — They Drift Spilling beans for how i learn for exam😁"Reinforcement Learning Cheat Sheet" I Replaced Chrome with Safari for AI Browser Automation. Here's What Broke (and What Finally Worked) How Python Borrows Other People's Work The $40 Architecture: Processing 1 Billion API Requests with 99.99% Uptime Vibe Coding: A Workflow Guide (From Zero to SaaS) Most webhook security guides protect the wrong side. The scary part is delivery. Headless CMS for TanStack Start: Build a Blog with Cosmic EU Age Verification App "Hacked in 2 Minutes" — What Actually Happened Comfy Cloud’s delete function does not actually remove files Running AI Models on GPU Cloud Servers: A Beginner Guide Event-driven media intelligence with AWS Step Functions and Bedrock I scored 500 AI prompts across 8 quality dimensions — here's what broke How to Call Google Gemini API from Next.js (Free Tier, No Backend Needed) The Portal Protocol: Reclaiming Human Connection in the Age of AI How to Fix Your Team's Scattered Knowledge Problem With a Self-Hosted Forum Intro to tc Cloud Functors: A Graph-First Mental Model for the Modern Cloud Designing Multi-Tenant Backends With Both Ownership and Team Access I Built a Neumorphic CSS Library with 77+ Components — Here's What I Learned PostgreSQL Performance Optimization: Why Connection Pooling Is Critical at Scale Cómo construí un SaaS multi-rubro para gestionar expensas en Argentina con FastAPI + Vue 3 🚀 I Built an Ethical Hacking Scanner Tool – Open Source Project I Replaced /usage and /context in Claude Code With a Single Statusline A Pythonic Way to Handle Emails (IMAP/SMTP) with Auto-Discovery and AI-Ready Design I Collected 8.9 Million Polymarket Price Points — Here's What I Found About How Markets Really Move EcoTrack AI — Carbon Footprint Tracker & Dashboard Everyone's Using AI. No One Agrees How. 5 self-hosted ebook managers worth trying in 2026 Building Your First AI Agent with LangChain: From Chatbot to Autonomous Assistant Common SOC 2 Failures (Real World) Stop Vibe-Checking Your AI App: A Practical Guide to Evals How to Use SonarQube and SonarScanner Locally to Level Up Your Code Quality Your Next To-Do App Is Dead — I Replaced Mine with an OpenClaw AI Sign a Nostr event in 60 lines of Python using coincurve — no nostr-sdk, no nbxplorer, no rust toolchain ITGC Audit Explained Like You’re in Big 4 Patch Tuesday abril 2026: Microsoft parcha 163 vulnerabilidades y un zero-day en SharePoint Stop scraping everything: a better way to track competitor price changes Listing on MCPize + the Official MCP Registry while routing payments OUTSIDE the marketplace — how I kept 100% of my x402 revenue Building an AI-Powered Risk Intelligence System Using Serverless Architecture Why We Ripped Function Overloading Out of Our AI Toolchain Testing AI-Generated Code: How to Actually Know If It Works SaaS Churn Is Killing Your Business. Here Is What to Do About It (Without a Support Team) The Speed of AI Is No Longer Linear - And Self-Improving Models Are Why How to Implement RBAC for MCP Tools: A Practical Guide for Engineering Teams From Standard Quote to Persuasive Proposal: AI Automation for Arborists I built a CLI that scaffolds complete multi-tenant SaaS apps Axios CVE-2025–62718: The Silent SSRF Bug That Could Be Hiding in Your Node.js App Right Now The dashboard that ended our friendship Data Pipelines Explained Simply (and How to Build Them with Python) The Hidden Cost of AI Systems Nobody Talks About. undefined vs undeclared, and how typeof behaves Switching from file-based jobs to NATS/Kafka in Rust without changing code io_uring Adventures: Rust Servers That Love Syscalls Why Agentic AI is Killing the Traditional Database The POUR principles of web accessibility for developers and designers Quantum Neural Network 3D — A Deep Dive into Interactive WebGL Visualization How To Install Caveman In Codex On macOS And Windows Automation Pipeline Reliability: Why Your Workflow Breaks When Nobody Is Watching I Built an 'Open World' AI Coding Agent — It Works From ANY Folder From Freelancing to Product: A Tech Service Company's SaaS Transformation China's AI Giants: Adding Tencent Hunyuan & ByteDance Doubao to AI University (74 Providers) On the Vibe Coders and Their Lies clerk: Auto-Summarize Your Claude Code Sessions AI Weekly — 2026/04/10–04/17 | The Model Lockdown Is Here, but the Toolchain Is the Real Battleground AI 週報 — 2026/04/10–2026/04/17 模型封鎖潮來了,但工具鏈才是真戰場 Maybe this is how Open-Source apps are born... 🚀 Fine-Tune LLMs with LoRA and QLoRA: 2026 Guide tRPC v11 + Next.js App Router: End-to-End Type Safety Without the Boilerplate ShadCN UI in 2026: Why I Stopped Installing Component Libraries and Started Owning My Components SaaS Billing in React Server Components: Stripe + Supabase Without a Single `useEffect` Join our DEV Weekend Challenge — $1,000 in Prizes Across TEN winners! Submissions Due April 20 at 6:59 AM UTC. Implementing FSRS Spaced Repetition in Flutter + Supabase — Adding Memory Science to an AI Learning App "I Texted My Localhost From the Train — Claude Code Fixed the Bug Before I Got Home" I Built a Sales Prep AI and It Went Deeper Than Expected Design to Code #2: One JSON, Eleven Outputs Solving the 100M-Row Problem: A Summary Table Pattern for High-Volume Push Notification Logs Flutter Web With Wasm: What Actually Changes For Developers I Built 50 Royalty-Free Soundtracks for My Side Project in a Weekend Using AI Music Generation The Vibe Coding Security Checklist: 7 Things to Check Before You Ship Stop Letting Googlebot Guess Fix Your React App's SEO Right Desconstruindo o Streaming do LinkedIn: Como Criar um Engine de Extração de Vídeo de Alta Performance com HLS e FFmpeg (EDA Part-1) EDA (Exploratory Data Analysis) Explained With Real Life — Why Looking at Your Data Is the Most Important Step in Machine Learning Brand Relationship Management at Scale: Our 4-Touch Outreach System for 200+ Brands Why String.fromEnvironment() Might Return an Empty String in Dart JGuardrails 1.0.0 — Hardening Java LLM Apps Against Jailbreaks, Toxicity, and Prompt Injection Plan and Schedule a Full Week of Threads Content From One Claude Conversation Coding Cat Oran Ep3, Five Tables Changed Everything Updated: BFF Pattern I'm done watching freelancers get buried by 200 proposals. So I'm building the alternative. This is my first post BFS Algorithm in Java Step by Step Tutorial with Examples Tracking LLM Pricing Monthly: An Open Dataset for 22 AI Models How We Measure Content ROI on a Comparison Site: Revenue Attribution Without Perfect Data Introducing Nova AI Ops: The AI-Native Operating System for SRE Teams I built a free desktop video downloader for Windows — Grabbit How Talkie OCR Helps Vision-Impaired & Dyslexic Users Read the World Around Them VRCFaceTracking安装和iPhone面捕配置教程,有bug Even CrowdStrike Can't See Your Agents The Automation Gold Rush: What n8n Workflows and Claude Are Opening Up for Developers Right Now
Voice AI Outside the US: Double the Price, Worse Experience (And How We're Trying to Fix It)
Luke Miller · 2026-05-12 · via DEV Community

Every major voice model lab hosts in us-east or us-west. If you're building voice agents in Sydney, Mumbai, or Jakarta, your audio round-trips to Virginia and back before a single word is spoken. For real-time conversation, that's not a tradeoff. That's a dead product.

We're SLNG. We're building the global execution layer for voice agents — regional edge infrastructure combined with the leading global models for hyper-low latency, fewer tokens, and less cost. We run Deepgram, Cartesia, Speechmatics, InWorld, and AssemblyAI on sovereign compute in 11 regions.

This is the story of why that business exists, what we got wrong early, and what we've learned about the surprisingly US-centric infrastructure underneath AI.

The control plane problem nobody talks about

When we launched, we assumed we could move fast by working with inference providers. Spin up a provider's API in a target region, route traffic locally, done.

What we found was more curious, and at the time, deeply frustrating.

Every major inference provider routes through US-based control planes by default. Even when you're provisioned on international compute, your traffic may briefly traverse US infrastructure. Authentication, scheduling, logging — all routed through Virginia or Oregon before your workload touches the GPU you're actually paying for.

Which defeats the entire purpose if your compliance requirement is data sovereignty, or your latency budget is under 200ms.

They all did it. Every single one. The only provider we've seen start to move on this is Modal, which now offers control plane access in three regions. Credit where it's due.

But that discovery changed our trajectory. We couldn't outsource our way to 11 sovereign regions. We had to build the infrastructure team far earlier than any early-stage startup wants to.

The GPU supply crunch hit differently outside the US

Working with inference providers isn't just about API routing. You're outsourcing compute acquisition to their procurement teams. When we couldn't rely on that, we had to acquire GPU capacity directly.

This is the standard challenge of any early-stage startup — competing for resources against companies with bigger balance sheets and longer time horizons. Nothing unique to us. But the GPU supply crunch added a regional dimension that caught us off guard. Many regions already had constrained supply. Some became simply impossible to source from. Minimum commitments got larger, lock-in periods got longer, and prices went up in tandem.

At one point, a major hyperscaler was charging us for compute they hadn't provisioned. They didn't have the GPUs on hand. Hadn't allocated them. But still thought they had the right to invoice for it.

That part was new.

The default is US compute. Every layer.

To be clear, this isn't a post about being pro or anti-US. So much of the AI innovation driving this space comes out of the US ecosystem. But even having worked at an inference provider myself, I hadn't grasped the full depth of the problem — or more accurately, the giant chasm between "we support your region" and actually building compliant local compute that doesn't touch US infrastructure at any point in the chain.

It gets harder the more you look at it.

Real-time voice agents don't run on a single service. They draw together an orchestrator (which has servers with a geography), a runtime (which has a geography), then the STT, LLM, and TTS components — each with their own geography.

Look at any single layer in that stack. The leading providers are US voice labs, US LLM labs, or companies like LiveKit and Pipecat who are also US-based.

So every time something gets built, the default starting point is US compute. Not because anyone chose it deliberately. Because that is the origin of the entire supply chain.

Double the price, worse experience

The cost inflation isn't one thing. It's three things compounding simultaneously.

Latency tax. A voice agent round-tripping from Sydney to Virginia adds 150–300ms per turn. In a real-time conversation, that's the pause that makes humans hang up. To compensate, you over-engineer: larger buffers, more aggressive endpointing, retry logic. All of it costs compute.

Token tax. Higher latency doesn't just slow things down — it breaks conversations. VAD misfires on the added delay, triggering partial transcriptions that each hit the LLM. Users repeat themselves. Endpointing fails and retries stack up. We've measured roughly 50% more LLM token consumption on US-routed voice calls versus locally-routed ones. Same intent. Same outcome. 50% more tokens because the conversation needed more turns to get there.

Egress tax. Audio data crossing regions isn't free. Streaming bidirectional audio from APAC through US endpoints and back accumulates egress charges that don't show up on any model lab's pricing page.

Add them up: the same voice agent that costs $0.04/min on US compute easily doubles to $0.08–0.10/min when routed internationally through US infrastructure.

Local compute changes the economics fundamentally. When the audio never leaves the region, the latency tax, token tax, and egress tax disappear. The architecture is the saving.

Why the model labs haven't fixed this

This isn't incompetence. It's incentive structure.

Model labs sell API calls. Their business model is usage-based. If your architecture generates more round-trips, more tokens, more egress — that's more revenue for them. Regional distribution would cannibalise their own margin.

They also don't have compliance teams for 11 jurisdictions. They don't want to navigate Australian data residency requirements, Indian RBI regulations, or Indonesian sovereignty laws. That's expensive, slow, and distracts from model development.

There's a deeper structural issue too. Most model labs are US-based, operating in a relatively narrow window of languages and a massive abundance of compute. Their models are optimised for that environment. When you move outside it — into Hindi, Bahasa, Tamil, Arabic — you're running models that weren't built for your language, on hardware that's harder to source, in regions where the compliance requirements are stricter. Everything compounds.

So the gap persists. Not because it's technically impossible, but because nobody with the models has the incentive to close it.

What we've learned (and what surprised us)

The partnerships are sometimes harder than the infrastructure. Getting the leading voice model labs to let you run their models on your own compute, in your own regions, under your own compliance frameworks — that takes trust, not just engineering. Every lab has different terms, different technical requirements, different views on what running their models outside their cloud means. Building those relationships took longer than we expected.

Compliance varies wildly — and it's not just data residency. Regional data sovereignty requirements are table stakes. The harder layer is industry-specific compliance. The companies that care most about where their voice data is processed are in healthcare and financial services — and those industries have their own local regulatory regimes on top of regional data laws. Indian financial services voice data has RBI requirements. Australian healthcare has its own privacy framework. We had to scope routing, storage, and compute independently per region, then layer industry compliance on top of each one.

Hardware variance is real. The same model doesn't perform identically across GPU types and configurations. We benchmark every model on every hardware profile in every region — and what's available in each region continuously shifts. We generally have more flexibility on the STT side because the unit economics of smaller GPUs align well with STT models, which are generally compact. TTS is a different problem. The models require larger GPUs as a baseline, and the provider licensing fees are higher, so the unit economics of STT and TTS are fundamentally different across regions. That tuning work is invisible to customers but critical. It's also where our margin often sits.

Where the constraints led us

These constraints are also where we've found our deepest innovation. Having to solve for all of them simultaneously — not in a single well-resourced US region, but across 11 — has forced us to build something more powerful than what you'd design if you started with abundant compute in Virginia.

Sovereign infrastructure across India, Australia, EU, UK, US, and Indonesia as primary hubs. Compliant compute, routing, and data storage scoped to each jurisdiction. Every major voice model available locally. A single API to access all voice models, where you can switch at any time between models, regions, and modalities.

By supporting voice agents across these regions — delivering exceptionally low latency, at a fraction of the usual cost, without losing quality across model labs — we believe we've built an execution layer for voice agents that will reshape how we build them globally.

If you're building voice pipelines across jurisdictions

We'd genuinely like to hear what you're hitting. Not a sales pitch — we're trying to understand the problem space better.

  • What regions are you deploying to?
  • What's your latency budget and are you meeting it?
  • Have you run into the control plane routing issue?
  • What compliance requirements are shaping your architecture?

Drop a comment or reach out. We're building this in the open because the problem is too big and too distributed for one company to solve by guessing.


I'm Luke, founder of SLNG. See what we've built from the above: a drop-in voice agent execution layer — in-region STT, TTS, noise reduction, VAD, language detection, endpointing, voice cloning, audio streaming, compliance routing, and LLM call optimisation. $0.01/min. One API. Bring your own orchestrator and LLM. Customer results include 50% less latency, >50% less cost, and fewer tokens per conversation.