惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

让小产品的独立变现更简单 - ezindie.com
让小产品的独立变现更简单 - ezindie.com
A
About on SuperTechFans
Y
Y Combinator Blog
V
V2EX
Engineering at Meta
Engineering at Meta
freeCodeCamp Programming Tutorials: Python, JavaScript, Git & More
V
Visual Studio Blog
博客园 - 叶小钗
博客园 - 聂微东
阮一峰的网络日志
阮一峰的网络日志
H
Help Net Security
小众软件
小众软件
奇客Solidot–传递最新科技情报
奇客Solidot–传递最新科技情报
The GitHub Blog
The GitHub Blog
WordPress大学
WordPress大学
OSCHINA 社区最新新闻
OSCHINA 社区最新新闻
MongoDB | Blog
MongoDB | Blog
B
Blog
G
Google Developers Blog
J
Java Code Geeks
博客园 - 三生石上(FineUI控件)
IT之家
IT之家
N
Netflix TechBlog - Medium
腾讯CDC

FourWeekMBA

Musk vs Altman: The $90B Fight That Will Define AI’s Future Why DeepMind’s $1.1B Bet Signals the End of Human-Trained AI The AI Orchestrator's Leverage Points AI & The Harness Theory Why AI Companies Are Selling Fiction as Partnership Strategy Google’s $40B Anthropic Bet Reveals AI Infrastructure Wars Anthropic’s Agent Economy Signals End of Human-Mediated Commerce Claude OS: The AI Strategy Skill That Turns Claude Into Your Analyst Agent Harness OS: Build AI-Augmented Strategic Operations 🔥 AI & The Harness Theory 🔥 The Harnessing Players Map of AI 🔥 The Business Engineer’s Claude Code OS 🔥 Skills as the Architecture of the Personal OS Google's $40B Anthropic Bet Exposes Big Tech's AI Desperation Google's $40B Anthropic Bet Signals Platform Wars 2.0 20 Mental Models For AI Business Google's TPU Gambit: Why Hardware Will Crown the AI King LinkedIn Business Model: How LinkedIn Makes Money (2026) Netflix Organizational Structure: The Culture of Freedom (2026) Amazon Pricing Strategy: How Amazon Uses Price to Win Amazon Supply Chain: The Logistics Empire (2026) Apple Supply Chain: How Apple Built the World’s Best Supply Chain Tesla Supply Chain: Vertical Integration Strategy (2026) Anthropic Business Model: How Anthropic Makes Money (2026) OpenAI Business Model: How OpenAI Makes Money (2026) Meta (Facebook) Organizational Structure 2026 Google's Agentic TPUs Signal the Death of Traditional SaaS Google's $40B Anthropic Bet Signals The End of AI Independence The OpenAI–Anthropic Convergent Bets Google’s $40B Anthropic Bet Signals the End of Open AI Innovation
Nvidia's Vera Rubin Promises 10x Cheaper Inference — But ...
Gennaro Cuofano · 2026-06-01 · via FourWeekMBA

Nvidia just announced six new chips at once. The Vera Rubin platform — named after the astrophysicist who proved the existence of dark matter — is Jensen Huang’s answer to a question the market hasn’t fully internalized yet: what happens when AI inference costs drop 10x?

The headline specs are staggering. The Rubin GPU packs 336 billion transistors in a dual-die design — 1.6x more than Blackwell. Built on TSMC’s 3nm process with 288GB of HBM4 memory per GPU and 22TB/s of memory bandwidth. A single NVL72 rack holds 72 Rubin GPUs and 36 Vera CPUs, connected by 260TB/s of scale-up bandwidth. Total rack performance: 50 petaflops FP4. The Rubin Ultra, coming in 2027, doubles that to 100 petaflops.

But the number that matters isn’t petaflops. It’s 10x lower cost per token compared to Blackwell. That single metric reshapes the economics of the entire AI industry.

What 10x Cheaper Inference Actually Means

Today, running a large language model — as explored in the intelligence factory race between AI labs — at scale costs roughly $0.01-0.03 per 1,000 tokens on Blackwell-class hardware. Cut that by 10x, and you’re at $0.001-0.003. At that price point, entirely new application categories become viable.

Real-time AI agents that run continuously — not just when a user sends a prompt — become economically feasible. Autonomous customer service, code review, financial analysis, medical triage — workloads that were too expensive to run 24/7 suddenly fit inside a normal operating budget. The shift from “AI as a tool you query” to “AI as infrastructure — as explored in the economics of AI compute infrastructure — that runs always” requires exactly this kind of cost reduction.

This is why Nvidia also announced Rubin CPX — an inference-specific GPU with 128GB GDDR7 and 30 petaflops, purpose-built for million-token context windows. The NVL144 CPX platform delivers 8 exaflops per rack. That’s not a training machine. That’s an inference factory designed for the world where every application embeds an AI model that never stops running.

Six Chips at Once: The Full-Stack Play

The Vera Rubin platform isn’t just a GPU. It’s six coordinated silicon products: the Rubin GPU, Vera CPU (Arm-based), NVLink 6 switch, ConnectX-9 SuperNIC, BlueField-4 DPU, and Spectrum-6 Ethernet switch. Each is custom-designed to work together.

This matters because it means Nvidia controls every component in the data center compute plane — not just the GPU. When a hyperscaler buys an NVL72 rack, they’re buying the processor, the memory, the CPU, the networking, and the security infrastructure as a single integrated system. The switching cost isn’t replacing a chip. It’s replacing the entire architecture.

No competitor can match this breadth. AMD sells GPUs and CPUs but not networking. Broadcom designs custom ASICs and networking but not general-purpose GPUs. Intel has CPUs and is attempting foundry but lacks competitive AI accelerators. Only Nvidia ships the complete stack.

The ASIC Threat Is Real — And Growing Faster

Here’s the uncomfortable data point Nvidia can’t announce away: custom AI ASIC shipments are growing at 44.6% in 2026, nearly 3x faster than merchant GPU growth of 16.1%. Google’s TPU v7 Ironwood, Amazon’s Trainium 3, Microsoft’s Maia 200, and Meta’s MTIA collectively represent billions in R&D aimed at one objective — reducing dependency on Nvidia.

The five companies that represent roughly 50% of Nvidia’s data center revenue are the same five companies building chips to replace Nvidia. That’s not competition. That’s customer defection in slow motion.

Nvidia’s response is exactly what Vera Rubin represents: make the next generation so much better that the cost of switching exceeds the cost of staying. A 10x improvement in cost-per-token is designed to reset the clock on every custom ASIC program. By the time Google or Amazon finishes designing a chip that matches Blackwell, Nvidia has already shipped something 10x better.

The Strategic Paradox

There’s an irony embedded in Vera Rubin’s economics. By making inference dramatically cheaper, Nvidia accelerates the very market that custom silicon is best positioned to serve.

Training requires maximum flexibility — the kind that general-purpose GPUs excel at. But inference increasingly favors efficiency, latency, and cost-per-token — metrics where purpose-built ASICs can win. As inference grows to dwarf training in total compute demand (analysts project 70-80% of AI compute will be inference by 2028), the market is structurally shifting toward the territory where Nvidia’s advantage is narrowest.

Nvidia knows this. That’s why Rubin CPX exists — a separate inference-optimized GPU that sacrifices training flexibility for token-serving efficiency. It’s Nvidia building its own ASIC before its customers do.

The $5 Trillion Question

Nvidia’s market cap sits at $5.23 trillion — the most valuable company on Earth. Q1 FY2027 delivered $81.6 billion in revenue, up 85% year-over-year, with Q2 guided to $91 billion. At that trajectory, Nvidia is on a $360 billion annualized run rate.

The first Vera Rubin rack is already running at Microsoft Azure. Full production ships in H2 2026. AWS, Google Cloud, and Oracle are confirmed partners. The demand is not theoretical — it’s contracted.

The question for the next 18 months isn’t whether Vera Rubin will ship. It will. The question is whether 10x cheaper inference creates a market so large that even losing share to custom ASICs leaves Nvidia with a bigger business than it has today. If total inference demand grows 5x while Nvidia’s share drops from 90% to 60%, Nvidia still triples its inference revenue.

That math — growing the pie faster than you lose share of it — is the core bet behind the $5 trillion valuation. Vera Rubin is the chip designed to make sure the pie grows fast enough.

For the full structural map of the AI economy, read The Map of AI Redrawn on Business Engineer.