惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

N
Netflix TechBlog - Medium
罗磊的独立博客
H
Help Net Security
I
Intezer
G
Google Developers Blog
CTFtime.org: upcoming CTF events
CTFtime.org: upcoming CTF events
T
Troy Hunt's Blog
让小产品的独立变现更简单 - ezindie.com
让小产品的独立变现更简单 - ezindie.com
U
Unit 42
cs.AI updates on arXiv.org
cs.AI updates on arXiv.org
freeCodeCamp Programming Tutorials: Python, JavaScript, Git & More
钛媒体:引领未来商业与生活新知
钛媒体:引领未来商业与生活新知
N
News and Events Feed by Topic
J
Java Code Geeks
S
Security Affairs
T
The Blog of Author Tim Ferriss
Recent Commits to openclaw:main
Recent Commits to openclaw:main
cs.CV updates on arXiv.org
cs.CV updates on arXiv.org
D
Docker
The GitHub Blog
The GitHub Blog
F
Full Disclosure
N
News and Events Feed by Topic
Webroot Blog
Webroot Blog
S
Security @ Cisco Blogs
腾讯CDC
人人都是产品经理
人人都是产品经理
M
MIT News - Artificial intelligence
Blog — PlanetScale
Blog — PlanetScale
T
Threatpost
D
DataBreaches.Net
Recent Announcements
Recent Announcements
博客园 - 三生石上(FineUI控件)
MongoDB | Blog
MongoDB | Blog
博客园 - 【当耐特】
L
LINUX DO - 最新话题
Google Online Security Blog
Google Online Security Blog
S
Schneier on Security
S
Securelist
奇客Solidot–传递最新科技情报
奇客Solidot–传递最新科技情报
Help Net Security
Help Net Security
P
Proofpoint News Feed
Project Zero
Project Zero
S
SegmentFault 最新的问题
H
Hackread – Cybersecurity News, Data Breaches, AI and More
MyScale Blog
MyScale Blog
Google DeepMind News
Google DeepMind News
宝玉的分享
宝玉的分享
Y
Y Combinator Blog
C
CXSECURITY Database RSS Feed - CXSecurity.com
博客园 - 叶小钗

Hacker News - Newest: "LLM"

GitHub - lechmazur/position_bias: A benchmark for testing whether LLM judges keep the same preference when two lightly edited versions of the same story are shown in opposite orders. Flex routing (EU and EFTA) Dark Factories: Retooling for LLM Velocity Ask HN: What would be the impact of a LLM output injection attack? GitHub - AronDaron/dataset-generator: No-code desktop app for generating high-quality synthetic datasets to fine-tune LLMs — plan-then-execute pipeline, LLM-as-judge, HuggingFace upload. GitHub - Oaklight/llm-rosetta: Production-ready LLM API translation layer for Python — bidirectional conversion between OpenAI, Anthropic & Google formats via hub-and-spoke IR. Optional API gateway. Streaming & non-streaming. Zero core deps. Contributions welcome! GitHub - browser-use/browser-harness: Self-healing browser harness that enables LLMs to complete any task. GitHub - moeen-mahmud/remen: Remen turns thoughts into something you can return to Analyzing 156 LLM Launch Posts on Hacker News ChatGPT vs Gemini vs Claude: The Best LLM Subscription You Should Buy GitHub - salaamalykum/quran-semantic-search: High-density RAG Semantic Search Engine & Quran Corpus (GEO/SEO Architecture) GitHub - NVIDIA/TensorRT-LLM: TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way. The State of LLM Bug Bounties in 2026 Operational Readiness Criteria for Tool-Using LLM Agents Meshcore: Architecture for a Decentralized P2P LLM Inference Network How an LLM becomes more coherent as we train it GitHub - seetrex-ai/laimark GitHub - Jossifresben/BibCrit: AI-assited biblical textual criticism GitHub - wastedcode/memex: File system based wiki, maintained by Claude 99helpers.com GitHub - cliver-project/AITrigram GitHub - unbody-io/adapt: A self-evolving memory layer for AI agents. GitHub - hb20007/awesome-gen-ai-fails: A list of incidents where reliance on generative AI and LLMs resulted in harm to companies, individuals, or society GitHub - nevenkordic/localmind: Run any local LLM with persistent memory and context. CLI agent over Ollama with SQLite-backed hybrid recall. No cloud. Ask HN: What are the machine requirements for a LLM like Llama-3.1-8B? Faster LLM Inference via Sequential Monte Carlo grpo explained: group relative policy optimization for llm finetuning - cgft Stop comparing price per million tokens: the hidden LLM API costs · TensorZero Andrej Karpathy's LLM Wiki Is a Bad Idea GitHub - GG-QandV/mnemostroma: Offline RAM-first cognitive leer/coprocessor for AI agents and robotics. Solves "Context Abandonment" with 20-80ms latency using a dual-thread biomimetic memory architecture (ONNX + SQLite WAL). mempalace/agent at agent · skorotkiewicz/mempalace GitHub - Nyquest-ai/nyquest-rust-fullstack-pub: Nyquest — Semantic Compression Proxy for LLMs. 350+ rules, local LLM stage, 15-75% token savings. Full Rust stack. GitHub - TheoV823/mneme: Enforce architectural decisions in AI-assisted development. GitHub - klemenvod/TokenBrawl: A 1v1 Bomberman-style game where two LLM agents play autonomously against each other. No human plays — you watch the AIs fight. Each agent receives a text description of the board state, reasons about it, and outputs a move as JSON. The game engine executes it. Introducing the Common AI Provider: LLM and AI Agent Support for Apache Airflow Power Circuit AI: Designing Power Electronic Circuits for Motor Drives with Generative Artificial Intelligence Ask HN: How to program with IDE and LLM on CPU locally? Show HN: Agent-cache – Multi-tier LLM/tool/session caching for Valkey and Redis Bonsai 1-bit WebGPU - a Hugging Face Space by webml-community The LLM Fallacy: Misattribution in AI-Assisted Cognitive Workflows Ask HN: Simple tooling for local LLM code critique without IDE integration? Can a General LLM Diagnose a DICOM Slice? A 10-Case Public Benchmark Charts-of-Thought: Enhancing LLM Visualization Literacy (PDF, 2026) GitHub - Mesh-LLM/mesh-llm: Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat. GitHub - seamus-brady/springdrift: A persistent runtime for long-lived LLM agents Writing an LLM from scratch, part 32k -- Interventions: training a better model locally with gradient accumulation Ask HN: Which LLM model and agentic CLI are you using for local development? GitHub - wayneColt/modelcascade: Route local. Escalate smart. Never overspend. Open-source multi-model cascade routing for autonomous agents. LLM pricing is 100x harder than you think GitHub - asakin/llm-primer: Pre-warmed Claude Code sessions in tmux. No startup wait. GitHub - EggerMarc/chat-rs: A multi-provider LLM framework for Rust. GitHub - SynapseKit/SynapseKit: Minimal, async-first Python framework for production LLM apps- 2 hard deps, no magic, no SaaS. A Claude Skill that Makes LLM Paragraphs More Bearable Does Gas Town 'steal' usage from users' LLM credits & paid services to improve itself? What's Claude Code Actually Doing? Open the Black Box with the Arthur Engine Milla Jovovich's New Open Source LLM Memory App and the Dark Code Problem Your intuition of LLM token usage might be wrong Show HN: Bloomberg Terminal for LLM ops – free and open source GitHub - 0xchamin/mcptube: Transform YouTube videos into a compounding knowledge base with transcripts, vision analysis, and agentic search. Works as an MCP server for Claude, Copilot & more. Show HN: Open KB: Open LLM Knowledge Base Your LLM is a compiler, not a runtime GitHub - sapountzis/Unslop: A Web Feed That Deserves You crates.io: Rust Package Registry Beyond Karpathy's LLM-Wiki: The Necessity of Cognitive Governance GitHub - amitshekhariitbhu/llm-internals: Learn LLM internals step by step - from tokenization to attention to inference optimization. GitHub - parallem-ai/parallem: An expressive library for running agents with the Batch API. GitHub - stfurkan/pi-llm LLM-Wiki Show HN: Formal – Formal verification for AI-generated code using Lean 4 LRTS – Regression testing for LLM prompts (open source, local-first) LLM Wiki Skill: Build a Second Brain with Claude Code and Obsidian I built an LLM Wiki and RAG solution: here's a demo for a security KB The biggest advance in AI since the LLM Predict-Rlm: The LLM Runtime That Lets Models Write Their Own Control Flow the-synthetic-library/the-synthetic-mind at main · joshferrer1/the-synthetic-library GitHub - yisding/reviewwiggum GitHub - Donnyb369/mcp-spine: Context Minifier & State Guard — Local-first MCP middleware proxy GitHub - Beledarian/wgpu-llm: A from-scratch LLM inference engine that uses wgpu (the cross-platform WebGPU implementation) to dispatch WGSL compute shaders for every math operation a Transformer needs. No CUDA. No Python. No massive framework dependencies. Just Rust, raw shaders, and your GPU. GitHub - anitiue/Hindsight: An experience-driven self-improvement framework for LLM agents — 基于经验的 LLM Agent 自我改进框架 GitHub - stef41/lmscan: 🔍 Detect AI-generated text and fingerprint which LLM wrote it. Open-source GPTZero alternative. Zero dependencies, works offline. GitHub - alainnothere/AmdPerformanceTesting: Amd Performance Testing Ask HN: Is a purely Markdown-based CRM a terrible idea? Optimized for LLM agents Context Engineering - LLM Memory and Retrieval for AI Agents | Weaviate little_helper_tui/letter.md at main · sleepyeldrazi/little_helper_tui GitHub - EvanZhouDev/umr: The Unified Model Registry for all your local AI apps. GitHub - JordanCT/VigIA-Orchestrator Your Agent Is Mine: Measuring Malicious Intermediary Attacks on the LLM Supply Chain A Taxonomy of RL Environments for LLM Agents Llama LLM Network Feture GitHub - genedeng-ca/ai-mac-migration: AI-powered Mac-to-Mac migration tool - replace Apple Migration Assistant with intelligent, selective transfer using local LLMs GitHub - lunargate-ai/gateway: High-performance self-hosted AI gateway (OpenAI-compatible) with routing, retries, and streaming GitHub - AuthBits/webmcp: A lightweight, prompt-driven MCP web research server for high-quality LLM powered information extraction. Externalization in LLM Agents: A Unified Review of Memory, Skills, Protocols and Harness Engineering Springdrift: An Auditable Persistent Runtime for LLM Agents with Case-Based Memory, Normative Safety, and Ambient Self-Perception High-Stakes Personalization: Rethinking LLM Customization for Individual Investor Decision-Making From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agents HUOZIIME: An On-Device LLM-enhanced Input Method for Deep Personalization TIDE: Token-Informed Depth Execution for Per-Token Early Exit in LLM Inference Characterizing WebGPU Dispatch Overhead for LLM Inference Across Four GPU Vendors, Three Backends, and Three Browsers LLM Targeted Underperformance Disproportionately Impacts Vulnerable Users
AI Token Economics: Why Cheaper Tokens Made Your Bill Explode — Northwood Systems
ALAndrew Liu·Founder·7 min read · 2026-06-17 · via Hacker News - Newest: "LLM"

June 16, 2026

Token prices collapsed faster than almost any technology cost in history. Yet engineering teams are hitting emergency spending caps and cancelling licences. Understanding why that happened is the first step to fixing it.

Uber burned through its entire annual AI budget in four months. Not by being wasteful, but by doing exactly what its leadership encouraged. The company had internal leaderboards celebrating heavy AI usage, executives publicly praised the productivity gains, and then the bill arrived. The result: a $1,500-per-month hard cap on each agentic coding tool, per employee, effective June 2026.1

That story isn't a cautionary tale about one company's poor planning. It's a preview of what happens when metered, per-token pricing meets agentic workloads at scale, and it's landing in your budget right now.

Start with the numbers.

0 mo

To burn through the annual AI budget

Uber, 2026

0%

Fall in LLM API prices, 2025→2026

Industry pricing aggregators, 2026

0M

Tokens the median developer burns per month

Morph LLM, 2026

The Jevons paradox is running your AI budget

In 1865, economist William Stanley Jevons noticed something counterintuitive. As steam engines became more efficient, cheaper to run per unit of work, total coal consumption went up, not down. Efficiency unlocked demand that hadn't existed before.

The Jevons paradox is what's happening to your AI spend. Token prices dropped roughly 80% between 2025 and 2026.2 Your engineers didn't pocket those savings; they used them as permission to run more, longer, and more ambitiously. A task that cost $10 now costs $2, so your team runs it five times instead of once, then hands it to an agent that runs it fifty times automatically.

The strongest counter-argument: "If unit costs fell 80%, even tripling usage keeps the bill flat." That's true for chat-style, single-turn interactions. It breaks completely once you introduce agentic loops, because an agent doesn't triple token consumption. It multiplies it by 50x.3 A single agentic coding session now pushes 1–3.5 million tokens per task;4 one agentic coding tool, used heavily, clears Uber's $1,500 monthly cap on its own.

The math isn't subtle.

What one agentic coding turn actually costs

Take Claude Opus 4.8, a model your senior engineers might reasonably reach for on a complex refactoring task. Input tokens run $5 per million; output tokens run $25 per million.

A single agentic turn with a reasonable context: 200,000 input tokens × $5/M = $1.00. The model responds with 50,000 output tokens × $25/M = $1.25. Total: $2.25 per turn.

Now multiply that across a real workday: 40 turns per day, 20 working days. That's $1,800 a month, from one engineer, using one tool, on one model. Uber's $1,500 cap doesn't cover it.

$0.00

Per agentic turn

200K in + 50K out · Opus 4.8

$0

Per developer-day

× 40 turns

$0

Per developer-month

× 20 days, past Uber's $1,500 cap

The pricing chart below shows why output tokens are the number that matters. Input is the sticker price. Output is the bill.

Fig. 1

Input is the sticker price. Output is the bill.

Cost per 1M tokens, USD, input vs output by model

$0$10$20$30$40

Gemini Flash-Lite

Gemini 3.1 Pro

Claude Sonnet 4.6

GPT-5.4

Claude Opus 4.8

GPT-5.5

Provider pricing, compiled June 2026 · cloudzero.com

Output tokens cost 4–10× input tokens across every major model. On agentic workloads, output volume is the variable that escapes.

Developer spend follows a power law

Not every engineer hits $1,800 a month. A solo developer on a single subscription tool pays roughly $100. A heavy multi-tool user lands around $400. The power agentic user, the one actually getting the productivity gains, runs $1,500. And Microsoft reportedly cancelled employee AI licences after discovering some engineers were running $2,000 per month each.7

Fig. 2

Typical monthly AI-coding spend per developer

Upper bound of reported range, USD, 2026

$0$500$1k$1.5k$2k

Solo (subscription)

Heavy multi-tool user

Power agentic user

MS engineers (licences cancelled)

Morph LLM (ranges); Microsoft via reporting · morphllm.com

Monthly AI coding spend per developer varies by more than 20× depending on tool usage pattern. The productivity gains concentrate in the expensive tail.

That distribution matters for how you think about governance. The engineers generating the most business value from AI are, structurally, the same engineers generating the largest bills. Blunt per-tool caps catch both.

Sixty-three percent of organisations now name AI an active FinOps concern, up from 31% in 2024, according to the FinOps Foundation.5 That doubling isn't panic; it's recognition that per-token billing has no natural ceiling, and finance teams weren't built to forecast it.

Converting variable cost into fixed cost

Every dollar you spend on external LLM APIs is a variable cost that scales with usage. There is no cap baked into the architecture. You impose caps manually, reactively, after the budget has already moved.

The structural alternative is converting that variable cost into a fixed, plannable one: infrastructure you own, models you run, a bill that reads more like a data-centre line item than a taxi meter. That's the architecture change, not a configuration tweak.

Owning the stack also collapses a second problem into the same decision. Teams that can't send sensitive code or proprietary data to external APIs in the first place, like regulated industries with strict data-residency requirements, get cost control and data control from one architectural choice: when the models run inside your own perimeter, the spend is a capacity you provisioned, and the data never leaves it.

The honest objection is that owned infrastructure costs more upfront. That's true, and you should model it carefully. The break-even depends on your team size, your model mix, and how far up that power-law curve your engineers actually sit. But the Uber scenario, burning an annual budget in four months and then reaching for a blunt cap, has a specific infrastructure shape behind it: metered external APIs with no architectural ceiling.

The third that hasn't solved this yet

Look at the FinOps Foundation's numbers again. Two years ago, fewer than one in three organisations considered AI spend a FinOps concern. Today it's nearly two in three. The other third hasn't caught up yet, or they've decided the productivity gains justify the open meter.

That second position is defensible for a while, at the right scale. One company reportedly spent approximately $500 million on AI after failing to enact employee usage caps.7 MIT research suggests roughly 95% of enterprise GenAI projects fail to deliver measurable financial returns within six months.6 Unlimited spend on ambiguous return is a hard position to hold when the board asks.

The move that's working for teams ahead of this curve: model the cost of your specific agentic workload (use the math above as a starting point), map it against the productivity return you can actually measure, and decide whether metered external spend or fixed owned infrastructure gives you better control over that ratio. Don't let the sticker price on input tokens be the number your finance team sees.

Key takeaways

  • 01Token prices fell ~80% in a year, yet bills rose, because cheaper tokens unlocked agentic workloads that burn 50× more tokens than a chat prompt. That's the Jevons paradox, and it runs on autopilot.
  • 02Output tokens are the variable that escapes. At Opus 4.8 rates, one power user running 40 agentic turns a day costs $1,800/month, past Uber's hard cap on a single tool.
  • 03Developer AI spend follows a power-law distribution. The engineers generating the most value are structurally also generating the largest bills; blunt caps cut both.
  • 04Per-token billing has no architectural ceiling. You impose limits manually, after the damage. The structural fix is converting variable token spend into fixed infrastructure cost.
  • 0563% of organisations now name AI an active FinOps concern, up from 31% two years ago. The teams ahead of this have modelled their workloads and made an explicit build-vs-buy decision.

Sources

  1. TechCrunch, "Uber caps employee AI spending after blowing through budget in four months" (June 2, 2026).
  2. CloudZero, "LLM API Pricing Comparison". Per-million-token input/output prices and the ~80% year-over-year decline (2026).
  3. LeanOps, "Agentic AI cost runaway: the token budget problem". Agents consume roughly 50× the tokens of a chat prompt (2026).
  4. Morph LLM, "AI Coding Costs". Median monthly token usage (~51M/developer), tokens per agentic task, and per-developer monthly spend ranges (2026).
  5. FinOps Foundation, finops.org. Share of organisations naming AI an active FinOps concern, 31% (2024) → 63% (2025).
  6. MIT Project NANDA, The GenAI Divide: State of AI in Business (2025). Roughly 95% of enterprise generative-AI projects show no measurable financial return within six months.
  7. Secondary industry reporting (2026). Microsoft engineers' reported ~$2,000/month agentic token bills and a reported ~$500M unmanaged AI spend at one company. Primary sources still to be confirmed before publication.