惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

阮一峰的网络日志
阮一峰的网络日志
Last Week in AI
Last Week in AI
钛媒体:引领未来商业与生活新知
钛媒体:引领未来商业与生活新知
U
Unit 42
J
Java Code Geeks
OSCHINA 社区最新新闻
OSCHINA 社区最新新闻
罗磊的独立博客
月光博客
月光博客
腾讯CDC
Stack Overflow Blog
Stack Overflow Blog
小众软件
小众软件
B
Blog
freeCodeCamp Programming Tutorials: Python, JavaScript, Git & More
美团技术团队
Y
Y Combinator Blog
T
Tailwind CSS Blog
宝玉的分享
宝玉的分享
酷 壳 – CoolShell
酷 壳 – CoolShell
博客园_首页
Cyber Security Advisories - MS-ISAC
Cyber Security Advisories - MS-ISAC
爱范儿
爱范儿
B
Blog RSS Feed
V
Visual Studio Blog
MyScale Blog
MyScale Blog

DEV Community

Authentication Security Deep Dive: From Brute Force to Salted Hashing (With Java Examples) Why AI Systems Don’t Fail — They Drift Spilling beans for how i learn for exam😁"Reinforcement Learning Cheat Sheet" I Replaced Chrome with Safari for AI Browser Automation. Here's What Broke (and What Finally Worked) How Python Borrows Other People's Work The $40 Architecture: Processing 1 Billion API Requests with 99.99% Uptime Vibe Coding: A Workflow Guide (From Zero to SaaS) Most webhook security guides protect the wrong side. The scary part is delivery. Headless CMS for TanStack Start: Build a Blog with Cosmic EU Age Verification App "Hacked in 2 Minutes" — What Actually Happened Comfy Cloud’s delete function does not actually remove files Running AI Models on GPU Cloud Servers: A Beginner Guide Event-driven media intelligence with AWS Step Functions and Bedrock I scored 500 AI prompts across 8 quality dimensions — here's what broke How to Call Google Gemini API from Next.js (Free Tier, No Backend Needed) The Portal Protocol: Reclaiming Human Connection in the Age of AI How to Fix Your Team's Scattered Knowledge Problem With a Self-Hosted Forum Intro to tc Cloud Functors: A Graph-First Mental Model for the Modern Cloud Designing Multi-Tenant Backends With Both Ownership and Team Access I Built a Neumorphic CSS Library with 77+ Components — Here's What I Learned PostgreSQL Performance Optimization: Why Connection Pooling Is Critical at Scale Cómo construí un SaaS multi-rubro para gestionar expensas en Argentina con FastAPI + Vue 3 🚀 I Built an Ethical Hacking Scanner Tool – Open Source Project I Replaced /usage and /context in Claude Code With a Single Statusline A Pythonic Way to Handle Emails (IMAP/SMTP) with Auto-Discovery and AI-Ready Design I Collected 8.9 Million Polymarket Price Points — Here's What I Found About How Markets Really Move EcoTrack AI — Carbon Footprint Tracker & Dashboard Everyone's Using AI. No One Agrees How. 5 self-hosted ebook managers worth trying in 2026 Building Your First AI Agent with LangChain: From Chatbot to Autonomous Assistant
I Spent $50 on LLM API Calls. Then Optimized to $0.
ZNY · 2026-05-20 · via DEV Community

ZNY

I Spent $50 on LLM API Calls. Then Optimized to $0.

The real cost of AI features isn't the subscription — it's the prompts you haven't optimized yet.

The $50 Month

Two months ago, my OpenAI API bill hit $50. For a side project used by maybe 100 people.

The features I was using weren't complex:

  • User name extraction
  • Email subject generation
  • Simple categorization

I was calling GPT-4o mini for everything because it was "cheap enough." But it added up.

What I Changed

1. Better Prompt Engineering

Same model, better prompts. A well-structured prompt with examples often matches a more expensive model.

Before:

Categorize this email: "{subject}"

Enter fullscreen mode Exit fullscreen mode

After:

Categorize this email into one of: [urgent, follow-up, spam, newsletter]
Example: "RE: Meeting at 3pm" → follow-up
Example: "Free iPhone!" → spam
Now categorize: "{subject}"

Enter fullscreen mode Exit fullscreen mode

Result: Same model, 40% fewer tokens needed.

2. Switched to Local Models for Simple Tasks

For categorization and extraction, I switched to:

  • Ollama + Llama 3.2 for self-hosted inference
  • Groq API (free tier) for production

Both handle simple structured extraction tasks at near-zero cost.

3. Caching Everything

Repeated questions get cached. If 50 users ask the same question, one API call serves all.

# Simple semantic cache
cache_key = hash(prompt + first_50_chars_of_context)
if cache.exists(cache_key):
    return cache.get(cache_key)

Enter fullscreen mode Exit fullscreen mode

4. Model Selection by Task

Not everything needs GPT-4o:

Task Model Cost
Simple categorization Groq (free tier) $0
Structured extraction Ollama (local) $0
Long-form generation GPT-4o mini $0.002/1K
Complex reasoning Claude 3.5 Sonnet $0.003/1K

The Results

After optimization:

  • API bill dropped from $50/month to $8/month
  • Response times actually improved (local models are faster for simple tasks)
  • Caching covered 60% of requests

What I'd Tell Myself

Start with the cheapest model that works. Optimize prompts before switching models. Add caching before adding more expensive calls.

The $50/month problem is usually a $5/month problem you haven't solved yet.

What's your biggest AI API expense? Any optimization wins you've found?