We find cheaper inference within the SLA you provide.
−45%costs
input + output / 1M
−34%latency
time to first token
// median cost and latency across 22,138 requests
Gemini Image Classification
+20.2% Latency-38.9% Cost
OpenAI Deep Research
-30.1% Latency-44.8% Cost
OpenAI Browser Agent
+9.7% Latency-51.5% Cost
When you make a request it is fulfilled using edge compute. We use Cloudflare workers which is deployed in 300+ cities. Our own routing adds 1-5 milliseconds on a cold start.
Your prompt and its reply just pass through. We never store them and we never read them. Your provider key is envelope-encrypted with AES-256-GCM and locked to your exact org and provider slot, so it decrypts nowhere else, and a key that will not decrypt is treated as missing. So your production key is safe to drop in.
You bring your own key, so the provider bills you directly. We also don't have a fee per request. By bringing your own key you also get the benefits of using your credits, discounts, negotiated rates, and API tiers.
If you send a wrong parameter we don't quietly strip it to force a success. When the provider rejects a request, we send the status code and the error back to you. That way you can debug based on your intentions and not find a bug weeks after launching.
Point the base URL at us and pass your key. We work with OpenAI, Anthropic, and Gemini clients. To use FlexInference you just need to add a single new field, start_within. If you decide to use our Python or TypeScript SDKs then you also get the benefits of strict types.
Every error comes back in the shape of the SDK you called, so your client parses it unchanged. It carries a machine-readable code, the exact fix, and a doc_url. Our MCP server goes further. Coding tools like Claude and Cursor can search the docs, look up any error code, and manage your keys over OAuth. So your agents fix their own mistakes, and you are not stuck babysitting them.
Base price
5.5% per request$0per request
Routing is free. When you give us an SLA to find a cheaper way to run your request, we hunt for cheaper inference. If we find you cheaper inference, we keep 20% of what we save you. If we cannot find anything cheaper, we escalate your request to a standard request and it is once again free.
If we take a $10 request down to $5, we take a $1 fee and you pay $6. That is 40% savings.
Point your base URL at FlexInference, pass your FlexInference key, and add start_within to start saving.
curl https://api.flexinference.com/v1/responses \
-H "Authorization: Bearer flex_live_..." \
-H "Content-Type: application/json" \
-d '{
"model": "gpt-5.2",
"input": "Summarize this thread.",
"start_within": "00h-00m-30s"
}'Hey! My name is Adi.
I grew up wanting to help others. Actually, that's not always been true. I went through a tough time in college and it made me want to help people. Help people get educated. Help people get better healthcare. Help people with the basics, you know? At first I tried to do that directly. Made a few free websites/tools/videos. And it definitely helped. But, not the scale I wanted.
Then AI hit an inflection point. It started making education better because it could answer a billion questions happily. It made healthcare better by personalizing it to everyone. I realized something then. I hadn't built the models, but I could help make them easier to reach. The labs want the same thing. They're working to make inference cheaper, faster, and open to everyone. The problem is all the layers sitting on top. They slow it down, mark it up, and gate who gets in.
So I made FlexInference as a crack at that. It makes getting to these providers cheaper, faster, and more reliable. The first way it does that is by hunting for cheaper inference, and escalating to standard when it can't find any. By making it cheaper to work with these models, ideally we can get more ideas out there. More incredible products. And as such, help more people.
That's why I created FlexInference. Hopefully, it helps you all.
Sincerely,
Adi
P.S. It's free for all requests. And I only really charge when I save you money, so it's profitable to use FlexInference.
P.P.S I tried to make it super easy to use FlexInference. It's strictly typed. It also won't quietly fall back to parameters you never set just to force a request through. You also don't need to use the FlexInference SDK and can just change the URL and key instead.
FlexInference runs an MCP server, so Claude, Cursor, and any other MCP client can check your usage, manage your API keys, and search the docs without leaving your editor. Point it at https://mcp.flexinference.com/mcp and you are set.
The docs tools need no login. Anything that touches your account runs over OAuth and asks first, so a client reads your usage or changes a key only after you approve it. It never runs inference and never takes a raw provider key.
此内容由惯性聚合(RSS阅读器)自动聚合整理，仅供阅读参考。 原文来自 — 版权归原作者所有。