If you are building LLM-powered applications today, you are probably managing multiple LLM providers, a pile of API keys, and your own logic for routing, budgets, and failovers. Accessing language models is no longer the challenge. Operating LLM infrastructure effectively is.

Today, we are excited to launch Otari, the open-source LLM control plane built by Mozilla.ai.

A Unified Approach to LLM Infrastructure

Otari provides a single control plane for your LLM infrastructure, helping developers and engineering teams manage routing, budgets, governance, deployment and reliability across multiple LLM providers.

From one platform, developers can:

• Route requests across multiple LLM providers through a single endpoint.
• Control LLM spend with built-in budgets, usage visibility and automatic budget enforcement.
• Manage governance through centralised API keys, workspaces and access controls.
• Deploy where you need to using either hosted or self-hosted environments.
• Improve reliability with intelligent routing and automatic failover.
• Build agent-ready applications with Agent Harnesses that provide built-in tools and orchestration.

Otari gives developers one place to control LLM infrastructure, so they can spend less time managing complexity and more time building AI applications.

Why Mozilla.ai Built Otari

At Mozilla.ai, we believe developers should be able to build AI systems that are open, flexible and under their control.

As we worked with developers and organisations adopting LLMs, we saw the same infrastructure challenges appear again and again. Teams were building custom routing logic, managing provider keys, tracking usage, enforcing budgets and implementing governance independently across every application.

These capabilities should not have to be rebuilt every time a new LLM-powered application is created.

We believe they belong in a dedicated control plane that sits between applications and LLM providers, giving developers one place to manage and operate their infrastructure.

That is why we built Otari.

Start Building with Otari

Otari is available today.

Explore the platform, read the documentation, visit the open source project on GitHub and start building with Otari.

Discover Otari at otari.ai.

Control your LLM infrastructure before complexity controls you.