Today, BentoML is joining Modular.
Our goal is simple: make it dramatically easier to serve high-performance inference in production - fast, portable, and without hardware lock-in.
This acquisition accelerates our end-to-end platform vision. By unifying hardware-aware optimization with production deployment, teams can take models from development to reliable, scalable serving with fewer moving parts.
After months of collaborating on customer deployments, we’re thrilled to officially become one team.
When we started Modular, our vision was clear: unify the AI software stack from the bottom up. We built Mojo to give developers performance without complexity. We built MAX to optimize AI models across hardware. Now, with BentoML, we’re completing that stack with proven managed service infrastructure.
BentoML has built exactly what production AI teams need. More than 10,000 organizations, including 50+ Fortune 500 companies, use BentoML to deploy models at scale. Simply put, BentoML is where production AI teams live:
Modular and BentoML share the same DNA: open source foundations and a commitment to making AI infrastructure accessible. We’re not just aligned on technology; we’re aligned on values. Together, we’re building a single workflow that spans optimization, serving, and operation, so teams can ship faster with fewer moving parts.
As part of that mission, we are super charging our cloud team, if incredible at-scale AI inference gets you excited, come join us!
Together, we’re bringing performance optimization across the entire AI workflow into one cohesive stack.
If you use BentoML today: nothing breaks. The open source project continues under Apache 2.0 with the same docs, community, and contribution process, and commitments to BentoML customers continue without disruption.
BentoML remains an active open source project. The community, documentation, and contribution process are unchanged, and development continues as usual. Our priority is stability for existing users as we begin integrating our platforms.
In the near term, we’ll focus on tight, practical integrations that make it easier to go from optimized models to production deployments, without disrupting existing BentoML workflows.
We’ll start sharing concrete progress soon. For now:
For the BentoML community: we’re committed to supporting the production workflows you rely on and the open source project you’ve built together. Join us on Tuesday February 17th from 9:30am-11:30am PT for an Ask Me Anything with Modular CEO Chris Lattner and BentoML CEO Chaoyu Yang in the Modular Forum, where we’ll answer questions and outline our integration roadmap.
For Modular developers: this acquisition reinforces our commitment to open source and production-ready infrastructure. BentoML brings proven deployment expertise, helping turn performance gains into real-world production wins.
This is just the beginning. We’ll share concrete integrations, benchmarks, and results as we continue to ship.
BentoML is the open source platform for deploying AI models at scale. Used by more than 10,000 organizations worldwide, BentoML makes it simple to package models, manage dependencies, and deploy to production with confidence. Learn more at bentoml.com.
Modular is building unified AI infrastructure. Our Mojo programming language and MAX inference engine enable developers to build high-performance AI on any hardware. Learn more at modular.com.
Discover what Modular can do for you
Request a demo
此内容由惯性聚合(RSS阅读器)自动聚合整理，仅供阅读参考。 原文来自 — 版权归原作者所有。