惯性聚合 高效追踪和阅读你感兴趣的博客、新闻、科技资讯
阅读原文 在惯性聚合中打开

推荐订阅源

IT之家
IT之家
奇客Solidot–传递最新科技情报
奇客Solidot–传递最新科技情报
大猫的无限游戏
大猫的无限游戏
美团技术团队
OSCHINA 社区最新新闻
OSCHINA 社区最新新闻
博客园_首页
MyScale Blog
MyScale Blog
N
Netflix TechBlog - Medium
I
InfoQ
Jina AI
Jina AI
Martin Fowler
Martin Fowler
Recent Announcements
Recent Announcements
量子位
月光博客
月光博客
罗磊的独立博客
雷峰网
雷峰网
The Cloudflare Blog
V
V2EX
小众软件
小众软件
人人都是产品经理
人人都是产品经理
博客园 - Franky
T
Tailwind CSS Blog
有赞技术团队
有赞技术团队
S
SegmentFault 最新的问题

StorageNewsletter

Vast Data Valued at $30 Billion as AI Drives a New Infrastructure Stack Wasabi Technologies Closes $250M Credit Facility to Expand Cloud Storage Innovation NAB Show 2026: TVC Soho Selects EditShare High-Performance NVMe Storage to Support Resolve Finishing Workflows KIOXIA Unveils Value-Oriented QLC-based EG7 Series SSDs for PC OEMs NinjaOne Unified Backup Surpasses Fifteen Thousand Customers Portworx by Everpure is Redefining Modern Virtualization for Customers with Proven, Enterprise-Ready Solutions Peer Software Strengthens Global Partner Program to Unify Fragmented File Environments for the AI Era NetApp Collaborates with Google Cloud to Power Data Infrastructure for Distributed Cloud Sidus Space Expands Existing Agreement with Lonestar Data Holdings, Inc. to Support Additional StarVault Orbital Data Storage Payload From SNIA: SCSI Continues to Innovate Data Storage with SBC-5 Microsoft Technology Licensing Assigned Patent Linux Kernel 7.0 is Out NAB Show 2026: ATTO Technology Ignites Next Era of Media Connectivity NAB Show 2026: Promise Technology to Showcase Integrated Storage Plug-in for Video and Image Creative Workflows NAB Show 2026: EditShare Advances Analytical AI and NVMe Performance for Modern Broadcast and Post NAB Show 2026: Elements Introduces GRID, a New Node-Based Scale-Out NAS Platform NAB Show 2026: MASV Expands Global Partner Ecosystem to Accelerate End-to-End Media Workflows NAB Show 2026: UnifyDrive to Showcase Full NAS Lineup NAB Show 2026: Strada Releases Easiest Remote Editing Platform on the Market Synology: Three Security Advisories on Resolved Vulnerabilities Mastercard International Assigned Patent NAB Show 2026: Promise Technology to Unveil AI-Optimized Storage Solutions NAB Show 2026: QNAP Releases HDP Recovery Media Creator: Building Windows DR Media in USB and ISO Formats NAB Show 2026: SNS Unveils Three New Products, Expanded Ecosystem NAB Show 2026: Symply Unveils Centara Platform, World’s First Quad-Interface LTO with Thunderbolt 5, and Spark One Portable NVMe NAB Show 2026: Other World Computing Launches OWC Express 4M2 Ultra Thunderbolt 5 Four-Slot NVMe M.2 SSD Enclosure Panmnesia to Mass-Produce PCIe 6.4-CXL 3.2 Fusion Switch CIQ Delivers the First Enterprise Linux Compliance Platform for Federal Cryptographic Validation and Post-Quantum Readiness Adata Launches Urban Tapsafe Up to 2TB USB 3.2 Gen2 External SSD Raidon Technology Introduces 4-Bay STARDOM SR4-BA32 20Gb/s USB-C RAID-5 Desktop Storage System
Announcing the Databricks Storage Ecosystem: Governing th...
Philippe Nicolas · 2026-06-24 · via StorageNewsletter

Blog written by Rupal Jain, technology partner management director, and Denis Dubeau, principal, partner engineering, Databricks, published June 10, 2026

The Data That Can’t Move
For years, the enterprise data strategy was simple: move everything to the cloud. Migrate the data lakes and the warehouses to the cloud, and then governance follows. It was a clean story — until it wasn’t.

Today, some of the world’s most sophisticated enterprises are telling us clearly: they cannot — and will not — move all of their data to the cloud. Leading semiconductor manufacturers are training models on engineering-classified datasets that must never leave their premises. Global trading firms sit on massive volumes of historical tick data where the economics of cloud egress make migration impossible. Tier-1 banks have adopted “Hybrid Forever” strategies, modernizing on-premises storage while maintaining strict data sovereignty. Major pharmaceutical companies run millions of daily drug experiments against petabyte-scale on-premises data estates subject to stringent regulatory controls.

These aren’t edge cases. They represent a structural shift in how enterprises think about data: from “Migrate Everything” to “Govern Everything.”

The drivers are real and compounding:

  • Data sovereignty & regulation: Financial services, healthcare, and government organizations operate under mandates — GDPR, HIPAA, NIS2, sector-specific data residency rules — that require data to remain within specific jurisdictions or air-gapped environments. Cloud migration is not optional; it is legally prohibited for certain datasets
  • Data gravity & costs: At petabyte and exabyte scale, the economics of cloud migration break down entirely. Egress fees, storage costs, and sheer data volume make the “move it once” model financially unsustainable. Some of the world’s largest retailers are actively repatriating analytics workloads from cloud back to on-premises infrastructure for precisely this reason
  • Latency & edge workloads: Retail, manufacturing, and telco workloads require low-latency access to on-premises and edge data. Telecommunications providers ingest enormous volumes of network telemetry on-premises daily to power AI-driven network operations that cannot tolerate cloud round-trips
  • AI on dark data: Vast stores of backup data, unstructured archives, and secondary datasets — representing hundreds of exabytes across the enterprise — contain immense AI value that has never been unlocked because governance didn’t reach it

The signal is unmistakable. We have received requests from hundreds of customers explicitly requesting on-premises and hybrid storage connectivity to Unity Catalog. The Software-Defined Storage (SDS) market stands at hundreds of billions of dollars in 2026, and the enterprise partners who manage this estate — collectively holding more than 2 Zettabytes of data under management — are building with us.

Introducing the Databricks Storage Ecosystem
Today, we are excited to announce the Databricks Software-Defined Storage (SDS) Ecosystem — a new partner category purpose-built to bring Databricks Intelligence Platform to enterprise data wherever it lives: on-premises, in private clouds, and at the edge environments. If you are an enterprise running petabytes of data on these platforms today, you no longer have to choose between your existing non-cloud storage infrastructure and Databricks AI.

For too long, enterprises had to choose between the on-premises storage infrastructure they rely on and the cloud-native AI they want to build. Forcing customers to migrate massive amounts of data using complex pipelines just to unlock that intelligence is a broken model. By uniting these industry-leading partners, we are ending that compromise and delivering Databricks Intelligence directly to where the enterprise data lives. But this launch is just day one. We are building the foundation to ensure that soon, every piece of hybrid data–structured or unstructured–is instantly ready for generative AI without ever copying a byte,” said Stephen Orban, SVP, product partnerships & ecosystem, Databricks.

At the heart of this ecosystem is OpenSharing, an open-source protocol for secure, governed data sharing. Our storage partners are implementing OpenSharing servers to expose their data estates directly to Databricks Serverless Compute. The path is simple: the storage partner stands up a OpenSharing endpoint, you connect it to Unity Catalog, and you instantly gain secure, governed access to your on-premise data in Databricks without data migration.

This integration provides a single, unified catalog across your entire hybrid environment. Customers can now use Databricks Serverless Compute, Genie, AgentBricks, and model training to query and reason over data that never leaves the premises. The result? Zero data movement, no duplication of data and zero compliance risk.

This is not a roadmap aspiration. Customers can try these integrations today. Partners building these integrations follow the Partner Well-Architected Framework — a technical blueprint covering architecture, security, and certification criteria.

Customers want to break down data silos and unify all of their Data and AI estate – including large amounts of data that still sits on-premises. Thanks to on-premises storage partners leveraging the open source Open Sharing protocol, customers can now seamlessly unify, govern, and analyze all of their data estate in Databricks Unity Catalog – unlocking the full value of their data in the Databricks Data Intelligence Platform,” added Jonathan Keller, VP, product management, Databricks.

Click to enlarge

Our Launch Partners
We are proud to announce integrations with the following leading storage providers:

Click to enlarge

MinIO — General Availability
MinIO AIStor is the bridge that seamlessly connects the Databricks Data Intelligence Platform with enterprise data that can’t move to the cloud. By natively implementing the open Open Sharing protocol at the storage layer, AIStor eliminates complexity and enables Databricks customers to efficiently query live on-premises Apache Iceberg™️ and Delta tables under full Unity Catalog governance. It extends Serverless Compute, Genie, and Agent Bricks to on-premises data, bringing the full power of the Databricks Platform to an enterprise’s most critical data.

“AI and analytics initiatives are often constrained by where data resides, particularly in environments with strict security, sovereignty, or operational requirements. By bringing native OpenSharing to AIStor, we’re enabling organizations to securely expose data where it lives while giving Databricks seamless access through open standards. This removes a major barrier between enterprise data and AI, allowing organizations to activate previously inaccessible data for AI, analytics, and agentic applications without compromising control,” said Ugur Tigli, CTO, MinIO.

Everpure (formerly Pure Storage) — Private Preview
Everpure and Databricks enable organizations to use on-prem data directly in the cloud removing the need for data replication or duplication.This is delivered through an OpenSharing connector that bridges data in object storage with databricks core workspaces in a secure and gated manner.

“Everpure and Databricks enable organizations to access and analyze on-premises data directly from the cloud without the need for replication or duplication. Continuously moving data between environments is costly and unsustainable at scale. Customers are looking for a simpler approach that balances cost, compliance, and data sovereignty while reducing operational complexity,” said Chadd Kenney, VP, product management, Everpure.

Qumulo — Private Preview in July 2026
Qumulo has integrated OpenSharing with its new NeuralSearch, allowing customers to securely share Qumulo-stored data with Databricks across core, cloud, and edge environments—without replication, extra costs, or complexity. Using NeuralSearch, users can discover relevant datasets, including unstructured content, via natural-language queries and seamlessly share those curated tables with Databricks via OpenSharing.

“Organizations can no longer afford the cost, complexity, and delays of copying massive datasets across environments just to support AI and analytics. By combining Qumulo NeuralSearch with Databricks OpenSharing, customers can securely discover, govern, and share both tabular and unstructured data across core data centers, edge locations, and public clouds – in real time, without moving the data itself. Together, we’re helping organizations accelerate AI initiatives, unify governance, and unlock faster time-to-insights from globally distributed data while maintaining a single source of truth,” said Brandon Whitelaw, SVP, head, product, Qumulo.

Vast Data — Private Preview in August 2026
Vast Data is extending the Vast AI Operating System with OpenSharing support to help enterprises bridge Databricks workflows with data that resides across on-premises and hybrid infrastructure – without requiring massive data movement or migration. The integration will give customers more flexibility to access, process and operationalize data across cloud, data center and emerging AI infrastructure environments while supporting modern hybrid AI and analytics workloads.

“AI infrastructure is becoming fundamentally hybrid. Customers increasingly want the ability to process data wherever it makes the most sense economically and operationally, while still maintaining seamless access across environments. OpenSharing support extends the Vast AI Operating System’s ability to bridge Databricks workflows with data that resides across cloud and on-premises infrastructure for modern AI and analytics applications. Unlike traditional storage platforms, Vast combines data services, distributed processing and AI infrastructure orchestration into a unified operating system for AI data at scale,” said John Mao, VP, global technology alliances, Vast Data.

What’s Next

Integrations Coming Soon
In addition to our launch partners, momentum across the storage ecosystem continues to accelerate. We have secured commitments from Cohesity, Commvault, HPE, NetApp, Nutanix, and Rubrik —to build native integrations by the end of the year.

Collectively, these partners, along with launch partners, manage hundreds of exabytes of enterprise data, spanning high-performance unstructured media, secondary backup archives, cost-effective cloud storage, and hyperconverged private cloud estates. 

Unlocking Unstructured Data
Today’s launch establishes structured, tabular data as fully governed and accessible across this ecosystem. But we know that exciting opportunity lies ahead in unstructured data: the images, PDFs, videos, medical scans, engineering simulations, and backup archives that represent the majority of enterprise data under management — and the raw material for the next generation of RAG pipelines and fine-tuned models.

We are actively working to extend the OpenSharing protocol with Volumes APIs — exposing unstructured files from on-premises storage directly to Databricks for GenAI workloads. With this coming, partners managing massive unstructured estates — from media and imaging archives to enterprise backup repositories — will unlock an entirely new class of AI use cases for their customers.

This is what it means to govern everything.

The era of “Migrate Everything” is over. The era of “Govern Everything” starts today.