Software & Apps

Databricks Announces OpenSharing, Data Sharing Protocol, AI Assets

Databricks announced the launch of OpenSharing, a new open source protocol designed to change the way organizations share artificial intelligence assets and data. Developed as the next version of the Delta sharing protocol, OpenSharing is now a project under the Linux Foundation.

Delta Sharing, launched by Databricks in 2021, focuses on open data sharing across platforms. OpenSharing extends that foundation to cover AI-era assets like agent capabilities and AI models, adds support for Apache Iceberg IRC clients, and enables on-premise and private cloud data sources to connect directly to cloud platforms without data movement.

The protocol comes at a time of transition to agent AI, where autonomous systems require easy access to tools and information. By making the protocol open source, Databricks aims to create a universal industry standard.

“Delta Sharing has shown that the industry will choose to open up in a closed environment,” said Matei Zaharia, Co-founder and CTO of Databricks. “OpenSharing extends that goal to the full AI stack, while extending the cross-platform ecosystem to Iceberg recipients and local providers. The agency era deserves an open foundation, and OpenSharing delivers it.”

Sharing AI Assets Across Organizations

A major feature of OpenSharing is its ability to manage AI models and agent capabilities. Previously, companies had to build custom integrations or use specific marketplaces to share these tools. This often led to high costs and technical barriers.

With OpenSharing, enterprises can publish agent capabilities through a single protocol. Partners can find and access these assets using standard APIs. This “zero-copy” approach means that data and models do not need to be moved or copied, which improves security and efficiency.

OpenSharing also addresses the issue of vendor lock-in to structured data. While the original Delta sharing protocol allows collaboration across several platforms such as Spark, Oracle, and Snowflake, OpenSharing adds support for Apache Iceberg APIs.

This expansion allows data providers to reach a wider audience. Companies using native Iceberg tools can now access shared data through the same protocol used by the entire ecosystem. This makes it easier for providers to publish their data once and reach users on different platforms.

“We believe in open AI ecosystems and are excited to partner with Databricks in providing a common, secure way to find and authorize access to AI assets,” said Alexander Embiricos, Head of Business Product at OpenAI.

It connects Cloud AI to local data

For many organizations, moving sensitive data to the cloud is not an option due to regulations or security concerns. OpenSharing offers native integration with local storage partners like MiniO and Qumulo.

This integration allows cloud-based AI and analytics platforms to connect directly to locally stored data. This gives companies the ability to use modern AI tools without handing over their data. Several other partners, including NetApp and Dell, are expected to add support in the future.

The project is currently available to the public. Interested developers and organizations can access the OpenSharing protocol on GitHub or visit the project’s official website to learn more about implementation.

Related Articles

Leave a Reply

Your email address will not be published. Required fields are marked *

Back to top button