Get the latest tech news

Databricks open-sources Unity Catalog, challenging Snowflake on interoperability for data workloads


Datbricks' Unity Catalog OSS supports data in any format, including Iceberg and Delta/Hudi (via UniForm) as well as Parquet, CSV and JSON.

Essentially, they would be able to use the information hosted in the catalog with their preferred tools of choice, including a large ecosystem of Delta Lake and Apache Iceberg-compatible query engines. Databricks launched Unity Catalog as a proprietary, closed-source governance solution for accessing and managing data and AI assets within its platform ecosystem. The offering, which went into general availability a couple of weeks ago, automatically generates the metadata needed for Apache Iceberg or Hudi and unifies the table formats into a single copy that can be queried from any supporting engine.

Get the Android app

Or read this on Venture Beat

Read more on:

Photo of Databricks

Databricks

Photo of interoperability

interoperability

Photo of Unity Catalog

Unity Catalog

Related news:

News photo

Databricks launches LakeFlow to help its customers build their data pipelines

News photo

Databricks expands Mosaic AI to help enterprises build with LLMs

News photo

Databricks' $1B Tabular buy raises questions around table format wars