Get the latest tech news

Open sourcing Dicer: Databricks's auto-sharder


Open sourcing Dicer, Databricks’ auto sharder. Learn why auto sharding matters, how Dicer works, and how it keeps Unity Catalog and SQL fast through restarts.

None

Get the Android app

Or read this on Hacker News

Read more on:

Photo of Databricks

Databricks

Photo of Open sourcing Dicer

Open sourcing Dicer

Photo of sharder

sharder

Related news:

News photo

Databricks' Instructed Retriever beats traditional RAG data retrieval by 70% — enterprise metadata was the missing link

News photo

CEO Ali Ghodsi of a $134 billion software giant analytics firm Databricks, blasts companies with billions in funding but zero revenue: "That's clearly a bubble, right… it's, like, insane"

News photo

All about Parameters and Widgets in Databricks Workflows (2024)