Get the latest tech news

Adding concurrent read/write to DuckDB with Arrow Flight


Definite: duck-takes-flight is a simple example of streaming and concurrent read/write with duckdb and Apache Arrow Flight

DuckDB is amazing for "single player" analytics, but it has a couple serious limitations that prevent it from being used in more traditional data workflows. If you're building something that needs to move data around quickly and query it on the fly - especially if you need concurrent access that DuckDB doesn't provide - this approach is worth exploring. We're taking this same philosophy - making powerful data tools simple and accessible - and applying it to the entire analytics stack.

Get the Android app

Or read this on Hacker News

Read more on:

Photo of DuckDB

DuckDB

Photo of Arrow Flight

Arrow Flight

Photo of concurrent read

concurrent read

Related news:

News photo

Should you ditch Spark for DuckDB or Polars?

News photo

Thoughts on DuckDB's Crazy Grammar Thing

News photo

DuckDB over Pandas/Polars