Get the latest tech news
Putting DuckDB in Postgres to Query Iceberg
ing DuckDB in Postgres to Query Iceberg Written by Ming Ying on June 26, 2024 Today, a growing number of organizations are offloading large volumes of historical data from Postgres to S3 due to its scalability and cost effectiveness. Many of these organizations are also adopting Apache Iceberg, a table format that enables S3 data to be queried like SQL tables.
Today, a growing number of organizations are offloading large volumes of historical data from Postgres to S3 due to its scalability and cost effectiveness. Iceberg metadata allows these files can be treated as SQL tables with features like ACID transactions, schema evolution, time travel, and partitioning. The next big feature we’re working on for pg_lakehouse is write support, which will enable Postgres tables to be copied into external object stores as Parquet or CSV files.
Or read this on Hacker News
