Get the latest tech news
S3 Tables
AWS announced S3 Tables today, which brings native support for Apache Iceberg to S3. It’s hard to overstate how exciting this is for the data analytics ecosystem. This post is a quick rundown of my thoughts so far.
To read an Iceberg table, all you need is to do is parse a bit of metadata on S3 will tell you which Parquet data files to download and decode. So unless your OLAP system is written in Java or another JVM-based language, you’re basically out of luck if you wanted to write Iceberg tables. It’s early days, but when we build an Iceberg sink for Materialize, we’re planning to lean on S3 table buckets to handle compaction.
Or read this on Hacker News