Iceberg FYI

Verified test results for 100+ combinations of tools in the Apache Iceberg ecosystem

Query Engine

The service that runs your SQL queries

Catalog

The Iceberg Catalog that manages your tables

Object Store

The storage backend for your tables

Select your stack

Or see a random one: 🎲

AWS S3 SDK update breaks compatibility with S3-compatible services

insight 2025-02-20

AWS recently introduced default data integrity protections with strong integrity checksums in their S3 SDKs, which has broken compatibility with nearly all S3-compatible services including pre-2025 Minio, Vast, Dell EC, Cloudflare R2, and Tigris. The Apache Iceberg community has raised a PR to disable these checksums, and Trino project also had to temporarily disable the checks after receiving error reports. Turns out reusing AWS SDKs is probably not a good idea.

Read more

Access Iceberg tables in S3 Tables using PyIceberg and AWS Glue

tutorial 2025-02-17

AWS now offers Iceberg REST support for AWS Glue catalogs and with S3 Tables. They wrote a nice tutorial showing how to use PyIceberg (the official Python client for Iceberg) to create, query, and update tables stored in S3 Tables.

Read more

Snowflake supports S3-compatible object stores, with review

insight 2025-02-05

It looks like Snowflake has added support for S3-compatible object stores, but you'll need to have their support team review your request first. The review process took less than 24 hours in our experience.

Read more

Nessie Collaborating with Polaris

news 2024-08-02

The Nessie team has announced they'll be collaborating with Polaris to contribute to the Polaris project. They specifically mention that like Catalog Level Versioning, Git-like semantics, multi-table transaction semantics to Polaris.

Read more

Built with ❤️ by Census Logo Census