Latest Articles

Hidden Pitfalls – Compaction and Partition Evolution in Apache Iceberg

Hidden Pitfalls – Compaction and Partition Evolution in Apache Iceberg

Partition evolution in Apache Iceberg is a powerful feature, but if not managed carefully, it can introduce fragmentation and impact compaction performance. Learn how to handle it effectively.

Read more
Using Iceberg Metadata Tables to Determine When Compaction Is Needed

Using Iceberg Metadata Tables to Determine When Compaction Is Needed

Discover how to use Apache Iceberg's metadata tables to proactively detect small files, bloated manifests, and table fragmentation - so you can trigger compaction only when it's needed.

Read more
Designing the Ideal Cadence for Compaction and Snapshot Expiration

Designing the Ideal Cadence for Compaction and Snapshot Expiration

Learn how to design an effective schedule for compaction and snapshot expiration in Apache Iceberg to balance cost, performance, and data freshness.

Read more
Avoiding Metadata Bloat with Snapshot Expiration and Rewriting Manifests

Avoiding Metadata Bloat with Snapshot Expiration and Rewriting Manifests

Learn how to prevent and clean up metadata bloat in Apache Iceberg by expiring snapshots and rewriting manifests for better performance and manageability.

Read more