Tag:Apache Spark

Articles tagged "Apache Spark".

• 27 MIN READ•May 22, 2026

  Iceberg MERGE INTO in Spark: Upserts, Copy-on-Write vs MoR

  Run Iceberg MERGE INTO, UPDATE, and DELETE in Spark with Iceberg 1.12.0, pick copy-on-write or merge-on-read per operation, and evolve schemas without rewrites.

  apache sparkapache icebergdata engineering
• 31 MIN READ•Aug 25, 2026

  DataFusion Comet 1.0 and What Native Rust Scans Change for Spark on Iceberg

  DataFusion Comet 1.0 replaces Spark Iceberg scans with native Rust. What speeds up, what still falls back to the JVM, and how to deploy it.

  Apache IcebergApache SparkDataFusion Comet
• 24 MIN READ•May 22, 2026

  Maintaining Apache Iceberg Tables: Compaction, Snapshot Expiration, and Orphan File Cleanup

  An in-depth guide to orchestrating maintenance operations on Apache Iceberg tables, covering bin-packing, sort-based, Z-Order compaction, snapshot.

  Apache IcebergCompactionData Engineering