Tag:Apache Iceberg
Articles tagged "Apache Iceberg".
- 33 MIN READ•Oct 28, 2026
Primary Keys Come to Apache Iceberg V4, and Most of Them Start Out Unenforced
Apache Iceberg V4 adds primary key, unique and check constraints, an enforced flag and per-snapshot status. What the spec says and how to prepare tables.
apache-icebergiceberg-v4data-quality - 30 MIN READ•Oct 27, 2026
Per-Developer Sandboxes on Apache Iceberg Branches: Lifecycle, Isolation Limits, and Cleanup
Give every developer and pull request a zero-copy Iceberg sandbox on branches: lifecycle, what branches do not isolate, and cleanup.
Apache Icebergbranchesdata engineering - 30 MIN READ•Oct 27, 2026
Inside the Iceberg REST Catalog's Multi-Table Commit Endpoint
How POST /v1/{prefix}/transactions/commit works: request shape, requirements, atomicity, error codes, idempotency, and limits.
Apache IcebergREST catalogtransactions - 31 MIN READ•Oct 27, 2026
Storing Quantized Embeddings in Apache Iceberg: Scalar 8-Bit Codes vs Product Quantization
How SQ8 and product quantization shrink Iceberg embedding columns 4x to 64x, how to store codes and codebooks, and what breaks.
Apache Icebergembeddingsquantization - 31 MIN READ•Oct 21, 2026
Iceberg Is Getting a Vector Type, and Parquet Decides What It Looks Like
Iceberg's proposed vector type enforces fixed dimension, non-null, and finite values. What it promises, how Parquet shapes it, and what to do now.
Apache Icebergvector typeembeddings - 31 MIN READ•Oct 21, 2026
What Vortex Has to Prove Before Iceberg Adds a Fourth File Format
The Vortex proposal split into criteria and candidate. What field IDs, statistics, governance, and ecosystem support a new Iceberg file format must prove.
Apache IcebergVortexParquet - 31 MIN READ•Oct 21, 2026
How to Choose Between Partitioning, Sort Orders, and Z-Order in Apache Iceberg
Partitioning, sort orders, and Z-order each cluster Iceberg data differently. Compare the costs, the failure modes, and how to measure layout with data_files.
Apache IcebergpartitioningZ-order - 31 MIN READ•Oct 21, 2026
Choosing Self-Hosted Object Storage for the Lakehouse After MinIO
MinIO's community edition is archived. Compare RustFS, SeaweedFS, Ceph, and Garage against what Iceberg actually needs, then test and migrate.
object storageMinIORustFS - 43 MIN READ•Sep 23, 2025
Data Lakehouse Guide 2026: Architecture and Ecosystem
What a data lakehouse is and how it works: Iceberg, Delta, Hudi, and Paimon table formats, the five core layers, catalogs, ingestion, and optimization.
Data LakehouseData EngineeringAgentic AI - 23 MIN READ•Sep 24, 2025
Open Table Formats Compared: Iceberg, Delta, Hudi, Paimon
Apache Iceberg, Delta Lake, Hudi, Paimon and DuckLake compared: metadata design, row-level updates, engine support, and when to choose each table format.
Data LakehouseData EngineeringAgentic AI - 28 MIN READ•May 22, 2026
Iceberg Catalogs Compared: REST, Glue, Hive, Polaris, Nessie
Iceberg catalogs track each table's current metadata file and make commits atomic. Compare REST, Glue, Hive, Nessie, Polaris, S3 Tables, and Snowflake Horizon.
apache icebergcatalogsNessie - 27 MIN READ•May 22, 2026
Iceberg MERGE INTO in Spark: Upserts, Copy-on-Write vs MoR
Run Iceberg MERGE INTO, UPDATE, and DELETE in Spark with Iceberg 1.12.0, pick copy-on-write or merge-on-read per operation, and evolve schemas without rewrites.
apache sparkapache icebergdata engineering