Tag:Parquet

Articles tagged "Parquet".

• 31 MIN READ•Oct 21, 2026

  Iceberg Is Getting a Vector Type, and Parquet Decides What It Looks Like

  Iceberg's proposed vector type enforces fixed dimension, non-null, and finite values. What it promises, how Parquet shapes it, and what to do now.

  Apache Icebergvector typeembeddings
• 31 MIN READ•Oct 21, 2026

  What Vortex Has to Prove Before Iceberg Adds a Fourth File Format

  The Vortex proposal split into criteria and candidate. What field IDs, statistics, governance, and ecosystem support a new Iceberg file format must prove.

  Apache IcebergVortexParquet
• 32 MIN READ•Aug 25, 2026

  Parquet-Only Manifests in Iceberg v4: Why the Metadata Layer Is Going Columnar

  Iceberg v4 is moving manifests from Avro to Parquet so planners can read only the stats they need. Why the metadata layer is going columnar.

  Apache IcebergIceberg v4Parquet
• 31 MIN READ•Aug 24, 2026

  Variant Shredding Explained: How Iceberg Gets Columnar Performance From Messy JSON

  Variant shredding turns messy JSON into Parquet columns with statistics. How the layout works, how readers reassemble values, and why some queries prune.

  Apache IcebergVariantParquet
• 20 MIN READ•Aug 4, 2026

  A Migration Playbook for Moving Legacy Warehouses onto Apache Iceberg

  A dependency-first playbook for migrating legacy warehouses onto Apache Iceberg: snapshot vs migrate vs add_files, four-level parity validation.

  Apache IcebergMigrationData Warehouse
• 31 MIN READ•Jul 28, 2026

  The Parquet Versioning Problem, and Why Iceberg Cares About It

  Parquet files have a version field that doesn't reliably signal feature requirements. A new versioning discipline is coming, borrowing from Iceberg's.

  ParquetApache IcebergData Engineering
• 27 MIN READ•Jul 6, 2026

  A Deep Dive Into File Compression: How Data Gets Smaller, Why Codecs Differ, and What to Actually Use in the Lakehouse

  How compression codecs work, why Zstandard became the default, how encodings differ from codecs in Parquet, and which codec to pick for each lakehouse workload.

  file compressioncodecsparquet
• 27 MIN READ•Jul 6, 2026

  The File Format Renaissance: Parquet, Lance, Vortex, Nimble, BtrBlocks, and the New Physics of Columnar Storage

  How Parquet, Lance, Vortex, Nimble, and BtrBlocks differ in encodings and point-lookup speed, and which columnar file format fits which workload in 2026.

  parquetlancevortex