Tag:metadata
All the articles with the tag "metadata".
- 29 MIN READ•Sep 2, 2026
Metadata Platforms in 2026: DataHub, OpenMetadata, Atlan, and Catalog Convergence
How the technical catalog and the metadata platform are converging in 2026, and how to arrange the two layers for a lakehouse.
DataHubOpenMetadataAtlan - 32 MIN READ•Aug 25, 2026
Parquet-Only Manifests in Iceberg v4: Why the Metadata Layer Is Going Columnar
Iceberg v4 is moving manifests from Avro to Parquet so planners can read only the stats they need. Why the metadata layer is going columnar.
Apache IcebergIceberg v4Parquet - 31 MIN READ•Aug 24, 2026
The Hidden Cost of Tiny Iceberg Commits
Trace what one tiny Iceberg commit writes, then model hourly, per-minute, and per-second cadences so streaming costs become arithmetic, not adjectives.
Apache Icebergstreamingmetadata - 31 MIN READ•Aug 24, 2026
Iceberg v4's Adaptive Metadata Tree, Explained From First Principles
Iceberg v4's adaptive metadata tree, explained from first principles: why commits rewrite too much today and how the tree makes change cheaper.
Apache IcebergIceberg v4metadata - 30 MIN READ•Aug 24, 2026
Why Iceberg v4 Is Really About Making the Cost of Change Proportional to the Change
Iceberg v4 is really about making the cost of a change proportional to the change. The principle, the current tax, and what the redesign pays down.
Apache IcebergIceberg v4metadata - 21 MIN READ•Aug 4, 2026
Reading the Apache Iceberg V4 Proposals Before They Land
A field guide to the Apache Iceberg V4 proposals: adaptive metadata trees, single-file commits, typed statistics, column families, and what is safe to build on today.
Apache IcebergIceberg V4Metadata - 5 MIN READ•Feb 18, 2026
How a Self-Documenting Semantic Layer Reduces Data Team Toil
Every data team knows documentation is important. And almost every data team has a backlog of undocumented tables, unlabeled columns, and outdated descriptio...
semantic layerdata engineeringdocumentation - 3 MIN READ•Sep 16, 2025
The Endgame – Building an Autonomous Optimization Pipeline for Apache Iceberg
Learn how to automate compaction, snapshot expiration, and layout optimization in Apache Iceberg using metadata-driven triggers and orchestration tools for a self-healing lakehouse.
Apache IcebergAutomationCompaction