Posts - Page 21
All the articles I've posted, page 21.
- 30 MIN READ•Jul 6, 2026
The State of Streaming to Apache Iceberg in July 2026: Every Path, Its Latency, and What to Do When Seconds Are Not Fast Enough
Every path for streaming data into Iceberg in 2026, Flink, Spark, Kafka Connect, broker-native, managed pipelines, with honest latency numbers.
Apache Icebergstreamingdata engineering - 16 MIN READ•Jul 6, 2026
High-Performance Columnar Transfers: Combining Apache Arrow Flight and Iceberg REST Catalogs
How Iceberg REST catalogs run the control plane and Arrow Flight runs the data plane, plus the security, performance, and lock-in tradeoffs of pairing them.
arrow flighticeberg rest catalogcolumnar transfers - 29 MIN READ•Jul 6, 2026
Block vs. Object Storage: A Deep Dive Into the Foundation of Modern Data, and How the Lakehouse Made the Slow Option Fast
Why analytics moved to slower object storage and got faster: how Parquet, Iceberg, and modern engines hide S3 latency, plus a guide to placing each workload.
data lakehousestoragearchitecture - 16 MIN READ•Jul 6, 2026
The Buyer's Scorecard for Agentic Analytics: Evaluating Tooling in the Enterprise AI Era
An eight-category scorecard for judging agentic analytics tools: semantic grounding, governance, validation, action controls, cost, and pilot questions.
agentic analyticsenterprise aievaluation - 15 MIN READ•Jul 6, 2026
Building Closed-Loop Decision Agents: Moving from Passive BI Dashboards to Active Goal-Directed Workflows
How to build decision agents that observe signals, validate evidence, and act within approved limits, using metric contracts, risk tiers, and human approval.
ai agentsdecision agentsworkflows - 15 MIN READ•Jul 6, 2026
Decoupled Catalogs vs. Managed Tables: Architectural Freedom in the Age of Table Format Convergence
A decision matrix for choosing between managed tables and decoupled catalogs for Iceberg, covering credentials, optimization, engine choice, and hybrid setups.
catalogstable formatsarchitecture - 26 MIN READ•Jul 6, 2026
Designing Your Own AI Harness: A Deep Dive Into the Architecture of Agent Loops, Tools, Context, and Control
A deep dive into custom AI harness architecture: model layers, tool design, context management, permissions, control budgets, persistence, orchestration.
AI agentsagent architectureMCP - 26 MIN READ•Jul 6, 2026
Deterministic Data Engineering With AI Harnesses: Using Claude Code, Codex, Antigravity, and OpenCode for Data Work You Can Actually Trust
How to use AI agent harnesses for data engineering without losing determinism, reproducibility, and trust in your data pipelines and analytics.
data engineeringAI agentsClaude Code - 17 MIN READ•Jul 6, 2026
Preparing Your Data Lakehouse for the EU AI Act: Auditable Lineage and Data Provenance
How lakehouse lineage, provenance, audit logs, and agent identity help you prepare for the EU AI Act, with a readiness checklist. Technical, not legal, advice.
eu ai actcompliancedata lakehouse - 28 MIN READ•Jul 6, 2026
Federation and the Lakehouse: Two Roads to Unified Data Access, and How to Know Which One to Take
When to federate queries across sources and when to consolidate into an Iceberg lakehouse, with pushdown mechanics, cost math, and a federate-first pattern.
data federationdata lakehouseunified access - 27 MIN READ•Jul 6, 2026
A Deep Dive Into File Compression: How Data Gets Smaller, Why Codecs Differ, and What to Actually Use in the Lakehouse
How compression codecs work, why Zstandard became the default, how encodings differ from codecs in Parquet, and which codec to pick for each lakehouse workload.
file compressioncodecsparquet - 27 MIN READ•Jul 6, 2026
The File Format Renaissance: Parquet, Lance, Vortex, Nimble, BtrBlocks, and the New Physics of Columnar Storage
How Parquet, Lance, Vortex, Nimble, and BtrBlocks differ in encodings and point-lookup speed, and which columnar file format fits which workload in 2026.
parquetlancevortex