Tag: Data Engineering
All the articles with the tag "Data Engineering".
Partition and Organize Data for Performance
Published: at 03:00 PMA table with 500 million rows takes 45 seconds to query. After partitioning it by date, the same query — filtering on a single day — returns in 2 seconds. Th...
Data Modeling for Analytics: Optimize for Queries, Not Transactions
Published: at 03:00 PMThe data model that runs your production application is almost never the right model for analytics. Transactional systems are designed for fast writes — inse...
Data Virtualization and the Semantic Layer: Query Without Copying
Published: at 03:00 PMEvery data pipeline you build to move data from one system to another costs you three things: time to build it, money to run it, and freshness you lose while...