Y

Data warehousing and dbt · Intermediate · 5 h

How warehouses store and scan data

Columnar formats, compression, partitioning and clustering, measured on real data.

Why employers care: Warehouses bill by data scanned or compute time. Engineers who design tables well save their companies real money.

In the roadmaps for: Data Engineer

Lessons, in order

  1. Columnar storage, partitions and clusteringThe same 3.5 million trips as CSV and Parquet: six times smaller and fifty times faster to query. Then sort for another boost.3 min

Next shelf: Tested transformations with dbt