Y

Library · concept

Data warehousing and dbt

How analytical warehouses store and scan data, how to design tables for cost and speed, and how to build tested transformations with dbt.

Data warehousing appeared in 68% of the Data Engineer job descriptions we read, with Snowflake named in 34%. BigQuery, Redshift, Synapse and Databricks SQL share the same ideas: columnar storage, partitions, clustering and SQL transformations.

Everything here runs locally with DuckDB and the open-source dbt adapter for it, so the skills transfer directly to cloud warehouses without a bill.

  1. 1How warehouses store and scan dataColumnar storage, partitions and clustering3 min read
  2. 2Tested transformations with dbtA dbt project with sources, models and tests4 min read

Data warehousing and dbt lessons

Loading lessons…