Y

Data · Skills roadmap

Data Engineer projects

Build the pipelines, warehouses and streams that every analyst, data scientist and AI system depends on.

  • 32 to 52 weeks to job-ready, part time
  • 74 lessons across 21 skills
  • 12 portfolio projects

86 lessons and projects. Progress saves in this browser.

Start the roadmap

Beginner

4 projects
  1. 1Data cleaning and quality · SQLNYC taxi demand in SQL8 h · 2 datasets
  2. 2ETL and data pipelines · Python · REST APIs and HTTPAPI to data lake ingestion10 h · 1 dataset
  3. 3Data cleaning and quality · Data modelling · SQLRetail star schema in SQL10 h · 1 dataset
  4. 4Data cleaning and quality · Python · SQLMonthly data quality report for taxi trips8 h · 1 dataset

Intermediate

4 projects
  1. 1Data modelling · Data warehousing and dbt · Git and GitHubTaxi analytics marts with dbt16 h · 2 datasets
  2. 2Apache Airflow and orchestration · Data cleaning and quality · ETL and data pipelinesOrchestrated monthly pipeline with Airflow14 h · 1 dataset
  3. 3Data warehousing and dbt · Python · Apache SparkA year of taxi trips in Spark16 h · 2 datasets
  4. 4Data cleaning and quality · Data modelling · Data warehousing and dbtMarketplace warehouse with history18 h · 1 dataset

Advanced

4 projects
  1. 1Data cleaning and quality · ETL and data pipelines · Power BIAutomated taxi operations pipeline and dashboard24 h · 2 datasets
  2. 2ETL and data pipelines · Kafka and event streaming · Monitoring and observabilityReal-time taxi demand stream24 h · 1 dataset
  3. 3Data modelling · Data warehousing and dbt · ETL and data pipelinesIncremental warehouse loads with late and corrected data20 h · 1 dataset
  4. 4Cloud platforms (AWS, Azure, Google Cloud) · Data warehousing and dbt · ETL and data pipelinesA small cloud data platform on a budget24 h · 2 datasets