Apache Spark · Advanced · 6 h

Joins, shuffles and skew

Read physical plans, choose broadcast joins, size shuffle partitions and handle skewed keys.

Why employers care: Slow or failing Spark jobs cost real cluster money. Senior data engineers are expected to diagnose them from the plan.

In the roadmaps for: Data Engineer