Spark Under the Hood to Partitioning and Caching kept pointing at the Spark 129 UI and at explain(). This section reads them on purpose: one application runs three BookNest workloads, a healthy aggregate, a skewed join and a cache, and the UI shows the difference.
MENU
Spark UI and Plans
Reading the Spark UI and Execution Plans