Getting Back Up to Speed on Spark Shuffling

An interview question about Spark shuffling sent me back to basics after five years away. I built a runnable Databricks demo covering shuffles, joins, skew, AQE, and Photon — here&rsquo;s what I relearned and what&rsquo;s changed.