Spark Shuffle, the good and the bad

0Sign in to vote or save

This site does not allow itself to be embedded. You can still read it on the original site — the toolbar below keeps your place in the directory.

Shuffling is a fundamental operator for transferring data between stages (and nodes) in Apache Spark. It was already a cornerstone of the…

Comments

Nothing yet. Say the first thing.