--

Hi Mehdi,

What I meant was Skew does not cause Shuffle directly, Skew might lead to repartition which in turn will cause shuffle.

--

--

Amit Singh Rathore
Amit Singh Rathore

Written by Amit Singh Rathore

Staff Data Engineer @ Visa — Writes about Cloud | Big Data | ML

Responses (1)