Use hadoop sort and shuffle to randomize the collisions
Merge pull request #248 from NICTA/experimental-shuffle4

Use hadoop to avoid collisions, and semishuffle them