Use hadoop to avoid collisions, and semishuffle them