Switch from reducers to map at last stage for better memory usager, may need to partition and pmap