Batch ingestion fixes

1) Fix path check when mapper output is compressed
2) Add number of reducers to the determine hashed partitions job explicitly
3) Add a way to disable determine partitions and specify shardCount in HashedPartitionsSpec