This code basically just lift's Pig's code, which doesn't use the Hadoop CombineFileInputFormat implementation either. I feel further refinement can be in a future PR.