Fixed data sampler to handle the case where we have no examples for certain categories in
either traing or test datasets.