Die early if num_folds != 2 (for now).