Prefill the validation set when restarting a checkpoint.  Fix key comparison during sanity checking.