Updated default shuffling behavior for training and cross-validation

This pull request implements the solution proposed in #190 
I feel like maybe this should be at the warning level, because when most people run `run_experiment`, they don't see info-level stuff. 

@mheilman what do you think?