Cross-validation is a fantastic tool, and definitely a sample of 20% is my default holdout. Is selecting that 20% a problem? Or can you just randomly sample (multiple holdout sets) of 20%?