Cleaner Pre-training algorithm