Refactored and moved code into utils module. Caching improvements for comparing files. check_dir_contains_files accepts a percentage to start from/resume