added a flag to remove invalid files (files with huge file paths). There's really no other solution at the moment, so we're just going to have to live with it