Try harder to remove extra files.