Delete all files that might show password setting