Temprorarily remove recoverable passwords