Remove passwords for public keys