Remove old public keys, add new ones