Set correct permissions on private keys