The authorized_keys file permissions need to be right ...