Need to make authorized_keys only readable by user.