Remove the least important of the authorized ssh keys