Remove the old key first