Force remove old keys