allow remove_key to fail if we had an exception before