Fix crash when we kill users because of a double free