Check if object has been destroyed when destrying the wrapper server