Don't try to DESTROY if socket closed.