Fix exception in SocketWrapper when WebSocketServer.Dispose() is called.

Fixes #82.

I saw some other that might be affected by this, i.e. #85.