Yes you need to "materialize" the socket with `WSASocket`, then close it with `CloseSocket`.