Reverted fix for LIBZMQ-504

This reverts commit a87aed284e10accc88456498d231628d84d41f6a.
Causes an assertion failure: s != retired_fd (tcp_connecter.cpp:271)