cluster: don't assert if worker has no handles

For shared (non-round-robin) handles (UDP, and all handles on Windows),
cluster must not assume that workers are completely symetric, in that if
one listens or binds to a port, every worker listens or binds to that
port.