imuxsock: handle unlimited number of additional listen sockets

At the same time, (very) slightly remove memory footprint when
few listeners are monitored.