fail gracefully when listen socket can't do IPv6

fixes bug introduced in 4857c99c7bbf85f28c490f7f74f387c7d6e01a08
(listen on ipv6 as well as ipv4)