Strengthen UDPListener against post-close shenanigans