Fix regression where listen on a UVServer failed