Remove setting the UDP port, given that it is ignored everywhere else.