Fix issue with datagram local address not being set properly