Validate if src OR dst have IP address set when protocol is IPv4+v6. Fixes #3499