Don't check validity of ipv4 when trying to add address that already exists.

Code checking validity only works for ipv6. So we only return True.