Compare only as IPv6 as IPv4 address are often mapped to IPv6 addresses