Check if the family is neither v4 or v6