Conditionally add domain to set.