Remove the CNAME temporarily