Remove the CNAME until it's needed.