Temporarily delete CNAME file