Temporarily reverts the addition of a CNAME file.