Make sure domain+host overrides are deleted