Remove hosts entry after the dns entry has been set