Revert "Delete config file before renaming tmp file on Windows"

This reverts commit 01539da63a7e765de4b61509d7597db8139ac1b2.