Leave old App.config in place