Don't wipe configs if they've changed while server is running