Commander::App should not notify deps of new config during boot up

In that phase, we're simply rewriting the existing config files before
other processes have been started.