Don't be quite as eager about reloading config

It didn't make sense to conflate 'start' with 'reload-config' by always
reloading the config. Users may want to manually tweak the config at the
REPL and always reloading would prevent this.