Refactors config creation into its own method

Reload should not be responsible for creating it, but should indicate that it
needs to be created.