Refactors config creation into its own method

Reload should not be responsible for creating it, but should indicate
that it needs to be created.