Switching to LazyInit

This saves about 10 seconds on load.  If we end up writing the config it
will slow down again (for some things), but it's still faster than it
was.