Avoid walking whole setting scope at startup.

This should deal with another thing that forces deserialization of all
things in the setting whether they're needed or not. Helps a little,
but probably there are further "leaks" that could be cleared up.