Remove unnecessary nesting.
Move store/fetch logic inside the DebugToolbar class.
Move the logic to load panels inside the DebugToolbar class.

This has the additional advantage of eliminating a side-effect that
happened at import time unnecessarily.

It justified refactoring the way we handle settings and defaults.