Unconditionally remove all existing handles.

debug_toolbar likes to sneak in a 'ThreadTracker' or something, but because
this means we have a root handler, we never actually setup our own logging.