How about only adding the debug toolbar and staticfiles apps if there's an explicit USE_DEBUG_TOOLBAR (or similar) setting set to True?