ENH: place annex into --debug mode as well if log level is <= 5