always remove a handler in fancylogger on logtox(false)