plugins/ban_manager: fix some case issues in unbanning