handle empty colorby list and remove flags