tag are hierarchies, try to fix all_reduce