Restructured LabelGraphBuilder a bit.