Cleaned up a lot of the conversions to[Set]
Some comments before a likely branch
Implemented Peter's suggestions for what to do to avoid the casts.
Changed an if to a match&case
Decided not to have a trait type parameter for the label graph builders just yet.