Fixed issue with build flow view not displaying all parents.

Also made it so parents without builders don't get a toggle-button for a
block/list that would be empty anyway.