Fully build out the LayoutTree