Combine model matrices of a child segment and parent segments.