Handle bounds correctly for groups with only empty children.