Calculate extrema when checking segment bounding boxes