Patent ID: 11954144
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 13:
14. The computer-implemented method of claim 8, further comprising:
receiving an image and a query phrase;
inputting the image and the query phrase into the trained visual language grounding model and a separately trained detector-based model;
receiving a first heatmap associated with the image for the query phrase from the trained visual language grounding model;
receiving a bounding box with a bounding box score for the query from the separately trained detector-based model;
converting the bounding box score into assigned values for pixels in the bounding box to generate a second heatmap for the image; and
combining the first heatmap and the second heatmap to generate a combined heatmap for the query and the image.