Patent ID: 11971955
Assignee: AMAZON TECHNOLOGIES, INC.
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A computer-implemented method of annotating images, comprising:
receiving, by a first convolutional neural network (CNN), a query image representing a first depiction of an object-of-interest;
generating, by the first CNN, first feature data representing the first depiction of the object-of-interest;
receiving, by a second CNN a target image representing a scene in which a second depiction of the object-of-interest is visually represented, at least in part;
generating, by the second CNN, second feature data representing the target image;
determining, using the first feature data and the second feature data, an emphasized representation of the target image using the first feature data and the second feature data, the emphasized representation of the target image encoding a similarity between portions of the target image and the first depiction of the object-of-interest in the query image;
inputting the emphasized representation of the target image into a transformer-based model;
determining, by the transformer-based model using the emphasized representation of the target image and positional embeddings, a location of the second depiction of the object-of-interest in the target image;
generating an annotated image comprising the target image with a bounding box surrounding a portion of the scene that includes the second depiction of the object-of-interest; and
generating a label classifying the second depiction of the object-of-interest.