Patent ID: 9547938
Date: 2017-01-17
CPC Classifications: G06F,G06K,G06Q,G06T

Claim:
1. A computer-implemented method for augmenting an image or a stream of images of a product captured and displayed with associated content, comprising: capturing at least one image in a stream of images of the product using an image capturing element of an electronic device operated by a user to form a captured at least one image; displaying the captured at least one image on a display element of the electronic device; determining one or more features defining a representation of the product in the captured at least one image; determining that the one or more features includes at least one of barcode data or text; matching the one or more features to features defining a plurality of items stored in an item repository; determining a match to identify a matched item; retrieving content associated with the matched item from the item repository; determining a plurality of corners of the product, the determining for the plurality of corners by extracting interest points on the at least one image and performing a feature extraction from the interest points; determining a bounding box that includes the representation of the product based on the plurality of corners; determining a perspective distortion associated with the bounding box; determining that the perspective distortion at least does not exceed a predetermined distortion threshold; and displaying the retrieved content in an overlay element on the display element of the electronic device within the bounding box such that the overlay element augments the image of the product displayed on the display element of the electronic device, the retrieved content representing selectable content enabling the user to provide an indication to purchase the product being augmented by the overlay element.