Patent Document ID: 9886678
Application ID: 14037121
Patent Status: 1

Claim One:
1. A method comprising: receiving, by a computer system, an image of a scene corresponding to a physical location captured by a camera on a client computing device and a time identifier indicating a time when the image of the scene of the physical location was captured by the camera on the client computing device; receiving, by the computer system, information relating to a location and orientation of the client computing device at the time when the image of the scene of the physical location was captured based on data generated by one or more sensor devices on the client computing device; receiving, by the computer system, an indication of a distance D between the physical location captured in the image and the location of the client computing device when the image was captured, the distance D measured by the one or more sensor devices that are operated on the client computing device; calculating, by the computer system, the location of the scene of the physical location captured in the image at the time the image was captured based on (1) the distance D between the physical location captured in the image and the location of the client computing device at the time the image was captured and (2) the location and orientation of the client computing device relative to the physical location when the image was captured, wherein the location of the scene of the physical location captured in the image is calculated by triangulating the location of the client computing device relative to the physical location captured in the image; retrieving, by the computer system, a planogram associated with the location of the scene of the physical location captured in the image and the time identifier, wherein the planogram defines an arrangement of objects in the physical location during a time range that includes the time identifier and the scene is a section of the planogram; generating, by the computer system, a graphic representation of the planogram, wherein the graphic representation of the planogram comprises images of the objects positioned relative to the image of the scene of the physical location; and transmitting, from the computer system, the graphic representation of the planogram to the client computing device for superimposing the section of the planogram onto the image of the scene of the physical location captured by the client computing device, wherein the graphic representation of the section of the planogram that is superimposed over the image of the scene changes as the image of the scene changes to a different section of the planogram.