Patent ID: 11868940
Assignee: SHOPPERTRAK RCT LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A system for monitoring workers in a retail environment, comprising:
a plurality of cameras located in different regions of the retail environment and configured to capture a video feed of a respective region;
a worker interface configured to receive identification from a worker and identify the worker; and
a computer system comprising a memory storing computer executable instructions and a processor configured to execute the instructions to:
receive a video feed of at least one region of the retail environment from at least one of the plurality of cameras;
identify a worker at the worker interface based on input to the worker interface;
track a location of the identified worker from a first region including the worker interface to a second region including a location of the worker in the video feed of the second region, wherein tracking the location of the identified worker comprises:
re-identifying the worker in the video feed of the second region based on one or more of height, gender, age, gait, or uniform when the worker leaves the video feed of the first region; and
moving at least one camera of the plurality of cameras to maintain a field of view of the camera on the worker;
provide the video feed of the second region of the retail environment to a machine learning classifier, the machine learning classifier trained on labeled videos, to classify a sequence of images of a worker into a probability certainty of an activity being performed by the worker;

determine a set of activities for the location of the worker in the video feed of the second region;
adjust the probability certainty of the activity based on whether the activity is in the set of activities for the location of the worker in the video feed of the second region by adding an adjustment amount to the probability certainty for the activity if the activity is in the set of activities for the location and subtracting the adjustment amount if the activity is not in the set of activities for the location;
determine, based on probability certainties generated by the machine learning classifier over a period of time, an activity schedule of the worker; and
determine labor productivity statistics based on the activity schedule.