Patent ID: 11954944
Assignee: CAPITAL ONE SERVICES, LLC
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 10:
11. A server, comprising:
a non-transitory memory; and
at least one processor associated with an authorizing entity configured to execute computer code stored in the non-transitory memory that causes the at least one processor to:
register first image data of a plurality of first images of a plurality of first physical objects to be used for granting permission to a user to perform at least one operation on the server;
detect in the first image data:
(i) a plurality of first object representations of the plurality of first physical objects, and
(ii) a plurality of first background scene representations of a plurality of first background scenes associated with the plurality of first physical objects;

register a first presentation sequence identifying a first order for presenting each of the plurality of first physical objects for granting the permission to the user to perform the at least one operation on the server;
store in the non-transitory memory:
the plurality of first object representations,
the plurality of first background scene representations, and
the first presentation sequence;

receive over a communication network, a request from the user through a computing device associated with the user to perform the at least one operation;
wherein the computing device comprises an image acquisition device;

send in response to the request, a notification to the computing device instructing the user to position a plurality of second physical objects so as to allow the image acquisition device to acquire second image data of a plurality of second images of the plurality of second physical objects;
receive over the communication network, the second image data and a second presentation sequence that is a second order in which the user has presented each of the plurality of second physical objects to the image acquisition device;
detect in the second image data:
(i) a plurality of second object representations of the plurality of second physical objects, and
(ii) a plurality of second background scene representations of a plurality of second background scenes associated with the plurality of second physical objects;

compute a probability that the user is a permissioned user that is permissioned to perform the at least one operation by inputting the first image data and the second image data into at least one machine learning model;
wherein the at least one machine learning model is configured to compute the probability based at least in part on:
a first comparison between the plurality of first object representations and the plurality of second object representations,
a second comparison between the plurality of first background scene representations and the plurality of second background scene representations, and
a third comparison between the first presentation sequence and the second presentation sequence; and

tag the user as:
the permissioned user to perform the at least one operation when the probability is above a predefined threshold, or
a non-permissioned violator user when the probability is below the predefined threshold.