Patent ID: 11954936
Assignee: AR & NS INVESTMENT, LLC
Field: nan (nan)
Classification: CPC nan | IPC G  H

Claim 17:
18. A cross-correlation method, comprising:
inputting by control circuitry, sensor data from a plurality of sensors into an input layer of a deep neural network;
training, by the control circuitry, the deep neural network for:
cross-correlating the sensor data from the plurality of sensors at an input sampling stage;
solving for a relationship between the cross-correlated sensor data and identity of one or more users represented in the cross-correlated sensor data, and
tracking subsequent movements of the one or more identified users based on the cross-correlated sensor data;

obtaining, by the control circuitry, first sensor data of a first user from a radio detection and ranging system, wherein the first sensor data is a spatial point cloud data of a body of the first user;
detecting, by the control circuitry, a first portable device carried by the first user based on the first sensor data of the first user;
obtaining, by the control circuitry, second sensor data from the first portable device based on detection of the first portable device of the first user, wherein the second sensor data includes device identity, location information, and signal strength information of the first portable device;
determining location coordinates of the first portable device based on the second sensor data, wherein the location coordinates include at least one of an angle and a distance of the first portable device;
utilizing the trained deep neural network to cross-correlate, by the control circuitry, the first sensor data and the second sensor data for:
obtaining cross-correlated information of the first user,
identifying the first user based on the cross-correlated information of the first user, and
determining a position of the first user based on the cross-correlated information of the first user, wherein coordinates of the spatial point cloud data are merged with the location coordinates of the first portable device,

recognizing, by the control circuitry, a first gesture, specific to the first user based on the cross-correlated information of the first user;
identifying, by the control circuitry, a first controllable device from a plurality of controllable devices and a first action that is to be executed at the identified first controllable device, based on the first gesture; and
controlling, by the control circuitry, the identified first controllable device to execute the first action based on the first gesture.