Patent ID: 11861940
Assignee: UNIVERSITY OF MARYLAND, COLLEGE PARK
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 7:
8. An apparatus, comprising:
at least one processor; and
at least one memory comprising computer program code,
the at least one memory and the computer program code are configured, with the at least one processor, to cause the apparatus at least to
receive a raw input;
process the raw input to generate input data corresponding to at least one context;
extract features from the raw input data to obtain a plurality of feature vectors and inputs;
transmit the plurality of feature vectors and the inputs to a respective neural network;
fuse at least some of the plurality of feature vectors to obtain a feature encoding;
compute additional feature encodings from the plurality of feature vectors via the respective neural network based, at least in part, on feeding a depth map computed from the raw input through a convolutional neural network comprising a plurality of alternating 2D convolutional layers to learn about a proximity of a plurality of agents to each other in the raw input; and
perform a multi-label emotion classification based on the feature encoding and the additional feature encodings.