Patent ID: 11861940
Assignee: UNIVERSITY OF MARYLAND, COLLEGE PARK
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 14:
15. A computer program embodied on a non-transitory computer readable medium, said computer program comprising computer executable code which, when executed by a processor, causes the processor to:
receive a raw input;
process the raw input to generate input data corresponding to at least one context;
extract features from the raw input data to obtain a plurality of feature vectors and inputs;
transmit the plurality of feature vectors and the inputs to a respective neural network;
fuse at least some of the plurality of feature vectors to obtain a feature encoding;
compute additional feature encodings from the plurality of feature vectors via the respective neural network based, at least in part, on feeding a depth map computed from the raw input through a convolutional neural network comprising a plurality of alternating 2D convolutional layers to learn about a proximity of a plurality of agents to each other in the raw input; and
perform a multi-label emotion classification based on the feature encoding and the additional feature encodings.