Patent ID: 11861940
Assignee: UNIVERSITY OF MARYLAND, COLLEGE PARK
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 0:
1. A method for recognizing perceived human emotion, comprising:
receiving a raw input;
processing the raw input to generate input data corresponding to at least one context;
extracting features from the raw input data to obtain a plurality of feature vectors and inputs;
transmitting the plurality of feature vectors and the inputs to a respective neural network;
fusing at least some of the plurality of feature vectors to obtain a feature encoding;
computing additional feature encodings from the plurality of feature vectors via the respective neural network based, at least in part, on feeding a depth map computed from the raw input through a convolutional neural network comprising a plurality of alternating 2D convolutional layers to learn about a proximity of a plurality of agents to each other in the raw input; and
performing a multi-label emotion classification of a primary agent in the raw input based on the feature encoding and the additional feature encodings.