Patent ID: 11961300
Assignee: ECOLE POLYTECHNIQUE FEDERALE DE LAUSANNE (EPFL)
Field: Computer technology (Electrical engineering)
Classification: CPC G | IPC G

Claim 23:
24. A classification system for classifying a media item into one or more user profile suitability classes, the system comprising a set of pre-trained artificial neural networks and being configured to perform operations comprising:
receive a media file;
extract a first data stream and a second data stream from the media file, the first media stream comprising first media content of a first media content form, the second data stream comprising second media content of a second, different media content form, the first and second data streams being comprised in the media item, the first content form being one of the following content forms: audio, image and text, while the second media content form being any one of the remaining two content forms;
generate by a first set of convolution neural networks a first sequence of first feature vectors describing the first media content;
generate by a second set of convolution neural networks or by a set of word embedding matrices a second sequence of second feature vectors describing the second media content;
generate at least a first single feature vector representing the first sequence of first feature vectors and the second sequence of second feature vectors, or generating at least a first single feature vector representing at least the first sequence of first feature vectors, and generating a second single feature vector representing at least the second sequence of second feature vectors;
generate by a feedforward artificial neural network a probability vector at least from the first single feature vector in the case where the first single feature vector represents the first sequence of first feature vectors and the second sequence of second feature vectors, or at least from the first and second single feature vectors by first concatenating the first and second single feature vectors in the case where the first single feature vector represents at least the first sequence of first feature vectors, and the second single feature vector represents at least the second sequence of second feature vectors; and
assign a user profile suitability class to the media item based on the probability vector.