Update README.md
Browse filesupdate model card
README.md
CHANGED
@@ -1,3 +1,25 @@
|
|
1 |
---
|
|
|
2 |
license: creativeml-openrail-m
|
|
|
|
|
|
|
|
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
+
language: en
|
3 |
license: creativeml-openrail-m
|
4 |
+
tags:
|
5 |
+
- emotion-recognition, perceiver
|
6 |
+
datasets:
|
7 |
+
- RAVDESS
|
8 |
---
|
9 |
+
|
10 |
+
# Perceiver-based Emotion Recognition
|
11 |
+
|
12 |
+
This model is a Perceiver-based (https://huggingface.co/docs/transformers/model_doc/perceiver) emotion recognition model trained on RAVDESS dataset (https://zenodo.org/record/1188976#.Y5iqPy2B1QI).
|
13 |
+
The model is trained using 3 modalities: video, audio, and text.
|
14 |
+
|
15 |
+
For details on the data collection, check here: https://zenodo.org/record/1188976
|
16 |
+
|
17 |
+
The feature extraction for each modality and training procedure follows the steps mentioned here: https://dl.acm.org/doi/10.1145/3551876.3554806
|
18 |
+
|
19 |
+
## Intended uses
|
20 |
+
|
21 |
+
You can use the raw model for directly reconize emotion (classes: 01 = neutral, 02 = calm, 03 = happy, 04 = sad, 05 = angry, 06 = fearful, 07 = disgust, 08 = surprised) or fine-tune on a downstream task.
|
22 |
+
|
23 |
+
## Limitations
|
24 |
+
|
25 |
+
The model is traine don only one dataset and uses 8 specific classes of emotions. The limitations lies in the lack of diversity in the demographics and emotions.
|