YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

first run with
iFaz/Whisper_Compatible_SER_benchmark
eavl: skip_special_token = True
rerun with this dataset
iFaz/Whisper_Compatible_SER_benchmark
eavl: skip_special_token = False             <<<<<---------------

V3 (rerun of base-v1)
################################################

Dataset: test_CREMA_D Dataset

Number of Samples: 2000
Overall WA: 0.5490
Overall UA: 0.5604
Micro F1 Score: 0.5490
Macro F1 Score: 0.4853

Classification Report:

              precision    recall  f1-score   support

           0       0.38      0.93      0.54       336
           1       1.00      0.04      0.08       346
           2       0.85      0.80      0.82       344
           3       0.65      0.90      0.76       288
           4       0.83      0.09      0.16       344
           5       0.52      0.61      0.56       342

    accuracy                           0.55      2000
   macro avg       0.71      0.56      0.49      2000
weighted avg       0.71      0.55      0.48      2000

Confusion Matrix:

[[312   0   8  12   4   0]
 [208  14  24  30   0  70]
 [ 56   0 276  10   0   2]
 [ 22   0   2 258   0   6]
 [174   0  10  16  30 114]
 [ 58   0   6  68   2 208]]

################################################

Dataset: test_ravdess Dataset

Number of Samples: 1200
Overall WA: 0.6333
Overall UA: 0.6617
Micro F1 Score: 0.6333
Macro F1 Score: 0.6463

Classification Report:

              precision    recall  f1-score   support

           0       0.32      0.97      0.48       160
           1       1.00      0.28      0.43       160
           2       1.00      0.68      0.81       160
           3       0.96      0.52      0.68       400
           4       0.90      0.88      0.89       160
           5       0.55      0.65      0.60       160

    accuracy                           0.63      1200
   macro avg       0.79      0.66      0.65      1200
weighted avg       0.82      0.63      0.65      1200

Confusion Matrix:

[[156   0   0   4   0   0]
 [116  44   0   0   0   0]
 [ 48   0 108   4   0   0]
 [108   0   0 208   0  84]
 [ 20   0   0   0 140   0]
 [ 40   0   0   0  16 104]]

################################################

Dataset: test_IEMOCAP Dataset

Number of Samples: 1000
Overall WA: 0.4790
Overall UA: 0.4360
Micro F1 Score: 0.4790
Macro F1 Score: 0.4421

Classification Report:

              precision    recall  f1-score   support

           0       0.53      0.53      0.53       370
           2       1.00      0.16      0.27       167
           3       0.37      0.70      0.48       269
           5       0.75      0.37      0.49       194

    accuracy                           0.48      1000
   macro avg       0.66      0.44      0.44      1000
weighted avg       0.61      0.48      0.46      1000

Confusion Matrix:

[[195   0 166   9]
 [ 56  26  82   3]
 [ 70   0 187  12]
 [ 50   0  73  71]]

################################################

Downloads last month
1
Safetensors
Model size
72.6M params
Tensor type
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support