ViT Emotion Recognition (CK+)

Vision Transformer fine-tuned for 7-class facial emotion recognition on CK+.

Initialized from a FER2013-tuned ViT, then fine-tuned on CK+. Best for clean, frontal, posed lab faces. Prefer the FER2013 model for webcam / in-the-wild use.

Labels

anger, contempt, disgust, fear, happy, sadness, surprise

Usage

from transformers import pipeline

clf = pipeline("image-classification", model="ChristopherLi/vit-ckplus-emotion")
print(clf("face.jpg"))

Training

  • Base: FER2013 fine-tune of google/vit-base-patch16-224-in21k
  • 10 epochs on CK+ (stratified 80/10/10), fp16, lr 3e-5

Results (held-out test)

Metric Value
Accuracy 98.0%
Macro F1 0.965

See the project README for caveats about CK+ generalization.

Downloads last month
-
Safetensors
Model size
85.8M params
Tensor type
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ChristopherLi/vit-ckplus-emotion

Finetuned
(2550)
this model

Dataset used to train ChristopherLi/vit-ckplus-emotion

Evaluation results