Model Card: MLOps Emotion DistilBERT

Model Description

This is a fine-tuned version of distilbert-base-uncased for multi-class emotion classification. It was trained as part of an end-to-end MLOps pipeline assignment for the IIT Jodhpur PGD AI Program. The model takes English text as input and predicts one of six basic emotions.

  • Base Model: distilbert-base-uncased
  • Task: Text Classification
  • Language: English
  • License: IIT Jodhpur (All Rights Reserved)

Intended Uses & Limitations

This model is intended for educational purposes and basic emotion detection in short English text. It may not generalize well to complex, nuanced, or highly domain-specific language.

Training Data

The model was fine-tuned on the dair-ai/emotion dataset.

  • Training Set: 16,000 samples
  • Validation Set: 2,000 samples
  • Classes:
    • 0: Sadness
    • 1: Joy
    • 2: Love
    • 3: Anger
    • 4: Fear
    • 5: Surprise

Training Procedure

The model was trained in a Kaggle Notebook utilizing dual T4 GPUs. Hyperparameter tuning was conducted to compare multiple versions, tracked via Weights & Biases.

The following hyperparameters were used for the primary version:

  • Learning Rate: 3e-5
  • Epochs: 2
  • Train Batch Size: 16
  • Eval Batch Size: 16
  • Optimizer: AdamW

Evaluation Results

Model performance was evaluated on the validation split of the dataset. Metrics such as Accuracy and Weighted F1-score were monitored throughout training and logged directly to the project's W&B Dashboard.

Pipeline Integration

This model is containerized using Docker for inference and is integrated into a continuous CI/CD pipeline orchestrated via GitHub Actions.

Downloads last month
130
Safetensors
Model size
67M params
Tensor type
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Dataset used to train srajam696/mlops-emotion-distilbert