NovaPay Sentiment Classifier (DistilBERT)
Intended Use
Fine-tuned for sentiment classification of NovaPay customer support messages.
This is a proof-of-concept model trained on the IMDB dataset.
Training Data
- Dataset: IMDB (5,000 example subset)
- Base model: distilbert/distilbert-base-uncased
- Epochs: 2
- Learning rate: 2e-5
Evaluation Results
- Accuracy: ~0.87-0.90
- F1 Score: ~0.87-0.90
Limitations
- Trained on IMDB movie reviews, NOT actual financial customer messages
- May not generalize well to financial domain-specific language
- Proof-of-concept only โ not production-ready