metadata

tags:
  - generated_from_keras_callback
model-index:
  - name: twitter-roberta-base-emotion-multilabel-latest
    results: []
pipeline_tag: text-classification
language:
  - en

twitter-roberta-base-emotion-multilabel-latest

This model is a fine-tuned version of cardiffnlp/twitter-roberta-base-2021-124m on the SemEval 2018 - Task 1 Affect in Tweets (subtask: E-c / multilabel classification).

Performance

Following metrics are achieved on the test split:

F1 (micro): 0.7218
F1 (macro): 0.5746
Jaccard Index (samples): 0.6073:

Usage

1. tweetnlp

Install tweetnlp via pip.

pip install tweetnlp

Load the model in python.

import tweetnlp

model = tweetnlp.load_model('topic_classification', model_name='cardiffnlp/twitter-roberta-base-emotion-multilabel-latest')

model.predict("I am so happy and sad at the same time")

>> {'label': ['joy', 'sadness']}

2. pipeline

pip install -U tensorflow==2.10

from transformers import pipeline

pipe = pipeline("text-classification", model="cardiffnlp/twitter-roberta-base-emotion-multilabel-latest", return_all_scores=True)

pipe("I am so happy and sad at the same time")

>> [[{'label': 'anger', 'score': 0.0059011634439229965},
  {'label': 'anticipation', 'score': 0.024502484127879143},
  {'label': 'disgust', 'score': 0.016748998314142227},
  {'label': 'fear', 'score': 0.20184014737606049},
  {'label': 'joy', 'score': 0.9260002970695496},
  {'label': 'love', 'score': 0.13167349994182587},
  {'label': 'optimism', 'score': 0.32711178064346313},
  {'label': 'pessimism', 'score': 0.08952841907739639},
  {'label': 'sadness', 'score': 0.8542942404747009},
  {'label': 'surprise', 'score': 0.059213291853666306},
  {'label': 'trust', 'score': 0.01618659868836403}]]

Reference

@inproceedings{camacho-collados-etal-2022-tweetnlp,
    title={{T}weet{NLP}: {C}utting-{E}dge {N}atural {L}anguage {P}rocessing for {S}ocial {M}edia},
    author={Camacho-Collados, Jose and Rezaee, Kiamehr and Riahi, Talayeh and Ushio, Asahi and Loureiro, Daniel and Antypas, Dimosthenis and Boisson, Joanne and Espinosa-Anke, Luis and Liu, Fangyu and Mart{\'\i}nez-C{\'a}mara, Eugenio and others},
    author = "Ushio, Asahi  and
      Camacho-Collados, Jose",
    booktitle = "Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing: System Demonstrations",
    month = nov,
    year = "2022",
    address = "Abu Dhabi, U.A.E.",
    publisher = "Association for Computational Linguistics",
}