Duplicate from tabularisai/multilingual-emotion-classification

Co-authored-by: Vadim Borisov <vdmbrsv@users.noreply.huggingface.co>

.gitattributes

@@ -0,0 +1,36 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,237 @@
+---
+base_model: FacebookAI/xlm-roberta-base
+language:
+- en
+- zh
+- es
+- hi
+- ar
+- bn
+- pt
+- ru
+- ja
+- de
+- id
+- ta
+- vi
+- ko
+- fr
+- tr
+- it
+- pl
+- uk
+- ur
+- nl
+- pa
+- sw
+library_name: transformers
+license: cc-by-nc-4.0
+pipeline_tag: text-classification
+tags:
+- text-classification
+- emotion-classification
+- emotion
+- multi-label-classification
+- synthetic data
+- social-media-analysis
+- customer-feedback
+- product-reviews
+- brand-monitoring
+- multilingual
+- 🇪🇺
+- region:eu
+- synthetic
+---
+
+> [!TIP]
+> If you wish to use this model for commercial purposes, please obtain a license by contacting: info@tabularis.ai
+
+
+# 🎭 Multilingual Emotion Classification Model (23 Languages, 11 Emotions)
+
+[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/Discord%20button.png" width="200"/>](https://discord.gg/sznxwdqBXj)
+
+
+## Model Details
+- `Model Name:` tabularisai/multilingual-emotion-classification
+- `Base Model:` FacebookAI/xlm-roberta-base
+- `Task:` Multi-label Text Classification (Emotion Recognition)
+- `Languages:` 23 — English, Mandarin Chinese (中文), Spanish (Español), Hindi (हिन्दी), Arabic (العربية), Bengali (বাংলা), Portuguese (Português), Russian (Русский), Japanese (日本語), German (Deutsch), Indonesian (Bahasa Indonesia), Tamil (தமிழ்), Vietnamese (Tiếng Việt), Korean (한국어), French (Français), Turkish (Türkçe), Italian (Italiano), Polish (Polski), Ukrainian (Українська), Urdu (اردو), Dutch (Nederlands), Punjabi (ਪੰਜਾਬੀ), and Swahili.
+- `Number of Classes:` 11 — *anger, contempt, disgust, fear, frustration, gratitude, joy, love, neutral, sadness, surprise*
+- `Label Mode:` Multi-label — each text can be assigned **zero, one, or multiple** emotions (independent sigmoid heads, τ = 0.5).
+- `Usage:`
+  - Social media emotion analysis
+  - Customer feedback analysis
+  - Product review emotion tagging
+  - Brand monitoring
+  - Conversational AI / chatbot affect tracking
+  - Market research
+  - Customer service optimization
+
+> 
+
+
+## Model Description
+
+This model is a fine-tuned version of `FacebookAI/xlm-roberta-base` for multilingual multi-label emotion classification. It was trained on synthetic multilingual data covering 23 languages and 11 emotion categories, enabling robust emotion detection across languages, registers, and cultural contexts.
+
+Unlike single-label sentiment classifiers, this model predicts a **set** of emotions per input — reflecting the reality that utterances often carry mixed affect (e.g. *gratitude + love*, *frustration + sadness*).
+
+### Training Data
+
+Trained on synthetic multilingual data generated by advanced LLMs, providing broad coverage of emotion expressions across all 23 supported languages. All labels are multi-hot vectors over the 11 emotion classes.
+
+### Training Procedure
+
+- Fine-tuned for 3 epochs with **BCEWithLogitsLoss** (independent-binary-per-label).
+- Cosine LR schedule with 6% warmup, `lr=2e-5`, effective batch size 64.
+- Mixed precision (bf16) on a single A100; max sequence length 192.
+- Per-epoch checkpointing; epoch 3 was selected by validation F1-micro.
+
+## Evaluation (held-out multilingual test set, 11,500 rows)
+
+| Metric              | Value |
+|---------------------|-------|
+| F1 (micro)          | 0.840 |
+| F1 (macro)          | 0.839 |
+| Jaccard (samples)   | 0.794 |
+| Subset accuracy     | 0.640 |
+| Hamming accuracy    | 0.953 |
+| AUROC (micro)       | 0.980 |
+| Average Precision (micro) | 0.923 |
+| LRAP                | 0.936 |
+
+Decision threshold: τ = 0.5 applied independently per label.
+
+## Intended Use
+
+Ideal for:
+- Multilingual social media emotion monitoring
+- International customer feedback affect analysis
+- Global product review emotion tagging
+- Worldwide brand sentiment & emotion tracking
+- Affect-aware conversational systems
+
+## How to Use
+
+```python
+from transformers import AutoTokenizer, AutoModelForSequenceClassification
+import torch
+
+model_name = "tabularisai/multilingual-emotion-classification"
+tokenizer = AutoTokenizer.from_pretrained(model_name)
+model = AutoModelForSequenceClassification.from_pretrained(model_name)
+model.eval()
+
+LABELS = ["anger", "contempt", "disgust", "fear", "frustration",
+          "gratitude", "joy", "love", "neutral", "sadness", "surprise"]
+
+@torch.no_grad()
+def predict_emotions(texts, threshold: float = 0.5):
+    inputs = tokenizer(texts, return_tensors="pt", truncation=True,
+                       padding=True, max_length=192)
+    probs = torch.sigmoid(model(**inputs).logits).cpu().numpy()
+    results = []
+    for row in probs:
+        picked = [(LABELS[i], float(row[i])) for i in range(len(LABELS)) if row[i] >= threshold]
+        picked.sort(key=lambda x: -x[1])
+        results.append(picked or [("neutral", float(row[LABELS.index("neutral")]))])
+    return results
+
+
+texts = [
+    # English
+    "Thank you so much for helping me, I really appreciate it!",
+    "I can't believe they cancelled the flight again, this is ridiculous.",
+    # Spanish
+    "¡Qué alegría verte después de tanto tiempo!",
+    "Estoy muy decepcionado con el servicio.",
+    # Chinese
+    "收到你的礼物我真的很感动,谢谢你!",
+    "这部电影太吓人了,我都不敢一个人看。",
+    # Arabic
+    "أنا ممتن جدًا لكل ما فعلته من أجلي.",
+    "لا أستطيع تحمّل هذا الوضع أكثر من ذلك.",
+    # Hindi
+    "आपका यह तोहफ़ा देखकर मेरी आँखों में आँसू आ गए।",
+    "यह सेवा बिल्कुल घटिया थी, मैं बहुत निराश हूँ।",
+    # Japanese
+    "久しぶりに会えて本当に嬉しいです!",
+    "また電車が遅れた...本当にうんざりする。",
+    # French
+    "Je suis tellement reconnaissant pour tout ce que tu as fait.",
+    "C'est inadmissible, j'en ai assez de cette situation.",
+    # Swahili
+    "Asante sana kwa msaada wako, nakupenda sana!",
+    "Nimechoka kabisa na huduma hii mbaya.",
+]
+
+for t, r in zip(texts, predict_emotions(texts)):
+    tags = ", ".join(f"{lbl}({p:.2f})" for lbl, p in r)
+    print(f"Text: {t}\nEmotions: {tags}\n")
+```
+
+Using pipelines (returns probability for each of the 11 classes):
+
+```python
+from transformers import pipeline
+
+pipe = pipeline(
+    "text-classification",
+    model="tabularisai/multilingual-emotion-classification",
+    function_to_apply="sigmoid",
+    top_k=None,
+)
+
+print(pipe("I love this product! It's amazing and works perfectly."))
+```
+
+## Ethical Considerations
+
+Synthetic training data reduces annotator bias and broadens language coverage, but real-world validation is strongly advised before deploying in high-stakes settings. Emotion labels are culturally situated — predictions should be treated as probabilistic signals, not ground truth about a person's internal state.
+
+## Citation
+
+```bib
+@misc{borisov2026multilingual,
+      title={Multilingual Multi-Label Emotion Classification at Scale with Synthetic Data}, 
+      author={Vadim Borisov},
+      year={2026},
+      eprint={2604.12633},
+      archivePrefix={arXiv},
+      primaryClass={cs.CL},
+      url={https://arxiv.org/abs/2604.12633}, 
+}
+```
+
+## Contact
+
+For inquiries, data, private APIs, better models, contact info@tabularis.ai
+
+tabularis.ai
+
+
+<table align="center">
+  <tr>
+    <td align="center">
+      <a href="https://www.linkedin.com/company/tabularis-ai/">
+        <img src="https://cdn.jsdelivr.net/gh/simple-icons/simple-icons/icons/linkedin.svg" alt="LinkedIn" width="30" height="30">
+      </a>
+    </td>
+    <td align="center">
+      <a href="https://x.com/tabularis_ai">
+        <img src="https://cdn.jsdelivr.net/gh/simple-icons/simple-icons/icons/x.svg" alt="X" width="30" height="30">
+      </a>
+    </td>
+    <td align="center">
+      <a href="https://github.com/tabularis-ai">
+        <img src="https://cdn.jsdelivr.net/gh/simple-icons/simple-icons/icons/github.svg" alt="GitHub" width="30" height="30">
+      </a>
+    </td>
+    <td align="center">
+      <a href="https://tabularis.ai">
+        <img src="https://cdn.jsdelivr.net/gh/simple-icons/simple-icons/icons/internetarchive.svg" alt="Website" width="30" height="30">
+      </a>
+    </td>
+  </tr>
+</table>

config.json

@@ -0,0 +1,57 @@
+{
+  "add_cross_attention": false,
+  "architectures": [
+    "XLMRobertaForSequenceClassification"
+  ],
+  "attention_probs_dropout_prob": 0.1,
+  "bos_token_id": 0,
+  "classifier_dropout": null,
+  "dtype": "float32",
+  "eos_token_id": 2,
+  "hidden_act": "gelu",
+  "hidden_dropout_prob": 0.1,
+  "hidden_size": 768,
+  "id2label": {
+    "0": "anger",
+    "1": "contempt",
+    "2": "disgust",
+    "3": "fear",
+    "4": "frustration",
+    "5": "gratitude",
+    "6": "joy",
+    "7": "love",
+    "8": "neutral",
+    "9": "sadness",
+    "10": "surprise"
+  },
+  "initializer_range": 0.02,
+  "intermediate_size": 3072,
+  "is_decoder": false,
+  "label2id": {
+    "anger": 0,
+    "contempt": 1,
+    "disgust": 2,
+    "fear": 3,
+    "frustration": 4,
+    "gratitude": 5,
+    "joy": 6,
+    "love": 7,
+    "neutral": 8,
+    "sadness": 9,
+    "surprise": 10
+  },
+  "layer_norm_eps": 1e-05,
+  "max_position_embeddings": 514,
+  "model_type": "xlm-roberta",
+  "num_attention_heads": 12,
+  "num_hidden_layers": 12,
+  "output_past": true,
+  "pad_token_id": 1,
+  "position_embedding_type": "absolute",
+  "problem_type": "multi_label_classification",
+  "tie_word_embeddings": true,
+  "transformers_version": "5.5.3",
+  "type_vocab_size": 1,
+  "use_cache": true,
+  "vocab_size": 250002
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:300fd92943ec7541749bd56fcb3f4c037d2ba3313bf54c0c4046913156fdd3c3
+size 1112232668

tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:acbd420e2269cdc1ef45332d3d5c418be4aef6b8cb5a0b7ccae0893485307153
+size 17098086

tokenizer_config.json

@@ -0,0 +1,14 @@
+{
+  "add_prefix_space": true,
+  "backend": "tokenizers",
+  "bos_token": "<s>",
+  "cls_token": "<s>",
+  "eos_token": "</s>",
+  "is_local": false,
+  "mask_token": "<mask>",
+  "model_max_length": 512,
+  "pad_token": "<pad>",
+  "sep_token": "</s>",
+  "tokenizer_class": "XLMRobertaTokenizer",
+  "unk_token": "<unk>"
+}