Create README.md

README.md

@@ -0,0 +1,65 @@
+---
+language: "it"
+tags:
+- bert
+- sarcasm-detection
+- text-classification
+widget:
+- text: "Auto, stop a diesel e benzina dal 2035. Ecco cosa cambia per i consumatori"
+---
+
+# Italian Sarcasm Detector
+
+Italian Sarcasm Detector is a text classification model built to detect sarcasm from news article titles. It is fine-tuned on dbmdz/bert-base-italian-uncased and the training data consists of scraped data from Italian non-sarcastic newspaper (Il Giornale) and sarcastic newspaper (Lercio).
+
+## Metrics:
+
+
+## Training Data
+
+Scraped data:
+- Italian non-sarcastic news from [Il Giornale]([https://www.ilgiornale.it])
+- Italian sarcastic news from [Lercio]([https://www.lercio.it])
+
+Codebase:
+- Git Repo: [Official repository](https://github.com/helinivan/multilingual-sarcasm-detector)
+
+---
+
+## Example of classification
+
+```python
+from transformers import AutoModelForSequenceClassification
+from transformers import AutoTokenizer
+import string
+
+def preprocess_data(text: str) -> str:
+   return text.lower().translate(str.maketrans("", "", string.punctuation)).strip()
+
+MODEL_PATH = "helinivan/italian-sarcasm-detector"
+
+tokenizer = AutoTokenizer.from_pretrained(MODEL_PATH)
+model = AutoModelForSequenceClassification.from_pretrained(MODEL_PATH)
+
+text = "Auto, stop a diesel e benzina dal 2035. Ecco cosa cambia per i consumatori"
+tokenized_text = tokenizer([preprocess_data(text)], padding=True, truncation=True, max_length=512, return_tensors="pt")
+output = model(**tokenized_text)
+probs = output.logits.softmax(dim=-1).tolist()[0]
+confidence = max(probs)
+prediction = probs.index(confidence)
+results = {"is_sarcastic": prediction, "confidence": confidence}
+
+```
+
+Output: 
+
+```
+{'is_sarcastic': 1, 'confidence': 0.9999909400939941}
+```
+
+## Performance
+| Model-Name | F1 | Precision | Recall | Accuracy 
+| ------------- |:-------------| -----| -----| ----| 
+| helinivan/english-sarcasm-detector | 94.48 | 94.46 | 94.51 | 94.48
+| helinivan/italian-sarcasm-detector | 92.99 | 92.77 | 93.24 | 93.42
+| helinivan/multilingual-sarcasm-detector | 90.91 | 91.51 | 90.44 | 91.55