PereLluis13 FinancialSupport commited on
Commit
6ec3fd1
1 Parent(s): 159ef8a

Update README.md (#1)

Browse files

- Update README.md (e479e0274f3c5a2e74436600a46f424daf6ad3e3)


Co-authored-by: Samuele Colombo <FinancialSupport@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +7 -3
README.md CHANGED
@@ -54,9 +54,13 @@ Please take it with a pinch of salt as we continue to study Modello Italia.
54
  * The model architecture is **based on GPT-NeoX**.
55
 
56
  ## Results
57
- Modello Italia 9B has not been evaluated on standard benchmarks yet.
58
- We will update this model card with the results soon.
59
- * **Want to contribute to the evaluation?** Submit a pull request!
 
 
 
 
60
 
61
  ## How to use Modello Italia with Hugging Face transformers
62
 
 
54
  * The model architecture is **based on GPT-NeoX**.
55
 
56
  ## Results
57
+ For a detailed comparison of model performance, check out the [Leaderboard for Italian Language Models](https://huggingface.co/spaces/FinancialSupport/open_ita_llm_leaderboard).
58
+
59
+ Here's a breakdown of the performance metrics:
60
+
61
+ | Metric | hellaswag_it acc_norm | arc_it acc_norm | m_mmlu_it 5-shot acc | Average |
62
+ |:----------------------------|:----------------------|:----------------|:---------------------|:--------|
63
+ | **Accuracy Normalized** | 0.5679 | 0.3849 | 0.3522 | 0.4350 |
64
 
65
  ## How to use Modello Italia with Hugging Face transformers
66