Commit
•
b608306
1
Parent(s):
9a8df92
Update README.md
Browse files
README.md
CHANGED
@@ -41,9 +41,10 @@ This is the model card of a 🤗 transformers model that has been pushed on the
|
|
41 |
For a detailed comparison of model performance, check out the [Leaderboard for Italian Language Models](https://huggingface.co/spaces/FinancialSupport/open_ita_llm_leaderboard).
|
42 |
|
43 |
Here's a breakdown of the performance metrics:
|
44 |
-
|
|
45 |
|:----------------------------|:----------------------|:----------------|:---------------------|:--------|
|
46 |
-
| **
|
|
|
47 |
|
48 |
|
49 |
### Sample Code
|
|
|
41 |
For a detailed comparison of model performance, check out the [Leaderboard for Italian Language Models](https://huggingface.co/spaces/FinancialSupport/open_ita_llm_leaderboard).
|
42 |
|
43 |
Here's a breakdown of the performance metrics:
|
44 |
+
| Model/metric | hellaswag_it acc_norm | arc_it acc_norm | m_mmlu_it 5-shot acc | Average |
|
45 |
|:----------------------------|:----------------------|:----------------|:---------------------|:--------|
|
46 |
+
| **Minerva-3B-Instruct-v1.0** | 0.5197 | 0.3157 | 0.2631 | 0.366 |
|
47 |
+
| Minerva-3B-base-v1.0 | 0.5187 | 0.3045 | 0.2612 | 0.361 |
|
48 |
|
49 |
|
50 |
### Sample Code
|