---
license: apache-2.0
datasets:
- SeacomSrl/rag-data
language:
- it
---

# Uploaded  model

- **Developed by:** [Toti Riccardo](https://www.linkedin.com/in/riccardo-toti/)
- **License:** apache-2.0
- **Finetuned from model :** [unsloth/Phi-3-medium-4k-instruct](https://huggingface.co/unsloth/Phi-3-medium-4k-instruct) on [Seacom/rag-data](https://huggingface.co/datasets/SeacomSrl/rag-data) an italian translated dataset. 

## Evaluation

For a detailed comparison of model performance, check out the [Leaderboard for Italian Language Models](https://huggingface.co/spaces/FinancialSupport/open_ita_llm_leaderboard).

Here's a breakdown of the performance metrics:

| Metric                      | hellaswag_it acc_norm | arc_it acc_norm | m_mmlu_it 5-shot acc |m_mmlu_pro_it | Average |
|:----------------------------|:----------------------|:----------------|:---------------------|:--------|:--------|
| **Accuracy Normalized**     | 69.35                | 49.1        | 69.53            | 0.3913 |62.66 |