JacopoAbate commited on
Commit
28d1054
·
verified ·
1 Parent(s): 8fb4b85

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -6
README.md CHANGED
@@ -13,18 +13,16 @@ tags:
13
 
14
  # Model Information
15
 
16
- xxxx is a SFT and LoRA finetuned version of Mistral-7B-v0.2
17
-
18
- It has been trained on a mixture of opensource datasets, like SQUAD-it (https://huggingface.co/datasets/squad_it), and some internally made datasets.
19
-
20
- It is not just a Q&A, it is a Q&A + Context model, with the goal being it being used for RAGs and application in need of a context.
21
 
 
 
22
  # Evaluation
23
 
24
  We evaluated the model using the same test sets as used for the Open Ita LLM Leaderboard
25
 
26
  | hellaswag_it acc_norm | arc_it acc_norm | m_mmlu_it 5-shot acc | Average |
27
- |:----------------------:| :---------------: | :--------------------: | :-------: |
28
  | 0.6067 | 0.4405 | 0.5112 | 0,52 |
29
 
30
 
 
13
 
14
  # Model Information
15
 
16
+ XXXX is an updated version of Mistral-7B-v0.2, specifically fine-tuned with SFT and LoRA adjustments.
 
 
 
 
17
 
18
+ - It's trained both on publicly available datasets like SQUAD-it and datasets we've created in-house.
19
+ - it's designed to understand and maintain context, making it ideal for Retrieval Augmented Generation (RAG) tasks and applications requiring contextual awareness.
20
  # Evaluation
21
 
22
  We evaluated the model using the same test sets as used for the Open Ita LLM Leaderboard
23
 
24
  | hellaswag_it acc_norm | arc_it acc_norm | m_mmlu_it 5-shot acc | Average |
25
+ |:----------------------| :--------------- | :-------------------- | :------- |
26
  | 0.6067 | 0.4405 | 0.5112 | 0,52 |
27
 
28