marianbasti commited on
Commit
e5b39f5
1 Parent(s): a16e23b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -0
README.md CHANGED
@@ -1,3 +1,19 @@
1
  ---
2
  license: llama2
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: llama2
3
+ datasets:
4
+ - bertin-project/alpaca-spanish
5
+ language:
6
+ - es
7
+ library_name: transformers
8
+ pipeline_tag: text-generation
9
  ---
10
+ ## Llama 2-13b-alpaca-spanish LoRA
11
+ This is a LoRA for Llama 2 13B trained on a translated [alpaca dataset](https://huggingface.co/datasets/bertin-project/alpaca-spanish) on an attempt to improve spanish performance of the Llama-2 foundation model with a conversational focus
12
+
13
+ | Training parameteres | |
14
+ | ----------- | ----------- |
15
+ | LoRA scale | 2 |
16
+ | Epochs | 0.75 |
17
+ | Learning Rate| 2e-5 |
18
+ | Warmup Steps| 100 |
19
+ | Loss | 1.07 |