PEFT
Chinese
English
iamshnoo commited on
Commit
12a8cf1
1 Parent(s): d715d0e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -1
README.md CHANGED
@@ -1,6 +1,16 @@
1
  ---
2
  library_name: peft
 
 
 
 
 
 
3
  ---
 
 
 
 
4
  ## Training procedure
5
 
6
 
@@ -17,4 +27,4 @@ The following `bitsandbytes` quantization config was used during training:
17
  ### Framework versions
18
 
19
 
20
- - PEFT 0.4.0
 
1
  ---
2
  library_name: peft
3
+ license: cc-by-4.0
4
+ datasets:
5
+ - iamshnoo/alpaca-cleaned-chinese
6
+ language:
7
+ - zh
8
+ - en
9
  ---
10
+ This represents the PEFT weights only. The base model is LLaMA 2. Instruction finetuning was done using 4 bit QLoRA on a single A100 GPU with the PEFT config as given below. The dataset used for this instruction finetuning process is a translated version of the cleaned alpaca dataset (translated using NLLB-1.3B).
11
+
12
+ Do note that this model might have inferior performance on some language specific tasks compared to full finetuning or a different base model trained with more language specific data.
13
+
14
  ## Training procedure
15
 
16
 
 
27
  ### Framework versions
28
 
29
 
30
+ - PEFT 0.4.0