skar01 commited on
Commit
6a1b98f
1 Parent(s): 8d8584a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -0
README.md CHANGED
@@ -3,6 +3,11 @@ library_name: peft
3
  ---
4
  ## Training procedure
5
 
 
 
 
 
 
6
 
7
  The following `bitsandbytes` quantization config was used during training:
8
  - load_in_8bit: False
 
3
  ---
4
  ## Training procedure
5
 
6
+ Llama2 (7B) model fine-tuned on the CodeAlpaca 20k instructions dataset by using the method QLoRA with PEFT library.
7
+
8
+ Training and evaluation data 📚
9
+
10
+ CodeAlpaca_20K: contains 20K instruction-following data used for fine-tuning the Code Alpaca model.
11
 
12
  The following `bitsandbytes` quantization config was used during training:
13
  - load_in_8bit: False