NouRed commited on
Commit
98be240
1 Parent(s): 22205e0

update readme.md

Browse files
Files changed (1) hide show
  1. README.md +10 -1
README.md CHANGED
@@ -1,6 +1,14 @@
1
  ---
2
  library_name: peft
 
 
 
 
3
  ---
 
 
 
 
4
  ## Training procedure
5
 
6
 
@@ -14,7 +22,8 @@ The following `bitsandbytes` quantization config was used during training:
14
  - bnb_4bit_quant_type: nf4
15
  - bnb_4bit_use_double_quant: True
16
  - bnb_4bit_compute_dtype: bfloat16
 
17
  ### Framework versions
18
 
19
 
20
- - PEFT 0.4.0
 
1
  ---
2
  library_name: peft
3
+ license: mit
4
+ datasets:
5
+ - yahma/alpaca-cleaned
6
+ pipeline_tag: text-generation
7
  ---
8
+
9
+ ## Quantized LLaMA2 Alpaca
10
+ **quantized-llama2-alpaca** is a fine-tuned version of the [LLaMA2](https://ai.meta.com/research/publications/llama-2-open-foundation-and-fine-tuned-chat-models/) ([Llama-2-7b-hf](https://huggingface.co/meta-llama/Llama-2-7b)) model on the [Alpaca](https://github.com/tatsu-lab/stanford_alpaca) dataset using [QLoRA](https://arxiv.org/abs/2305.14314).
11
+
12
  ## Training procedure
13
 
14
 
 
22
  - bnb_4bit_quant_type: nf4
23
  - bnb_4bit_use_double_quant: True
24
  - bnb_4bit_compute_dtype: bfloat16
25
+
26
  ### Framework versions
27
 
28
 
29
+ - PEFT 0.4.0