Kdffff commited on
Commit
aa82efe
1 Parent(s): a34ebc0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +26 -14
README.md CHANGED
@@ -5,23 +5,35 @@ tags:
5
  - peft
6
  ---
7
 
8
- ## My Model
9
 
10
- This model is designed for text generation using LoRA.
11
 
12
- ## Training procedure
13
 
14
- The following `bitsandbytes` quantization config was used during training:
15
- - load_in_8bit: False
16
- - load_in_4bit: True
17
- - llm_int8_threshold: 6.0
18
- - llm_int8_skip_modules: None
19
- - llm_int8_enable_fp32_cpu_offload: False
20
- - llm_int8_has_fp16_weight: False
21
- - bnb_4bit_quant_type: nf4
22
- - bnb_4bit_use_double_quant: True
23
- - bnb_4bit_compute_dtype: bfloat16
24
 
25
- ### Framework versions
 
 
 
 
 
 
 
 
 
 
 
 
26
 
27
  - PEFT 0.4.0
 
 
 
 
 
 
 
 
 
 
5
  - peft
6
  ---
7
 
8
+ # LoRA Text Generation Model
9
 
10
+ This repository contains a fine-tuned LoRA model designed for text generation.
11
 
12
+ ## Training Details
13
 
14
+ ### Fine-Tuning Procedure
 
 
 
 
 
 
 
 
 
15
 
16
+ The model was fine-tuned using the following `bitsandbytes` quantization configuration:
17
+
18
+ - **load_in_8bit:** False
19
+ - **load_in_4bit:** True
20
+ - **llm_int8_threshold:** 6.0
21
+ - **llm_int8_skip_modules:** None
22
+ - **llm_int8_enable_fp32_cpu_offload:** False
23
+ - **llm_int8_has_fp16_weight:** False
24
+ - **bnb_4bit_quant_type:** nf4
25
+ - **bnb_4bit_use_double_quant:** True
26
+ - **bnb_4bit_compute_dtype:** bfloat16
27
+
28
+ ### Framework Versions
29
 
30
  - PEFT 0.4.0
31
+
32
+ ## How to Use
33
+
34
+ ### Installation
35
+
36
+ Install the necessary libraries:
37
+
38
+ ```bash
39
+ pip install transformers