TariqJamil
commited on
Commit
•
f2ebd46
1
Parent(s):
9192ca3
Upload 7 files
Browse files- README.md +0 -12
- optimizer.pt +3 -0
- rng_state.pth +3 -0
- scheduler.pt +3 -0
- trainer_state.json +0 -0
- training_args.bin +3 -0
README.md
CHANGED
@@ -4,17 +4,6 @@ library_name: peft
|
|
4 |
## Training procedure
|
5 |
|
6 |
|
7 |
-
The following `bitsandbytes` quantization config was used during training:
|
8 |
-
- load_in_8bit: False
|
9 |
-
- load_in_4bit: True
|
10 |
-
- llm_int8_threshold: 6.0
|
11 |
-
- llm_int8_skip_modules: None
|
12 |
-
- llm_int8_enable_fp32_cpu_offload: False
|
13 |
-
- llm_int8_has_fp16_weight: False
|
14 |
-
- bnb_4bit_quant_type: nf4
|
15 |
-
- bnb_4bit_use_double_quant: True
|
16 |
-
- bnb_4bit_compute_dtype: bfloat16
|
17 |
-
|
18 |
The following `bitsandbytes` quantization config was used during training:
|
19 |
- load_in_8bit: False
|
20 |
- load_in_4bit: True
|
@@ -27,6 +16,5 @@ The following `bitsandbytes` quantization config was used during training:
|
|
27 |
- bnb_4bit_compute_dtype: bfloat16
|
28 |
### Framework versions
|
29 |
|
30 |
-
- PEFT 0.5.0.dev0
|
31 |
|
32 |
- PEFT 0.5.0.dev0
|
|
|
4 |
## Training procedure
|
5 |
|
6 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
7 |
The following `bitsandbytes` quantization config was used during training:
|
8 |
- load_in_8bit: False
|
9 |
- load_in_4bit: True
|
|
|
16 |
- bnb_4bit_compute_dtype: bfloat16
|
17 |
### Framework versions
|
18 |
|
|
|
19 |
|
20 |
- PEFT 0.5.0.dev0
|
optimizer.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:3be2da802365756b9417ce137fd3e4e6b24756535eb441ba0b2694afbc8b2615
|
3 |
+
size 9531525
|
rng_state.pth
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:45633bcc1c6a2c7fe4f141203d8671c0ffdaf6c33c7b688fda6ef051d533c590
|
3 |
+
size 14575
|
scheduler.pt
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:ffa84e40719b997939d68759cd6081e20cd194a4249148874782150e77884095
|
3 |
+
size 627
|
trainer_state.json
ADDED
The diff for this file is too large to render.
See raw diff
|
|
training_args.bin
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b6a2b69a343ad4023efcbc232398d102ae55766b9ae0f9eaa15b2f3837ea0e90
|
3 |
+
size 4027
|