IliyanGochev commited on
Commit
2f12828
1 Parent(s): acf51e4

Training in progress epoch 7

Browse files
README.md CHANGED
@@ -126,6 +126,18 @@ The following `bitsandbytes` quantization config was used during training:
126
  - bnb_4bit_use_double_quant: False
127
  - bnb_4bit_compute_dtype: float32
128
 
 
 
 
 
 
 
 
 
 
 
 
 
129
  The following `bitsandbytes` quantization config was used during training:
130
  - quant_method: bitsandbytes
131
  - load_in_8bit: True
@@ -162,6 +174,7 @@ The following `bitsandbytes` quantization config was used during training:
162
  - PEFT 0.5.0
163
  - PEFT 0.5.0
164
  - PEFT 0.5.0
 
165
 
166
  - PEFT 0.5.0.dev0
167
  `bitsandbytes` quantization config was used during training:
 
126
  - bnb_4bit_use_double_quant: False
127
  - bnb_4bit_compute_dtype: float32
128
 
129
+ The following `bitsandbytes` quantization config was used during training:
130
+ - quant_method: bitsandbytes
131
+ - load_in_8bit: True
132
+ - load_in_4bit: False
133
+ - llm_int8_threshold: 6.0
134
+ - llm_int8_skip_modules: None
135
+ - llm_int8_enable_fp32_cpu_offload: False
136
+ - llm_int8_has_fp16_weight: False
137
+ - bnb_4bit_quant_type: fp4
138
+ - bnb_4bit_use_double_quant: False
139
+ - bnb_4bit_compute_dtype: float32
140
+
141
  The following `bitsandbytes` quantization config was used during training:
142
  - quant_method: bitsandbytes
143
  - load_in_8bit: True
 
174
  - PEFT 0.5.0
175
  - PEFT 0.5.0
176
  - PEFT 0.5.0
177
+ - PEFT 0.5.0
178
 
179
  - PEFT 0.5.0.dev0
180
  `bitsandbytes` quantization config was used during training:
Whisper PEFT Fine-Tuning/events.out.tfevents.1696436338.MLbox.300106.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e2b6432c4a69699a7b542c147c4b5b0c4ceca9c087dbe2080c3ebaa22ffcb8f6
3
- size 5545
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:94bdcd96fa14cea6a0aa01b078c2b2b8c61be16b5b284676d11b3b1d69f4e6fa
3
+ size 5704
adapter_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:95288710dc7deef9620afce08216d929e5b573b44492027876fc76721ffd6f8f
3
  size 38697637
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c2aef5cc5861aa4178fadf6aec45ec69bb0ede0dd24faa5f79f5e0acd0d39cfb
3
  size 38697637