KallistiTMR commited on
Commit
5b8a9b8
1 Parent(s): 9a1945b

Upload model

Browse files
Files changed (2) hide show
  1. README.md +24 -0
  2. adapter_model.bin +1 -1
README.md CHANGED
@@ -598,6 +598,28 @@ The following `bitsandbytes` quantization config was used during training:
598
  - bnb_4bit_use_double_quant: False
599
  - bnb_4bit_compute_dtype: float16
600
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
601
  The following `bitsandbytes` quantization config was used during training:
602
  - load_in_8bit: False
603
  - load_in_4bit: True
@@ -664,5 +686,7 @@ The following `bitsandbytes` quantization config was used during training:
664
  - PEFT 0.4.0
665
  - PEFT 0.4.0
666
  - PEFT 0.4.0
 
 
667
 
668
  - PEFT 0.4.0
 
598
  - bnb_4bit_use_double_quant: False
599
  - bnb_4bit_compute_dtype: float16
600
 
601
+ The following `bitsandbytes` quantization config was used during training:
602
+ - load_in_8bit: False
603
+ - load_in_4bit: True
604
+ - llm_int8_threshold: 6.0
605
+ - llm_int8_skip_modules: None
606
+ - llm_int8_enable_fp32_cpu_offload: False
607
+ - llm_int8_has_fp16_weight: False
608
+ - bnb_4bit_quant_type: nf4
609
+ - bnb_4bit_use_double_quant: False
610
+ - bnb_4bit_compute_dtype: float16
611
+
612
+ The following `bitsandbytes` quantization config was used during training:
613
+ - load_in_8bit: False
614
+ - load_in_4bit: True
615
+ - llm_int8_threshold: 6.0
616
+ - llm_int8_skip_modules: None
617
+ - llm_int8_enable_fp32_cpu_offload: False
618
+ - llm_int8_has_fp16_weight: False
619
+ - bnb_4bit_quant_type: nf4
620
+ - bnb_4bit_use_double_quant: False
621
+ - bnb_4bit_compute_dtype: float16
622
+
623
  The following `bitsandbytes` quantization config was used during training:
624
  - load_in_8bit: False
625
  - load_in_4bit: True
 
686
  - PEFT 0.4.0
687
  - PEFT 0.4.0
688
  - PEFT 0.4.0
689
+ - PEFT 0.4.0
690
+ - PEFT 0.4.0
691
 
692
  - PEFT 0.4.0
adapter_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c16511b0d6549c94345636ad3871420f55d35d2d9c5db4b02609de75be005bf3
3
  size 134263757
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:689766dcf119953b165f33707469055d26c32ea30b180487618dbca8f61d83ff
3
  size 134263757