maidacundo commited on
Commit
2fb532a
1 Parent(s): 5ea56a5

End of training

Browse files
Files changed (3) hide show
  1. README.md +13 -0
  2. adapter_model.bin +1 -1
  3. training_args.bin +1 -1
README.md CHANGED
@@ -7,6 +7,7 @@ datasets:
7
  model-index:
8
  - name: falcon_qlora_sql
9
  results: []
 
10
  ---
11
 
12
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -30,6 +31,17 @@ More information needed
30
 
31
  ## Training procedure
32
 
 
 
 
 
 
 
 
 
 
 
 
33
  ### Training hyperparameters
34
 
35
  The following hyperparameters were used during training:
@@ -44,6 +56,7 @@ The following hyperparameters were used during training:
44
 
45
  ### Framework versions
46
 
 
47
  - Transformers 4.31.0.dev0
48
  - Pytorch 2.0.1+cu118
49
  - Datasets 2.13.1
 
7
  model-index:
8
  - name: falcon_qlora_sql
9
  results: []
10
+ library_name: peft
11
  ---
12
 
13
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
31
 
32
  ## Training procedure
33
 
34
+
35
+ The following `bitsandbytes` quantization config was used during training:
36
+ - load_in_8bit: False
37
+ - load_in_4bit: True
38
+ - llm_int8_threshold: 6.0
39
+ - llm_int8_skip_modules: None
40
+ - llm_int8_enable_fp32_cpu_offload: False
41
+ - llm_int8_has_fp16_weight: False
42
+ - bnb_4bit_quant_type: nf4
43
+ - bnb_4bit_use_double_quant: True
44
+ - bnb_4bit_compute_dtype: bfloat16
45
  ### Training hyperparameters
46
 
47
  The following hyperparameters were used during training:
 
56
 
57
  ### Framework versions
58
 
59
+ - PEFT 0.4.0.dev0
60
  - Transformers 4.31.0.dev0
61
  - Pytorch 2.0.1+cu118
62
  - Datasets 2.13.1
adapter_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:da09e230a257408893b2bca281eaf5787faa5cedbc30bccc919e5bcdf86bb433
3
  size 2382961
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5299ceac4d1bea7373f237977d04d3b4db77bd1d6a5b24f5bfff8bdfd8aa5303
3
  size 2382961
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:43622eccdfb6ef105e8b872de773a25495f9ed8c2fb0b26e7391d3716a9bf9ff
3
  size 3963
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:15c20875831195fbc1ac91ff57a96e68d4073c83568c3069eacb629d7bd72470
3
  size 3963