Avnish Kumar
commited on
Commit
•
17544a5
1
Parent(s):
90c036c
Update README.md
Browse files
README.md
CHANGED
|
@@ -8,8 +8,8 @@ Open source falcon 7b large language model fine tuned on SQuAD dataset for quest
|
|
| 8 |
|
| 9 |
|
| 10 |
The following `bitsandbytes` quantization config was used during training:
|
| 11 |
-
- load_in_8bit:
|
| 12 |
-
- load_in_4bit:
|
| 13 |
- llm_int8_threshold: 6.0
|
| 14 |
- llm_int8_skip_modules: None
|
| 15 |
- llm_int8_enable_fp32_cpu_offload: False
|
|
|
|
| 8 |
|
| 9 |
|
| 10 |
The following `bitsandbytes` quantization config was used during training:
|
| 11 |
+
- load_in_8bit: True
|
| 12 |
+
- load_in_4bit: False
|
| 13 |
- llm_int8_threshold: 6.0
|
| 14 |
- llm_int8_skip_modules: None
|
| 15 |
- llm_int8_enable_fp32_cpu_offload: False
|