dranger003 commited on
Commit
7bd97ee
1 Parent(s): f72e30b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -1
README.md CHANGED
@@ -7,4 +7,8 @@ GGUF importance matrix (imatrix) quants for https://huggingface.co/CausalLM/34b-
7
  The importance matrix was trained for 40K tokens (80 batches of 512 tokens) using random data.
8
 
9
  From the model author:
10
- *Please do not use wikitext for quantization calibration because all wikitext have been re-aligned on synthetic dataset, and its distribution differs significantly from the original wikitext.*
 
 
 
 
 
7
  The importance matrix was trained for 40K tokens (80 batches of 512 tokens) using random data.
8
 
9
  From the model author:
10
+ *Please do not use wikitext for quantization calibration because all wikitext have been re-aligned on synthetic dataset, and its distribution differs significantly from the original wikitext.*
11
+
12
+ | Layers | Context | Template |
13
+ | --- | --- | --- |
14
+ | <pre>60</pre> | <pre>200000</pre> | <pre><\|im_start\|>system<br>{instructions}<\|im_end\|><br><\|im_start\|>user<br>{prompt}<\|im_end\|><br><\|im_start\|>assistant<br>{response}</pre> |