ehartford bartowski commited on
Commit
cae12e8
1 Parent(s): 1d5980f

Add quant links (#6)

Browse files

- Add quant links (dcf94cb5e61027ba88c41489cd852c622738a892)


Co-authored-by: Bartowski <bartowski@users.noreply.huggingface.co>

Files changed (1) hide show
  1. README.md +6 -0
README.md CHANGED
@@ -181,6 +181,12 @@ tokens:
181
 
182
  </details><br>
183
 
 
 
 
 
 
 
184
  ## Training procedure
185
 
186
  ### Training hyperparameters
 
181
 
182
  </details><br>
183
 
184
+ ## Quants
185
+
186
+ GGUF with imatrix: https://huggingface.co/bartowski/dolphin-2.9-llama3-8b-GGUF
187
+
188
+ Exllamav2: https://huggingface.co/bartowski/dolphin-2.9-llama3-8b-exl2
189
+
190
  ## Training procedure
191
 
192
  ### Training hyperparameters