sophosympatheia commited on
Commit
31e42ff
1 Parent(s): 9ceecdf

Update README.md

Browse files

Added links to BigHuggy's exl2 quants

Files changed (1) hide show
  1. README.md +8 -1
README.md CHANGED
@@ -173,7 +173,14 @@ If you save this as a .json file, you can import it directly into Silly Tavern.
173
  Use the Llama 3 instruct format. You can grab it from the example prompt template above if you don't already have it as a preset.
174
 
175
  ### Quantizations
176
- Probably coming soon, and I'll update as they do. I would upload them myself but my Internet speeds are terrible for that. Someone else will undoutedly beat me to it.
 
 
 
 
 
 
 
177
 
178
  ### Licence and usage restrictions
179
  [META LLAMA 3 COMMUNITY LICENSE AGREEMENT](https://huggingface.co/meta-llama/Meta-Llama-3-8B/blob/main/LICENSE)
 
173
  Use the Llama 3 instruct format. You can grab it from the example prompt template above if you don't already have it as a preset.
174
 
175
  ### Quantizations
176
+ * Exllamav2 (exl2)
177
+ * [BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_4.5bpw_h8](https://huggingface.co/BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_4.5bpw_h8)
178
+ * [BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_5.5bpw_h8](https://huggingface.co/BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_5.5bpw_h8)
179
+ * [BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_6.0bpw_h8](https://huggingface.co/BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_6.0bpw_h8)
180
+ * [BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_6.5bpw_h8](https://huggingface.co/BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_6.5bpw_h8)
181
+ * [BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_7.0bpw_h8](https://huggingface.co/BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_7.0bpw_h8)
182
+ * [BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_7.5bpw_h8](https://huggingface.co/BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_7.5bpw_h8)
183
+ * [BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_8.0bpw_h8](https://huggingface.co/BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_8.0bpw_h8)
184
 
185
  ### Licence and usage restrictions
186
  [META LLAMA 3 COMMUNITY LICENSE AGREEMENT](https://huggingface.co/meta-llama/Meta-Llama-3-8B/blob/main/LICENSE)