sophosympatheia
commited on
Commit
•
31e42ff
1
Parent(s):
9ceecdf
Update README.md
Browse filesAdded links to BigHuggy's exl2 quants
README.md
CHANGED
@@ -173,7 +173,14 @@ If you save this as a .json file, you can import it directly into Silly Tavern.
|
|
173 |
Use the Llama 3 instruct format. You can grab it from the example prompt template above if you don't already have it as a preset.
|
174 |
|
175 |
### Quantizations
|
176 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
177 |
|
178 |
### Licence and usage restrictions
|
179 |
[META LLAMA 3 COMMUNITY LICENSE AGREEMENT](https://huggingface.co/meta-llama/Meta-Llama-3-8B/blob/main/LICENSE)
|
|
|
173 |
Use the Llama 3 instruct format. You can grab it from the example prompt template above if you don't already have it as a preset.
|
174 |
|
175 |
### Quantizations
|
176 |
+
* Exllamav2 (exl2)
|
177 |
+
* [BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_4.5bpw_h8](https://huggingface.co/BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_4.5bpw_h8)
|
178 |
+
* [BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_5.5bpw_h8](https://huggingface.co/BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_5.5bpw_h8)
|
179 |
+
* [BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_6.0bpw_h8](https://huggingface.co/BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_6.0bpw_h8)
|
180 |
+
* [BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_6.5bpw_h8](https://huggingface.co/BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_6.5bpw_h8)
|
181 |
+
* [BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_7.0bpw_h8](https://huggingface.co/BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_7.0bpw_h8)
|
182 |
+
* [BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_7.5bpw_h8](https://huggingface.co/BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_7.5bpw_h8)
|
183 |
+
* [BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_8.0bpw_h8](https://huggingface.co/BigHuggyD/sophosympatheia_New-Dawn-Llama-3-70B-32K-v1.0_exl2_8.0bpw_h8)
|
184 |
|
185 |
### Licence and usage restrictions
|
186 |
[META LLAMA 3 COMMUNITY LICENSE AGREEMENT](https://huggingface.co/meta-llama/Meta-Llama-3-8B/blob/main/LICENSE)
|