Update README.md
Browse files
README.md
CHANGED
@@ -15,7 +15,7 @@ datasets:
|
|
15 |
|
16 |
## **Nous Capybara 57B**
|
17 |
|
18 |
-
(https://github.com/turboderp/exllamav2)
|
19 |
|
20 |
Runs smoothly on single 3090 in webui with context length set to 4096, ExLlamav2_HF loader
|
21 |
and cache_8bit=True
|
|
|
15 |
|
16 |
## **Nous Capybara 57B**
|
17 |
|
18 |
+
[exllamav2](https://github.com/turboderp/exllamav2) quant for [TeeZee/2xNous-Capybara-34B](https://huggingface.co/TeeZee/2xNous-Capybara-34B)
|
19 |
|
20 |
Runs smoothly on single 3090 in webui with context length set to 4096, ExLlamav2_HF loader
|
21 |
and cache_8bit=True
|