Update README.md
Browse files
README.md
CHANGED
@@ -9,13 +9,7 @@ license: apache-2.0
|
|
9 |
|
10 |
## Quantization Description
|
11 |
|
12 |
-
This repo contains a
|
13 |
-
|
14 |
-
<div style="text-align: center;">
|
15 |
-
<a href="https://github.com/thesven/GGUF-n-Go">
|
16 |
-
<img src="https://github.com/thesven/GGUF-n-Go/blob/main/assets/quantized_with.png?raw=true" alt="image/png" style="max-width: 350px;">
|
17 |
-
</a>
|
18 |
-
</div>
|
19 |
|
20 |
### Prompt Template
|
21 |
```bash
|
|
|
9 |
|
10 |
## Quantization Description
|
11 |
|
12 |
+
This repo contains a GPTQ 4bit Quantized version of the WizardLM-2-7B model with the context expanded to 98k
|
|
|
|
|
|
|
|
|
|
|
|
|
13 |
|
14 |
### Prompt Template
|
15 |
```bash
|