Update README.md
Browse files
README.md
CHANGED
|
@@ -26,6 +26,8 @@ Zipped Quantization (if you want to download a single file)
|
|
| 26 |
- [6.0bpw](https://huggingface.co/hgloow/Merged-AGI-7B-EXL2/tree/6.0bpw-zip)
|
| 27 |
- [8.0bpw](https://huggingface.co/hgloow/Merged-AGI-7B-EXL2/tree/8.0bpw-zip)
|
| 28 |
|
|
|
|
|
|
|
| 29 |
## Memory Usage
|
| 30 |
Measured using ExLlamaV2 and 4096 max_seq_len with [Oobabooga's Text Generation WebUI](https://github.com/oobabooga/text-generation-webui/tree/main).
|
| 31 |
| Branch | BPW | VRAM Usage |
|
|
|
|
| 26 |
- [6.0bpw](https://huggingface.co/hgloow/Merged-AGI-7B-EXL2/tree/6.0bpw-zip)
|
| 27 |
- [8.0bpw](https://huggingface.co/hgloow/Merged-AGI-7B-EXL2/tree/8.0bpw-zip)
|
| 28 |
|
| 29 |
+
Calibration Dataset: [wikitext-103-v1](https://huggingface.co/datasets/wikitext/blob/9a9e482b5987f9d25b3a9b2883fc6cc9fd8071b3/wikitext-103-v1/wikitext-test.parquet)
|
| 30 |
+
|
| 31 |
## Memory Usage
|
| 32 |
Measured using ExLlamaV2 and 4096 max_seq_len with [Oobabooga's Text Generation WebUI](https://github.com/oobabooga/text-generation-webui/tree/main).
|
| 33 |
| Branch | BPW | VRAM Usage |
|