hgloow
/

Merged-AGI-7B-EXL2

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

hgloow commited on Jan 2

Commit

bbe25c0

•

1 Parent(s): 169a850

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -31,7 +31,7 @@ Zipped Quantization (if you want to download a single file)
 [wikitext-103-v1](https://huggingface.co/datasets/wikitext/blob/9a9e482b5987f9d25b3a9b2883fc6cc9fd8071b3/wikitext-103-v1/wikitext-test.parquet)
 ## Memory Usage
-Measured using ExLlamaV2 and 4096 max_seq_len with [Oobabooga's Text Generation WebUI](https://github.com/oobabooga/text-generation-webui/tree/main).
 | Branch | BPW | VRAM Usage | Description |
 | ------ | --- | ---------- | ----------- |
 [3.0bpw](https://huggingface.co/hgloow/Merged-AGI-7B-EXL2/tree/3.0bpw)|3.0|3.7 GB|For >=6GB VRAM cards

 [wikitext-103-v1](https://huggingface.co/datasets/wikitext/blob/9a9e482b5987f9d25b3a9b2883fc6cc9fd8071b3/wikitext-103-v1/wikitext-test.parquet)
 ## Memory Usage
+Measured using ExLlamav2_HF and 4096 max_seq_len with [Oobabooga's Text Generation WebUI](https://github.com/oobabooga/text-generation-webui/tree/main).
 | Branch | BPW | VRAM Usage | Description |
 | ------ | --- | ---------- | ----------- |
 [3.0bpw](https://huggingface.co/hgloow/Merged-AGI-7B-EXL2/tree/3.0bpw)|3.0|3.7 GB|For >=6GB VRAM cards