mobiuslabsgmbh
/

Llama-3-8b-instruct_2bitgs64_hqq

Text Generation

Model card Files Files and versions Community

mobicham commited on Jul 19, 2024

Commit

6e7e7ca

·

verified ·

1 Parent(s): 0ea99de

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -16,7 +16,7 @@ Moreover, this model is fully compatible with <a href="https://github.com/micros
 ## Model Size
 | Models            | fp16| HQQ+ 2-bit/gs-64|
 |:-------------------:|:--------:|:----------------:|
-| Bitrate     |   16           |  2.63           |
 | VRAM    |   13.1 (GB)       |  4.3 (GB)          |
 ## Model Decoding Speed

 ## Model Size
 | Models            | fp16| HQQ+ 2-bit/gs-64|
 |:-------------------:|:--------:|:----------------:|
+| Bitrate (Linear layers)    |   16           |  2.63           |
 | VRAM    |   13.1 (GB)       |  4.3 (GB)          |
 ## Model Decoding Speed