Accidentally removed original repo link
Browse files
README.md
CHANGED
|
@@ -15,6 +15,8 @@ Using <a href="https://github.com/turboderp/exllamav2/releases/tag/v0.0.13">turb
|
|
| 15 |
|
| 16 |
<b>The "main" branch only contains the measurement.json, download one of the other branches for the model (see below)</b>
|
| 17 |
|
|
|
|
|
|
|
| 18 |
Each branch contains an individual bits per weight, with the main one containing only the meaurement.json for further conversions.
|
| 19 |
|
| 20 |
| Branch | Bits | lm_head bits | VRAM (4k) | VRAM (16k) | VRAM (32k) | Description |
|
|
|
|
| 15 |
|
| 16 |
<b>The "main" branch only contains the measurement.json, download one of the other branches for the model (see below)</b>
|
| 17 |
|
| 18 |
+
Original model: https://huggingface.co/Kquant03/Buttercup-4x7B-V2-laser
|
| 19 |
+
|
| 20 |
Each branch contains an individual bits per weight, with the main one containing only the meaurement.json for further conversions.
|
| 21 |
|
| 22 |
| Branch | Bits | lm_head bits | VRAM (4k) | VRAM (16k) | VRAM (32k) | Description |
|