Commit
•
4c5a0ad
1
Parent(s):
c6d19d0
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,6 +1,6 @@
|
|
| 1 |
Original model: https://huggingface.co/Doctor-Shotgun/Nous-Capybara-limarpv3-34B
|
| 2 |
|
| 3 |
-
Using
|
| 4 |
|
| 5 |
4.65bpw - Can run 21k context in ~23.3GB VRAM with 8bit-cache option.
|
| 6 |
|
|
|
|
| 1 |
Original model: https://huggingface.co/Doctor-Shotgun/Nous-Capybara-limarpv3-34B
|
| 2 |
|
| 3 |
+
Using erotiquantxl.parquet as calibration dataset.
|
| 4 |
|
| 5 |
4.65bpw - Can run 21k context in ~23.3GB VRAM with 8bit-cache option.
|
| 6 |
|