File size: 337 Bytes
b5af069 184793e a925b6b 6b7a6f4 184793e 50646a6 43f0f6b |
1 2 3 4 5 6 7 8 9 10 |
---
license: other
---
4bit variants quantizations of airoboros 70b 1.4.1 (https://huggingface.co/jondurbin/airoboros-l2-70b-gpt4-1.4.1), using exllama2.
You can find 4.25bpw (main branch), 4.5bpw and 4.75bpw in each branch.
Update 21/09/2023
Re-quanted all variants with latest exllamav2 version, which fixed some measurement issues. |