---
license: other
---
4bit variants quantizations of airoboros 70b 1.4.1 (https://huggingface.co/jondurbin/airoboros-l2-70b-gpt4-1.4.1), using exllama2.

You can find 4.25bpw (main branch), 4.5bpw and 4.75bpw in each branch.

Update 21/09/2023

Re-quanted all variants with latest exllamav2 version, which fixed some measurement issues.