license: other | |
4.65 bit quantization of airoboros 70b 1.4.1 (https://huggingface.co/jondurbin/airoboros-l2-70b-gpt4-1.4.1), using exllama2. | |
Update 21/09/23 | |
Re-quanted with latest exllamav2 version, which fixed some measurement issues. |
license: other | |
4.65 bit quantization of airoboros 70b 1.4.1 (https://huggingface.co/jondurbin/airoboros-l2-70b-gpt4-1.4.1), using exllama2. | |
Update 21/09/23 | |
Re-quanted with latest exllamav2 version, which fixed some measurement issues. |