File size: 812 Bytes
1ae1332 cedaba5 1ae1332 |
1 2 3 4 5 6 7 8 9 10 11 12 |
EXL2 quants of [dbrx-instruct](https://huggingface.co/alpindale/dbrx-instruct).
Tokenizer from [here](https://huggingface.co/Xenova/dbrx-instruct-tokenizer)
[2.20 bits per weight](https://huggingface.co/turboderp/dbrx-instruct-exl2/tree/2.2bpw)
[2.30 bits per weight](https://huggingface.co/turboderp/dbrx-instruct-exl2/tree/2.3bpw)
[2.75 bits per weight](https://huggingface.co/turboderp/dbrx-instruct-exl2/tree/2.75bpw)
[3.00 bits per weight](https://huggingface.co/turboderp/dbrx-instruct-exl2/tree/3.0bpw)
[3.40 bits per weight](https://huggingface.co/turboderp/dbrx-instruct-exl2/tree/3.4bpw)
[3.75 bits per weight](https://huggingface.co/turboderp/dbrx-instruct-exl2/tree/3.75bpw)
[measurement.json](https://huggingface.co/turboderp/dbrx-instruct-exl2/blob/main/measurement.json) |