Hugging Face's logo

turboderp
/
dbrx-base-exl2

Model card Files Community
dbrx-base-exl2
File size: 776 Bytes 
eff5af4
 
797a883
 
eff5af4
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
 
EXL2 quants of [dbrx-base](https://huggingface.co/alpindale/dbrx-base).

Tokenizer from [here](https://huggingface.co/Xenova/dbrx-instruct-tokenizer)

[2.20 bits per weight](https://huggingface.co/turboderp/dbrx-base-exl2/tree/2.2bpw)    
[2.30 bits per weight](https://huggingface.co/turboderp/dbrx-base-exl2/tree/2.3bpw)    
[2.75 bits per weight](https://huggingface.co/turboderp/dbrx-base-exl2/tree/2.75bpw)    
[3.00 bits per weight](https://huggingface.co/turboderp/dbrx-base-exl2/tree/3.0bpw)    
[3.40 bits per weight](https://huggingface.co/turboderp/dbrx-base-exl2/tree/3.4bpw)    
[3.75 bits per weight](https://huggingface.co/turboderp/dbrx-base-exl2/tree/3.75bpw)    

[measurement.json](https://huggingface.co/turboderp/dbrx-base-exl2/blob/main/measurement.json)