GGUF quantum models for DBRX:
https://github.com/ggerganov/llama.cpp
Pierrick HYMBERT
phymbert
AI & ML interests
None yet
Organizations
Collections
1
models
7
![](https://cdn-avatars.huggingface.co/v1/production/uploads/65d6adbcca16ef9ba7e1af16/B0SHdzW92gAFRsuyeJLr3.jpeg)
phymbert/llama3-8b-instruct-q4_k_m-gguf
Updated
•
22
![](https://cdn-avatars.huggingface.co/v1/production/uploads/65d6adbcca16ef9ba7e1af16/B0SHdzW92gAFRsuyeJLr3.jpeg)
phymbert/dbrx-16x12b-instruct-q8_0-gguf
Updated
•
16
![](https://cdn-avatars.huggingface.co/v1/production/uploads/65d6adbcca16ef9ba7e1af16/B0SHdzW92gAFRsuyeJLr3.jpeg)
phymbert/dbrx-16x12b-instruct-iq3_xxs-gguf
Updated
•
16
•
1
![](https://cdn-avatars.huggingface.co/v1/production/uploads/65d6adbcca16ef9ba7e1af16/B0SHdzW92gAFRsuyeJLr3.jpeg)
phymbert/dbrx-16x12b-instruct-q6_k-gguf
Updated
•
24
![](https://cdn-avatars.huggingface.co/v1/production/uploads/65d6adbcca16ef9ba7e1af16/B0SHdzW92gAFRsuyeJLr3.jpeg)
phymbert/dbrx-16x12b-instruct-iq3_s-gguf
Updated
•
19
![](https://cdn-avatars.huggingface.co/v1/production/uploads/65d6adbcca16ef9ba7e1af16/B0SHdzW92gAFRsuyeJLr3.jpeg)
phymbert/dbrx-16x12b-instruct-q4_0-gguf
Updated
•
61
•
1
![](https://cdn-avatars.huggingface.co/v1/production/uploads/65d6adbcca16ef9ba7e1af16/B0SHdzW92gAFRsuyeJLr3.jpeg)
phymbert/dbrx-16x12b-instruct-q3_k_m-gguf
Updated
•
18
datasets
None public yet