Edit model card

This is the Q8_0 quantum model for llama.cpp:

https://github.com/ggerganov/llama.cpp/pull/6515

Downloads last month
46
GGUF
Model size
132B params
Architecture
dbrx

8-bit

Inference API
Unable to determine this model's library. Check the docs .

Collection including phymbert/dbrx-16x12b-instruct-q8_0-gguf