OpenCodeInterpreter-DS-33B GGUF

Original model: OpenCodeInterpreter-DS-33B

Model creator: Multimodal Art Projection Research Community

PAUSED. DeepSeek model are not well supported by llama.cpp https://github.com/ggerganov/llama.cpp/issues/5981

Quants are tested to run with llama.cpp b2251. Quants are not yet evaluated, actual quality is unknown.

Downloads last month
0
GGUF
Model size
33.3B params
Architecture
llama

3-bit

4-bit

Inference Examples
Inference API (serverless) has been turned off for this model.

Model tree for Hugi-R/OpenCodeInterpreter-DS-33B-GGUF

Quantized
(4)
this model