cognitivecomputations

/

DeepSeek-V3-AWQ

like 6

Follow

Cognitive Computations 1.18k

Very much looking forward to the GPTQ version support, looking forward to having a GPTQ release due to the inability of the graphics card to support AWQ quantization!