datatab
/

Yugo45A-GPT-Quantized-GGUF

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Yugo45A-GPT-Quantized-GGUF / Yugo45A-GPT-Quantized-GGUF.Q3_K_M.gguf

Commit History

q3_k_m: Uses Q4_K for the attention.wv, attention.wo, and feed_forward.w2 tensors, else Q3_K

8336ecd
verified

datatab commited on Feb 29