MoE models for local inference on two 5060ti 16gb cards + 64 gb ram workstation
-
unsloth/Qwen3.6-35B-A3B-GGUF
Image-Text-to-Text • 35B • Updated • 1.44M • 1.76k -
huihui-ai/Huihui-Qwen3.6-35B-A3B-abliterated-MTP-GGUF
Image-Text-to-Text • 36B • Updated • 2.82M • 71 -
ISTA-DASLab/Qwen3.8-Flash-Next-GSQ-RCO-GGUF
Image-Text-to-Text • 177B • Updated • 7.3M • 1.16k -
openbmb/MiniCPM-V-4.7-35B-A3B-gguf
Image-Text-to-Text • 35B • Updated • 330k • 459