unsloth
/

Qwen3.5-397B-A17B-GGUF

Image-Text-to-Text

Model card Files Files and versions

Resources

View closed (3)

Qwen3.5 GGUF Evaluation Results

#9 opened 2 months ago by

Q3_K_XL works surprisingly fast for 3x3090 + 128 ram

#4 opened 2 months ago by

Thank you! The UD-IQ2_M quant is amazing.

#23 opened 6 days ago by

Re-generate GGUFs to benefit from 10% speedup

#22 opened about 1 month ago by

No UD-IQ1_S after the update?

#21 opened about 1 month ago by

UD confusion

#20 opened about 1 month ago by

please restore the TQ1_0 model

#19 opened about 1 month ago by

Old UD quants gone?

#18 opened about 1 month ago by

Mac M3 Ultra 256GB

#16 opened about 2 months ago by

Do the 397B quants need to be downloaded again?

#15 opened about 2 months ago by

Is there any content questioning restriction for this?

#14 opened about 2 months ago by

keep crashing on llama.cpp

#13 opened about 2 months ago by

Very impressed by Qwen3.5-397B-A17B-UD-TQ1_0.gguf quant

#12 opened about 2 months ago by

How to enable vision encoder?

#10 opened 2 months ago by

Is it possible to turn off thinking mode on Llama.cpp?

#8 opened 2 months ago by

CUDA error: an illegal memory access was encountered for UD-Q8_K_XL/Qwen3.5-397B-A17B-UD-Q8_K_XL-00001-of-00011.gguf

#7 opened 2 months ago by

request: Standalone notebook for Unsloth Dynamic Quant 2.0 (GGUF export)

#6 opened 2 months ago by

Quant comparison versus "smol-IQ2_XS"

#5 opened 2 months ago by

Core dumped for me,

#3 opened 2 months ago by

How to choose MXFP4 vs Q4_K_XL on CPU + CUDA

#1 opened 2 months ago by