Error Run DeepSeek-R1-0528-Qwen3-8B-Q8_0.gguf

by deleted - opened Jun 10

deleted

Jun 10

🥲 Failed to load the model

Failed to load model

error loading model: llama_model_loader: failed to load model from D:\Model\!\New Folder\DeepSeek-R1-0528-Qwen3-8B-Q8_0.gguf

mukel

Jun 10

Q8_0 quant is corrupted, it's only 4GB while Q8_0 it should be ~8GB.

deleted

Jun 10

Q8_0 quant is corrupted, it's only 4GB while Q8_0 it should be ~8GB.

Yes I noticed this oddity, I downloaded the UD version it works fine

danielhanchen

Unsloth AI org Jun 15

Oh my apologies - I'll redo it - I'm unsure how that happened sorry!

shimmyshimmer

Unsloth AI org Jun 15

This comment has been hidden

shimmyshimmer

Unsloth AI org Jun 16

@E7Reine @mukel should now be reuploaded and fixed!

deleted

Jun 16

@E7Reine @mukel should now be reuploaded and fixed!

Thanks for your efforts, I have already tried UD Quant, to my surprise they are great Q4_K_XL performed well.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment