TheDrummer
/

Llama-3SOME-8B-v1-GGUF

GGUF

Not-For-All-Audiences

Model card Files Files and versions Community

4Q K_S request

by mpt369 - opened Apr 27

Discussion

mpt369

Apr 27

Hi, I'm curious about your model except my computer cannot run the 4q_k_m version without off-loading it into the RAM which is really slow, is a 4Q K_S version possible?

Haiart

Apr 27

You could use either the iMatrix iQ4nl or iQ4xs they also provided instead of the Q4_K_S.

https://huggingface.co/MarsupialAI/Llama-3SOME-8B-v1-BETA_iMatrix_GGUF/tree/main

mpt369

Apr 27

Thank you, I'll try that.

mpt369 changed discussion status to closed Apr 27

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment