protoLabsAI
/

Ornith-1.5-9B-MTP-GGUF

Image-Text-to-Text

speculative-decoding

multi-token-prediction

Model card Files Files and versions

more quants

#2

by rththr - opened 19 days ago

can u make soemthing like iq4xxs or in iq3 for 6 gb vram people thanks

artificial-citizen

protoLabsAI org 18 days ago

here you go, there is also the iq2 avail now. https://huggingface.co/protoLabsAI/Ornith-1.5-9B-MTP-GGUF/blob/main/Ornith-1.5-9B-MTP-IQ3_M.gguf

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment