I was going to make my own imatrix quants but (unsurprisingly) the great bartowski beat me to the punch.

So here's some mmproj files for the model, which no one else seems to have posted yet :)

mmproj-dots3-note-prev-q8_0.gguf

mmproj-dots3-note-prev-f16.gguf

Downloads last month
-
GGUF
Model size
8B params
Architecture
clip
Hardware compatibility
Log In to add your hardware
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for cdanis/dots3-note-prev-GGUF-mmproj

Quantized
(5)
this model