please create a quantized version, preferably using bitsandbytes!
#3
by
ctranslate2-4you
- opened
Really like the model but would like to use it with BitsandBytes...
Hey @ctranslate2-4you , check this out: https://huggingface.co/allenai/olmOCR-7B-0225-preview-GGUF