gguf model
#2
by
edwardDali
- opened
Please add a gguf version...your models are fantastic! :)
few more sizes (and confirmed imatrix, not sure what crusoeai does) here:
https://huggingface.co/bartowski/openchat-3.6-8b-20240522-GGUF
exl2 here also for anyone who wants:
https://huggingface.co/bartowski/openchat-3.6-8b-20240522-exl2