Can you convert Octopus V4 to GGUF?
#1
by
MouhuAI
- opened
I would like to convert light AI that exceeds the performance of GPT-3.5.
https://huggingface.co/NexaAIDev/Octopus-v4
Seems to not want to convert out of the box, don't have much time to investigate until tomorrow but I'll let you know if I find anything