Free and ready to use Mistral-7B-OpenOrca-GGUF model as OpenAI API compatible endpoint
Hi there,
I deployed the model as OpenAI API compatible endpoint at https://huggingface.co/spaces/limcheekin/Mistral-7B-OpenOrca-GGUF.
If you find this resource valuable, your support in the form of starring the space would be greatly appreciated.
Thank you.
So I was working with this project:
https://github.com/BerriAI/litellm
https://litellm.ai/
But yours seams simple and performant. Can you please share the code?
So I was working with this project:
https://github.com/BerriAI/litellm
https://litellm.ai/
But yours seams simple and performant. Can you please share the code?
Just clone the space to your local using git will do, all codes are public at https://huggingface.co/spaces/limcheekin/Mistral-7B-OpenOrca-GGUF/tree/main published under MIT license.
Happy coding! :)