Curious about the use of OpenAI API in the demo?
#1
by
1littlecoder
- opened
I'm just cuurious about the use of OpenAI API in the demo?
It is a vLLM-powered OpenAI-compatible API endpoint. Similar to what is documented here: https://huggingface.co/Open-Orca/OpenOrcaxOpenChat-Preview2-13B#serving-with-openchat
It still seems abstract. Can you explain it in a better way if thats possible?
If I understand corretly, it's an api endpoint that is in the same form as openAI. It's not the openAi api, it's 'An OpenAI-compatible API endpoint' that Platypus uses. I think this means you can call platypus just like you'd call gpt3/4.