garage-bAInd

/

Platypus2-70B-instruct

like 174

Follow

garage-bAInd 49

Hi @flavoredquark / @arielnlee

What's the best way for me to deploy this model? I'd love to make a demo of this with LiteLLM - https://github.com/BerriAI/litellm.

Lite currently works with Replicate, Azure, Together.ai and HF Inference Endpoints.

I'm facing issues with HF Inference endpoints due to quota limitations, so curious if you've tried any other provider.