Running Phi 3 with vLLM and Ray Serve
While everyone is talking about new models and their possible use cases, their deployment aspect...
Tags: ray, llm, kubernetes, aiops