ray-project/ray-llm: RayLLM - LLMs on Ray
Category: llm
Language: Python
Topics: distributed-systems, large-language-models, llm, llm-inference, llm-serving, llmops, ray, serving, transformers
Homepage: https://aviary.anyscale.com