predibase/lorax: Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
Category: llm
Language: Python
Topics: fine-tuned, fine-tuning, gpt, gpu, llama, llm, llm-inference, llm-serving, llmops, lora, model-serving, pytorch, scale, transformers
Homepage: https://predibase.github.io/lorax/