GitHub repository: predibase/lorax
Primary language: Python
Description: Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs