GitHub repository: nagyist/lorax
Description: Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs