GitHub repository: monologg/lorax
Description: Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs