GitHub repository: Infini-AI-Lab/UMbreLLa
Primary language: Python
Description: LLM Inference on consumer devices