GitHub repository: nagyist/picollm
Primary language: Python
Description: On-device LLM Inference Powered by X-Bit Quantization