GitHub repository: tloen/llama-int8
Primary language: Python
Description: Quantized inference code for LLaMA models