GitHub repository: zhihu/ZhiLight
Primary language: C++
Created: 2024-12-06T11:28:18Z
Description: A highly optimized LLM inference acceleration engine for Llama and its variants.