GitHub repository: zhentaocc/BigDL
Primary language: Jupyter Notebook
Description: Accelerate LLM with low-bit (INT3 / INT4 / NF4 / INT5 / INT8) optimizations using bigdl-llm