vahe1994/spqr: Quantization algorithm and the model evaluation code for SpQR method for LLM compression
Quantization algorithm and the model evaluation code for SpQR method for LLM compression
Category: llm
Language: Python
Topics: compression, falcon, llama, quantization