Repository: bytedance/ABQ-LLM
Description: An acceleration library that supports arbitrary bit-width combinatorial quantization operations
Language: C++
Topics: cuda, llm-inference, mlsys, quantized-networks, research
License: Apache License 2.0
Stars: 247.0 | Forks: 22.0 | Open issues: 15.0
Created: 2024-08-23 10:55:28
Owner: bytedance (Singapore)