GitHub repository: miacycle/fp6_llm
Description: An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).