GitHub repository: xxyux/SpInfer
Primary language: Cuda
Created: 2025-02-01T01:10:02Z
Description: SpInfer: Leveraging Low-Level Sparsity for Efficient Large   Language Model Inference on GPUs