Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

kernels-community
/
quantization

kernel
Model card Files Files and versions Community
1
quantization / fp8
Ctrl+K
Ctrl+K
  • 3 contributors
History: 2 commits
danieldk's picture
danieldk HF Staff
Sync with vLLM
0da5bf5 4 months ago
  • amd
    Add `scaled_(int|fp8)_quant` and `fp8_marlin_gemm` 5 months ago
  • nvidia
    Add `scaled_(int|fp8)_quant` and `fp8_marlin_gemm` 5 months ago
  • common.cu
    5.71 kB
    Add `scaled_(int|fp8)_quant` and `fp8_marlin_gemm` 5 months ago
  • common.cuh
    5.63 kB
    Sync with vLLM 4 months ago
  • fp8_marlin.cu
    51.1 kB
    Add `scaled_(int|fp8)_quant` and `fp8_marlin_gemm` 5 months ago