This is the repository card of kernels-community/aiter-kernels that has been pushed on the Hub. It was built to be used with the kernels library. This card was automatically generated.

How to use

# make sure `kernels` is installed: `pip install -U kernels`
from kernels import get_kernel

kernel_module = get_kernel("kernels-community/aiter-kernels")
__kernel_metadata__ = kernel_module.__kernel_metadata__

__kernel_metadata__(...)

Available functions

  • __kernel_metadata__
  • RotateStyle
  • apply_rotary_transformers
  • activation
  • causal_conv1d
  • causal_conv1d_update_single_token
  • comms
  • fusions
  • gated_delta_net
  • gather_kv_b_proj
  • gemm
  • gluon
  • gmm
  • kv_cache
  • moe
  • normalization
  • quant
  • rope
  • softmax
  • topk
  • utils

Benchmarks

No benchmark available yet.

Downloads last month
-
mit