GitHub repository: nv-auto-deploy/TensorRT-LLM
Primary language: C++
Description: AutoDeploy's TensorRT-LLM fork for rapid prototyping+development. See below for current prebuilt wheel for default branch: