baseten
/

whisper_trt_large-v3_NVIDIA_L4_i224_o512_bs8_bw2_int8

Model card Files Files and versions Community

No model card

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Collection including baseten/whisper_trt_large-v3_NVIDIA_L4_i224_o512_bs8_bw2_int8

Whisper Engines

Collection

Compiled engines for running Whisper with TRT LLM for much faster inference. • 251 items • Updated 4 days ago • 1