How to use nvidia/parakeet-tdt-0.6b-v3 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("automatic-speech-recognition", model="nvidia/parakeet-tdt-0.6b-v3")
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("nvidia/parakeet-tdt-0.6b-v3", dtype="auto")
I usually use vLLM but it doesn't support parakeet.
· Sign up or log in to comment
