mukowaty/faster-whisper-int8

Whisper models for CTranslate2 with quantization INT8

This repository contains the conversion of OpenAI Whisper models to the CTranslate2 model format.

Conversion details

The original model was converted with the following command:

ct2-transformers-converter --model openai/<model name> --output_dir faster-<model name>-int8 \
    --copy_files tokenizer.json --quantization int8

Note that the model weights are saved in INT8.

Models sources

• https://huggingface.co/openai/whisper-tiny

• https://huggingface.co/openai/whisper-tiny.en

• https://huggingface.co/openai/whisper-base

• https://huggingface.co/openai/whisper-base.en

• https://huggingface.co/openai/whisper-small

• https://huggingface.co/openai/whisper-small.en

• https://huggingface.co/openai/whisper-medium.en

• https://huggingface.co/openai/whisper-medium

• https://huggingface.co/openai/whisper-large-v2

• https://huggingface.co/openai/whisper-large-v3

• https://huggingface.co/distil-whisper/distil-small.en

• https://huggingface.co/distil-whisper/distil-medium.en

• https://huggingface.co/distil-whisper/distil-large-v2

• https://huggingface.co/distil-whisper/distil-large-v3

• https://huggingface.co/Aspik101/distil-whisper-large-v3-pl