candle

README.md

@@ -229,18 +229,6 @@ model = AutoModelForSpeechSeq2Seq.from_pretrained(model_id, torch_dtype=torch_dt
 + model = model.to_bettertransformer()
 ```
 
-### 8bit & 4bit Quantization
-
-Coming soon ...
-
-### Candle
-
-Coming soon ...
-
-### Whisper.cpp
-
-Coming soon ...
-
 ### Running Whisper in `openai-whisper`
 
 To use the model in the original Whisper format, first ensure you have the [`openai-whisper`](https://pypi.org/project/openai-whisper/) package installed:
@@ -290,6 +278,44 @@ let output = await transcriber(url);
 See the [docs](https://huggingface.co/docs/transformers.js/api/pipelines#module_pipelines.AutomaticSpeechRecognitionPipeline) for more information.
 
 
+
+### Candle
+
+Through an integration with Hugging Face [Candle](https://github.com/huggingface/candle/tree/main) 🕯️, Distil-Whisper is 
+now available in the Rust library 🦀
+
+Benefit from:
+* Optimised CPU backend with optional MKL support for x86 and Accelerate for Macs 
+* CUDA backend for efficiently running on GPUs, multiple GPU distribution via NCCL
+* WASM support: run Distil-Whisper in a browser
+
+Steps for getting started:
+1. Install [`candle-core`](https://github.com/huggingface/candle/tree/main/candle-core) as explained [here](https://huggingface.github.io/candle/guide/installation.html)
+2. Clone the `candle` repository locally:
+```
+git clone https://github.com/huggingface/candle.git
+```
+3. Enter the example directory for [Whisper](https://github.com/huggingface/candle/tree/main/candle-examples/examples/whisper):
+```
+cd candle/candle-examples/examples/whisper
+```
+4. Run an example:
+```
+cargo run --example whisper --release -- --model distil-medium.en
+```
+5. To specify your own audio file, add the `--input` flag:
+```
+cargo run --example whisper --release -- --model distil-medium.en --input audio.wav
+```
+
+### 8bit & 4bit Quantization
+
+Coming soon ...
+
+### Whisper.cpp
+
+Coming soon ...
+
 ## Model Details
 
 Distil-Whisper inherits the encoder-decoder architecture from Whisper. The encoder maps a sequence of speech vector