inference_code_snippet_added

README.md

@@ -55,6 +55,21 @@ In order to infer a single audio file using this model, the following code snipp
 >>> print('Transcription: ', transcribe(audio)["text"])
 ```
 
+For faster inference of whisper models the [whisper-jax](https://github.com/sanchit-gandhi/whisper-jax) library can be used. Please follow the necessary installation steps as mentioned [here](https://github.com/vasistalodagala/whisper-finetune#faster-evaluation-with-whisper-jax), before using the following code snippet:
+
+```python
+>>> import jax.numpy as jnp
+>>> from whisper_jax import FlaxWhisperForConditionalGeneration, FlaxWhisperPipline
+
+>>> # path to the audio file to be transcribed
+>>> audio = "/path/to/audio.format"
+
+>>> transcribe = FlaxWhisperPipline("vasista22/whisper-kannada-medium", batch_size=16)
+>>> transcribe.model.config.forced_decoder_ids = transcribe.tokenizer.get_decoder_prompt_ids(language="kn", task="transcribe")
+
+>>> print('Transcription: ', transcribe(audio)["text"])
+```
+
 ## Training and evaluation data
 
 Training Data: