I have tried to convert your model into ggml as https://github.com/ggerganov/whisper.cpp suggested for whisper.cpp consumption. It seems the conversion is running okay without errors. However, the whisper.cpp can't output any correct recognition by the converted ggml model. Can you help to check what's wrong? Here are what I did.

git clone https://github.com/openai/whisper
git clone https://github.com/ggerganov/whisper.cpp

clone HF fine-tuned model (this is just an example)

git clone git@hf.co:jonatasgrosman/whisper-large-zh-cv11

convert the model to ggml

python ./whisper.cpp/models/convert-h5-to-ggml.py ./whisper-large-zh-cv11/ ./whisper .