Unable to open model.bin on uncomment model?

#8
by mrprod - opened

Hello, i'm getting the following error in the logs when uncommenting the jp model in config.json5 for usage. I'm running the setup here on huggingface.co

    {
        "name": "whisper-large-v2-mix-jp",
        "url": "vumichien/whisper-large-v2-mix-jp",
    //    // The type of the model. Can be "huggingface" or "whisper" - "whisper" is the default.
    //    // HuggingFace models are loaded using the HuggingFace transformers library and then converted to Whisper models.
        "type": "huggingface"
    },

RuntimeError: Unable to open file 'model.bin' in model '/home/user/.cache/huggingface/hub/models--vumichien--whisper-large-v2-mix-jp/snapshots/53f44f82399d03957f4688cc88fcc8551dde353d'

Is there something extra I need to specify?

This is because the model at vumichien/whisper-large-v2-mix-jp is for Whisper, not Faster-Whisper. You need to convert the model to the CTranslate2 format, as specified here.

Luckily, there appears to be someone who have uploaded a converted version of whisper-large-v2-mix-jp to HuggingFace:

So you should be able to reference that instead, and use it directly in Faster-Whisper. Though it's not necessarily any better than large-v2.

{
    "name": "whisper-large-v2-mix-jp",
    "url": "arc-r/faster-whisper-large-v2-mix-jp",
    // The type of the model. Can be "huggingface" or "whisper" - "whisper" is the default.
    // HuggingFace models are loaded using the HuggingFace transformers library and then converted to Whisper models.
    "type": "huggingface",
},

Sign up or log in to comment