Google Coral
Hi,
Would be wonderful to be able to run whisper on Google Coral. The tflite models i found are not compatible.
Unfortunately i don't have the knowledge to do it - maybe there is someone knowledgeable .
Thanx!
Hey @nastasev , you can run all Whisper models on a Google Colab, see https://colab.research.google.com/drive/1l290cRv4RdvuLNlSeo9WexByHaNWs3s3?usp=sharing
Hey Sanchit,
My question was if there are any whisper models adjusted so it can run on GoogleCoral/EdgeTPU? I see you pointing me towards Google Colab :) - which i know it works. Google Coral is an usb TPU accelerator made by Google. The issue with the whisper tflite quantized models i could find, was that models contained flex-ops - which are not supported by Coral.
Looking at your impressive work, I would like to ask 2 questions:
1 - is it possible to have a romanian tiny pretrained model (Mozilla has an open dataset)?
2 - is there any way of adjusting the whisper model not to use flex / dynamic tensors, so it can be compatible with Google Coral (i can help with testing or whatever needed). Running whisper on Coral would be a great feature, making whisper available for offline embedded devices (imagine offline alexa in local language).
Thanks!!
Virgil
Hello! This is an old thread, but did anyone manage to make it work?