Wav2Vec2 base model trained of 1.5K hours of Vietnamese speech
The base model is pre-trained on 16kHz sampled speech audio from Vietnamese speech corpus containing 1.5K hours of reading and broadcasting speech. When using the model make sure that your speech input is also sampled at 16Khz. Note that this model should be fine-tuned on a downstream task, like Vietnamese Automatic Speech Recognition.
Note: This model does not have a tokenizer as it was pretrained on audio alone. In order to use this model speech recognition, a tokenizer should be created and the model should be fine-tuned on labeled text data. Check out this blog for more in-detail explanation of how to fine-tune the model.
Facebook's Wav2Vec2 blog Paper
See this notebook for more information on how to fine-tune the English pre-trained model.
import torch from transformers import Wav2Vec2Model model = Wav2Vec2Model.from_pretrained("dragonSwing/viwav2vec2-base-1.5k") # Sanity check inputs = torch.rand([1, 16000]) outputs = model(inputs)
- Downloads last month