---
language: sv
tags:
- audio
- automatic-speech-recognition
- voxrex
license: cc0-1.0
---
# Wav2vec 2.0 large VoxRex (C)
**Please note:** The model hosted in this repository is a pretrained wav2vec2 without a CTC head, as such it cannot do speech-to-text. If you are interested in speech-to-text, see our finetuned version of this model, which can be found at [KBLab/wav2vec2-large-voxrex-swedish](https://huggingface.co/KBLab/wav2vec2-large-voxrex-swedish). The weights found in this repository are from the pure acoustic model after unsupervised pretraining. This model is suitable for anyone interested in i) continued wav2vec2-pretraining with your own unsupervised data, ii) a feature extractor for finetuning your own downstream tasks (e.g. if you want to train your own CTC head, or an audio classifier).
**Disclaimer:** This is a work in progress.
**Update 2022-01-08:** Updated to VoxRex-C version, use git to get the older (B) version.
**Update 2022-05-16:** Paper is is [here](https://arxiv.org/abs/2205.03026).
This model has been pretrained for 400,000 updates on the P4-10k corpus which contains 10 000 hours of swedish local public service radio as well as 1500 hours of audio books and other speech from KBs collections.
![Accuracy during training](accuracy.svg "Accuracy")