RASMUS's picture
Update README.md
cb5737c
|
raw
history blame
1.75 kB
metadata
language:
  - fi
license: apache-2.0
tags:
  - whisper-event
  - finnish
datasets:
  - mozilla-foundation/common_voice_11_0
  - google/fleurs
metrics:
  - wer
  - cer
model-index:
  - name: Whisper Large V3 Finnish
    results:
      - task:
          name: Automatic Speech Recognition
          type: automatic-speech-recognition
        dataset:
          name: Common Voice 11.0
          type: mozilla-foundation/common_voice_11_0
          config: fi
          split: test
          args: fi
        metrics:
          - name: Wer
            type: wer
            value: 8.23
          - name: Cer
            type: cer
            value: 1.43
      - task:
          name: Automatic Speech Recognition
          type: automatic-speech-recognition
        dataset:
          name: FLEURS
          type: google/fleurs
          config: fi_fi
          split: test
          args: fi_fi
        metrics:
          - name: Wer
            type: wer
            value: 8.21
          - name: Cer
            type: cer
            value: 3.23

This is our improved Whisper model that is now finetuned from OpenAI Whisper Large V3 We improve from our finetuned V2 model: CV11 WER 10.42 --> 8.23 Fleurs WER 10.20 --> 8.21

Original Whisper Large V3

  • CV11

    • WER: 14.81
    • WER NORMALIZED: 10.82
    • CER: 2.7
    • CER NORMALIZED: 2.07
  • Fleurs

    • WER: 12.04
    • WER NORMALIZED: 9.63
    • CER: 2.48
    • CER NORMALIZED: 3.64

After Finetuning V3:

  • @14000 steps

    • CV11

      • WER: 11.36
      • WER NORMALIZED: 8.31
      • CER: 1.93
      • CER NORMALIZED: 1.48
    • Fleurs

      • WER: 10.2
      • WER NORMALIZED: 8.56
      • CER: 2.26
      • CER NORMALIZED: 3.54
  • @32000 steps

    • CV11

      • WER: 11.47
      • WER NORMALIZED: 8.23
      • CER: 1.91
      • CER NORMALIZED: 1.43
    • Fleurs

      • WER: 10.1
      • WER NORMALIZED: 8.21
      • CER: 2.2
      • CER NORMALIZED: 3.23