# k2_zipformer2_english_v1

- Zipformer2 recipe derived from : https://github.com/k2-fsa/icefall/tree/master/egs/librispeech/ASR/zipformer

- Training data : CommonVoice, VoxPopuli (speed-perturb 3x):
   - cca 1500 + 3x500 hours of training data

- Output text/symbols include:
   - TrueCase capitalization
   - punctuation `[,.?!]` as standalone tokens

## Config:
```
--num-epochs 20 \
--base-lr 0.04 \
\
--causal 1 \
--use-transducer 1 \
--use-ctc 0 \
\
--num-encoder-layers 2,2,2,2,2,2 \
--feedforward-dim 512,768,768,768,768,768 \
--encoder-dim 192,256,256,256,256,256 \
--encoder-unmasked-dim 192,192,192,192,192,192 \
```

## Results

| ID | System | cv-dev | cv-test | vp-dev | vp-test | Comment |
|---|-------------------------|--------|---------|--------|---------|-------------------------------|
| A | small (24M) | 18.57 | 21.98 | 13.66 | 13.26 | ep20,avg4 |

- non-streaming results from [decode.py](https://github.com/BUTSpeechFIT/k2_streaming_training/blob/main/training/zipformer/decode.py)
- cv = CommonVoice, vp = VoxPopuli
- exported the model averaging : ep20,avg4

## Note
- Not the best possible results, this model is for integration tests