zinc75 commited on
Commit
33ac478
1 Parent(s): 828efdc

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -36,7 +36,7 @@ model-index:
36
 
37
  Fine-tuned [facebook/wav2vec2-base-fr-voxpopuli-v2](https://huggingface.co/facebook/wav2vec2-base-fr-voxpopuli-v2) for **French speech-to-phoneme** using the train and validation splits of [Common Voice v13](https://huggingface.co/datasets/mozilla-foundation/common_voice_13_0).
38
 
39
- - The model has been trained for 14 epochs on 4 2080 Ti GPUs (256 audios per update, corresponding roughly to 25 minutes of speech per update -> 2k updates per epoch)
40
  - Learning rate schedule : Double Tri-state schedule
41
  - Warmup from 1e-5 for 7% of total updates
42
  - Constant at 1e-4 for 28% of total updates
 
36
 
37
  Fine-tuned [facebook/wav2vec2-base-fr-voxpopuli-v2](https://huggingface.co/facebook/wav2vec2-base-fr-voxpopuli-v2) for **French speech-to-phoneme** using the train and validation splits of [Common Voice v13](https://huggingface.co/datasets/mozilla-foundation/common_voice_13_0).
38
 
39
+ - The model has been trained for 14 epochs on 4x2080 Ti GPUs using a ddp strategy and gradient-accumulation procedure (256 audios per update, corresponding roughly to 25 minutes of speech per update -> 2k updates per epoch)
40
  - Learning rate schedule : Double Tri-state schedule
41
  - Warmup from 1e-5 for 7% of total updates
42
  - Constant at 1e-4 for 28% of total updates