Automatic Speech Recognition
NeMo
PyTorch
English
speech
audio
CTC
Conformer
Transformer
NeMo
Eval Results
wenqiglantz commited on
Commit
acf1e28
1 Parent(s): 9dc856f

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +112 -0
README.md ADDED
@@ -0,0 +1,112 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ license: cc-by-4.0
5
+ library_name: nemo
6
+ datasets:
7
+ - librispeech_asr
8
+ - mozilla-foundation/common_voice_7_0
9
+ - vctk
10
+ - fisher_corpus
11
+ - Switchboard-1
12
+ - WSJ-0
13
+ - WSJ-1
14
+ - National-Singapore-Corpus-Part-1
15
+ - National-Singapore-Corpus-Part-6
16
+ - voxpopuli
17
+ - europarl
18
+ - multilingual_librispeech
19
+ thumbnail: null
20
+ tags:
21
+ - automatic-speech-recognition
22
+ - speech
23
+ - audio
24
+ - CTC
25
+ - Conformer
26
+ - Transformer
27
+ - NeMo
28
+ - pytorch
29
+ model-index:
30
+ - name: stt_en_conformer_ctc_small
31
+ results: []
32
+
33
+ ---
34
+
35
+ ## Model Overview
36
+
37
+ <DESCRIBE IN ONE LINE THE MODEL AND ITS USE>
38
+
39
+ ## NVIDIA NeMo: Training
40
+
41
+ To train, fine-tune or play with the model you will need to install [NVIDIA NeMo](https://github.com/NVIDIA/NeMo). We recommend you install it after you've installed latest Pytorch version.
42
+ ```
43
+ pip install nemo_toolkit['all']
44
+ ```
45
+
46
+ ## How to Use this Model
47
+
48
+ The model is available for use in the NeMo toolkit [3], and can be used as a pre-trained checkpoint for inference or for fine-tuning on another dataset.
49
+
50
+ ### Automatically instantiate the model
51
+
52
+ ```python
53
+ import nemo.collections.asr as nemo_asr
54
+ asr_model = nemo_asr.models.ASRModel.from_pretrained("wenqiglantz/stt_en_conformer_ctc_small")
55
+ ```
56
+
57
+ ### Transcribing using Python
58
+ First, let's get a sample
59
+ ```
60
+ wget https://dldata-public.s3.us-east-2.amazonaws.com/2086-149220-0033.wav
61
+ ```
62
+ Then simply do:
63
+ ```
64
+ asr_model.transcribe(['2086-149220-0033.wav'])
65
+ ```
66
+
67
+ ### Transcribing many audio files
68
+
69
+ ```shell
70
+ python [NEMO_GIT_FOLDER]/examples/asr/transcribe_speech.py pretrained_name="wenqiglantz/stt_en_conformer_ctc_small" audio_dir="<DIRECTORY CONTAINING AUDIO FILES>"
71
+ ```
72
+
73
+ ### Input
74
+
75
+ This model accepts 16000 KHz Mono-channel Audio (wav files) as input.
76
+
77
+ ### Output
78
+
79
+ This model provides transcribed speech as a string for a given audio sample.
80
+
81
+ ## Model Architecture
82
+
83
+ <ADD SOME INFORMATION ABOUT THE ARCHITECTURE>
84
+
85
+ ## Training
86
+
87
+ <ADD INFORMATION ABOUT HOW THE MODEL WAS TRAINED - HOW MANY EPOCHS, AMOUNT OF COMPUTE ETC>
88
+
89
+ ### Datasets
90
+
91
+ <LIST THE NAME AND SPLITS OF DATASETS USED TO TRAIN THIS MODEL (ALONG WITH LANGUAGE AND ANY ADDITIONAL INFORMATION)>
92
+
93
+ ## Performance
94
+
95
+ <LIST THE SCORES OF THE MODEL -
96
+ OR
97
+ USE THE Hugging Face Evaluate LiBRARY TO UPLOAD METRICS>
98
+
99
+ ## Limitations
100
+
101
+ <DECLARE ANY POTENTIAL LIMITATIONS OF THE MODEL>
102
+
103
+ Eg:
104
+ Since this model was trained on publicly available speech datasets, the performance of this model might degrade for speech which includes technical terms, or vernacular that the model has not been trained on. The model might also perform worse for accented speech.
105
+
106
+
107
+ ## References
108
+
109
+ <ADD ANY REFERENCES HERE AS NEEDED>
110
+
111
+ [1] [NVIDIA NeMo Toolkit](https://github.com/NVIDIA/NeMo)
112
+