mandelakori
commited on
Commit
•
3eb569c
1
Parent(s):
f17107f
Update README.md
Browse files
README.md
CHANGED
@@ -1,199 +1,155 @@
|
|
1 |
---
|
2 |
-
|
3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
4 |
---
|
|
|
5 |
|
6 |
-
|
7 |
|
8 |
-
|
9 |
|
|
|
10 |
|
|
|
|
|
|
|
|
|
11 |
|
12 |
-
|
13 |
|
14 |
-
|
15 |
|
16 |
-
|
17 |
|
18 |
-
|
19 |
|
20 |
-
|
21 |
-
- **Funded by [optional]:** [More Information Needed]
|
22 |
-
- **Shared by [optional]:** [More Information Needed]
|
23 |
-
- **Model type:** [More Information Needed]
|
24 |
-
- **Language(s) (NLP):** [More Information Needed]
|
25 |
-
- **License:** [More Information Needed]
|
26 |
-
- **Finetuned from model [optional]:** [More Information Needed]
|
27 |
|
28 |
-
|
|
|
29 |
|
30 |
-
|
31 |
|
32 |
-
-
|
33 |
-
-
|
34 |
-
- **Demo [optional]:** [More Information Needed]
|
35 |
|
36 |
-
|
37 |
|
38 |
-
|
39 |
|
40 |
-
###
|
41 |
|
42 |
-
|
43 |
|
44 |
-
[More Information Needed]
|
45 |
|
46 |
-
|
47 |
|
48 |
-
<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
|
49 |
|
50 |
-
|
51 |
|
52 |
-
|
53 |
-
|
54 |
-
<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
|
55 |
-
|
56 |
-
[More Information Needed]
|
57 |
-
|
58 |
-
## Bias, Risks, and Limitations
|
59 |
-
|
60 |
-
<!-- This section is meant to convey both technical and sociotechnical limitations. -->
|
61 |
-
|
62 |
-
[More Information Needed]
|
63 |
-
|
64 |
-
### Recommendations
|
65 |
-
|
66 |
-
<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
|
67 |
-
|
68 |
-
Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
|
69 |
-
|
70 |
-
## How to Get Started with the Model
|
71 |
-
|
72 |
-
Use the code below to get started with the model.
|
73 |
-
|
74 |
-
[More Information Needed]
|
75 |
-
|
76 |
-
## Training Details
|
77 |
-
|
78 |
-
### Training Data
|
79 |
-
|
80 |
-
<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
|
81 |
-
|
82 |
-
[More Information Needed]
|
83 |
-
|
84 |
-
### Training Procedure
|
85 |
-
|
86 |
-
<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
|
87 |
-
|
88 |
-
#### Preprocessing [optional]
|
89 |
-
|
90 |
-
[More Information Needed]
|
91 |
-
|
92 |
-
|
93 |
-
#### Training Hyperparameters
|
94 |
-
|
95 |
-
- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
|
96 |
-
|
97 |
-
#### Speeds, Sizes, Times [optional]
|
98 |
-
|
99 |
-
<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
|
100 |
-
|
101 |
-
[More Information Needed]
|
102 |
-
|
103 |
-
## Evaluation
|
104 |
-
|
105 |
-
<!-- This section describes the evaluation protocols and provides the results. -->
|
106 |
-
|
107 |
-
### Testing Data, Factors & Metrics
|
108 |
-
|
109 |
-
#### Testing Data
|
110 |
-
|
111 |
-
<!-- This should link to a Dataset Card if possible. -->
|
112 |
-
|
113 |
-
[More Information Needed]
|
114 |
-
|
115 |
-
#### Factors
|
116 |
-
|
117 |
-
<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
|
118 |
-
|
119 |
-
[More Information Needed]
|
120 |
-
|
121 |
-
#### Metrics
|
122 |
-
|
123 |
-
<!-- These are the evaluation metrics being used, ideally with a description of why. -->
|
124 |
-
|
125 |
-
[More Information Needed]
|
126 |
-
|
127 |
-
### Results
|
128 |
-
|
129 |
-
[More Information Needed]
|
130 |
-
|
131 |
-
#### Summary
|
132 |
-
|
133 |
-
|
134 |
-
|
135 |
-
## Model Examination [optional]
|
136 |
-
|
137 |
-
<!-- Relevant interpretability work for the model goes here -->
|
138 |
-
|
139 |
-
[More Information Needed]
|
140 |
-
|
141 |
-
## Environmental Impact
|
142 |
-
|
143 |
-
<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
|
144 |
-
|
145 |
-
Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
|
146 |
-
|
147 |
-
- **Hardware Type:** [More Information Needed]
|
148 |
-
- **Hours used:** [More Information Needed]
|
149 |
-
- **Cloud Provider:** [More Information Needed]
|
150 |
-
- **Compute Region:** [More Information Needed]
|
151 |
-
- **Carbon Emitted:** [More Information Needed]
|
152 |
-
|
153 |
-
## Technical Specifications [optional]
|
154 |
-
|
155 |
-
### Model Architecture and Objective
|
156 |
-
|
157 |
-
[More Information Needed]
|
158 |
-
|
159 |
-
### Compute Infrastructure
|
160 |
-
|
161 |
-
[More Information Needed]
|
162 |
-
|
163 |
-
#### Hardware
|
164 |
-
|
165 |
-
[More Information Needed]
|
166 |
-
|
167 |
-
#### Software
|
168 |
-
|
169 |
-
[More Information Needed]
|
170 |
-
|
171 |
-
## Citation [optional]
|
172 |
-
|
173 |
-
<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
|
174 |
-
|
175 |
-
**BibTeX:**
|
176 |
-
|
177 |
-
[More Information Needed]
|
178 |
-
|
179 |
-
**APA:**
|
180 |
-
|
181 |
-
[More Information Needed]
|
182 |
-
|
183 |
-
## Glossary [optional]
|
184 |
-
|
185 |
-
<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
|
186 |
-
|
187 |
-
[More Information Needed]
|
188 |
-
|
189 |
-
## More Information [optional]
|
190 |
-
|
191 |
-
[More Information Needed]
|
192 |
-
|
193 |
-
## Model Card Authors [optional]
|
194 |
-
|
195 |
-
[More Information Needed]
|
196 |
-
|
197 |
-
## Model Card Contact
|
198 |
-
|
199 |
-
[More Information Needed]
|
|
|
1 |
---
|
2 |
+
language:
|
3 |
+
- en
|
4 |
+
- zh
|
5 |
+
- de
|
6 |
+
- es
|
7 |
+
- ru
|
8 |
+
- ko
|
9 |
+
- fr
|
10 |
+
- ja
|
11 |
+
- pt
|
12 |
+
- tr
|
13 |
+
- pl
|
14 |
+
- ca
|
15 |
+
- nl
|
16 |
+
- ar
|
17 |
+
- sv
|
18 |
+
- it
|
19 |
+
- id
|
20 |
+
- hi
|
21 |
+
- fi
|
22 |
+
- vi
|
23 |
+
- he
|
24 |
+
- uk
|
25 |
+
- el
|
26 |
+
- ms
|
27 |
+
- cs
|
28 |
+
- ro
|
29 |
+
- da
|
30 |
+
- hu
|
31 |
+
- ta
|
32 |
+
- no
|
33 |
+
- th
|
34 |
+
- ur
|
35 |
+
- hr
|
36 |
+
- bg
|
37 |
+
- lt
|
38 |
+
- la
|
39 |
+
- mi
|
40 |
+
- ml
|
41 |
+
- cy
|
42 |
+
- sk
|
43 |
+
- te
|
44 |
+
- fa
|
45 |
+
- lv
|
46 |
+
- bn
|
47 |
+
- sr
|
48 |
+
- az
|
49 |
+
- sl
|
50 |
+
- kn
|
51 |
+
- et
|
52 |
+
- mk
|
53 |
+
- br
|
54 |
+
- eu
|
55 |
+
- is
|
56 |
+
- hy
|
57 |
+
- ne
|
58 |
+
- mn
|
59 |
+
- bs
|
60 |
+
- kk
|
61 |
+
- sq
|
62 |
+
- sw
|
63 |
+
- gl
|
64 |
+
- mr
|
65 |
+
- pa
|
66 |
+
- si
|
67 |
+
- km
|
68 |
+
- sn
|
69 |
+
- yo
|
70 |
+
- so
|
71 |
+
- af
|
72 |
+
- oc
|
73 |
+
- ka
|
74 |
+
- be
|
75 |
+
- tg
|
76 |
+
- sd
|
77 |
+
- gu
|
78 |
+
- am
|
79 |
+
- yi
|
80 |
+
- lo
|
81 |
+
- uz
|
82 |
+
- fo
|
83 |
+
- ht
|
84 |
+
- ps
|
85 |
+
- tk
|
86 |
+
- nn
|
87 |
+
- mt
|
88 |
+
- sa
|
89 |
+
- lb
|
90 |
+
- my
|
91 |
+
- bo
|
92 |
+
- tl
|
93 |
+
- mg
|
94 |
+
- as
|
95 |
+
- tt
|
96 |
+
- haw
|
97 |
+
- ln
|
98 |
+
- ha
|
99 |
+
- ba
|
100 |
+
- jw
|
101 |
+
- su
|
102 |
+
tags:
|
103 |
+
- audio
|
104 |
+
- automatic-speech-recognition
|
105 |
+
- speech-to-text
|
106 |
+
pipeline_tag: automatic-speech-recognition
|
107 |
+
license: other
|
108 |
+
license_name: all-rights-reserved
|
109 |
---
|
110 |
+
# AISAK-Listen
|
111 |
|
112 |
+
### Overview:
|
113 |
|
114 |
+
AISAK, short for Artificially Intelligent Swiss Army Knife, is a general-purpose AI system comprising various models designed for different tasks. Developed by the AISAK team, one of the models within AISAK is a state-of-the-art automatic speech recognition (ASR) model. This model, named AISAK-Listen, is fine-tuned on extensive datasets to excel in converting spoken language into written text.
|
115 |
|
116 |
+
### Model Information:
|
117 |
|
118 |
+
- **Model Name**: AISAK-Listen
|
119 |
+
- **Version**: 1.0
|
120 |
+
- **Model Architecture**: Seq2seq
|
121 |
+
- **Specialization**: AISAK-Listen is a dedicated ASR model within the AISAK system, built off the impressive https://huggingface.co/openai/whisper-tiny model architecture. It has been fine-tuned to optimize performance for quick speech recognition tasks.
|
122 |
|
123 |
+
### Intended Use:
|
124 |
|
125 |
+
AISAK-Listen, as part of AISAK, is developed to provide reliable and high-quality speech-to-text conversion capabilities. It is intended to be a versatile tool for various applications such as transcription services, voice assistants, voice-controlled systems, and more. AISAK-Listen excels in accurately transcribing quick speech with minimal delay, making it suitable for real-time speech recognition requirements.
|
126 |
|
127 |
+
### Performance:
|
128 |
|
129 |
+
AISAK-Listen has undergone extensive testing to ensure its performance meets demanding standards. It consistently achieves impressive accuracy rates in converting spoken language to written text, outperforming other ASR models in terms of speed and efficiency. The model's performance has been evaluated on diverse speech datasets to ensure its generalization across different speakers and speech patterns.
|
130 |
|
131 |
+
### Ethical Considerations:
|
|
|
|
|
|
|
|
|
|
|
|
|
132 |
|
133 |
+
- **Bias Mitigation**: AISAK-Listen undergoes training processes that aim to minimize bias. However, it is important to note that biases may still be present in the transcriptions generated by the model.
|
134 |
+
- **Fair Use**: Users are advised to exercise caution when utilizing AISAK-Listen in sensitive or critical contexts. The generated transcriptions should be reviewed and verified to ensure their accuracy and fairness.
|
135 |
|
136 |
+
### Limitations:
|
137 |
|
138 |
+
- AISAK-Listen's performance is optimized for quick speech recognition and may not be as effective for specialized speech styles or accents.
|
139 |
+
- The model's accuracy may vary when exposed to speech data that significantly differs from the quick speech it was trained on.
|
|
|
140 |
|
141 |
+
### Deployment:
|
142 |
|
143 |
+
Inferencing for AISAK-Listen will be handled as part of the full deployment of the AISAK system in the future. The process is lengthy and intensive in many areas, emphasizing the goal of achieving the optimal system rather than the quickest. However, work is being done as fast as humanly possible. Updates will be provided as frequently as possible.
|
144 |
|
145 |
+
### Caveats:
|
146 |
|
147 |
+
- It is recommended to review and validate the transcriptions generated by AISAK-Listen, particularly in critical or high-stakes situations where accuracy is crucial.
|
148 |
|
|
|
149 |
|
150 |
+
**Contact Information**: For any inquiries or communication regarding AISAK, please contact me at mandelakorilogan@gmail.com.
|
151 |
|
|
|
152 |
|
153 |
+
**© 2024 Mandela Logan. All rights reserved.**
|
154 |
|
155 |
+
No part of this model may be reproduced, distributed, or transmitted in any form or by any means, including photocopying, recording, or other electronic or mechanical methods, without the prior written permission of the copyright holder. Users are expressly prohibited from creating replications or spaces derived from this model, whether in whole or in part, without the explicit authorization of the copyright holder. Unauthorized use or reproduction of this model is strictly prohibited by copyright law.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|