File size: 15,141 Bytes
c27a785
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
---
license: apache-2.0
base_model: openai/whisper-tiny
tags:
- generated_from_keras_callback
model-index:
- name: whisper_4_with_init_sun_syl_wd_0__0085
  results: []
---

<!-- This model card has been generated automatically according to the information Keras had access to. You should
probably proofread and complete it, then remove this comment. -->

# whisper_4_with_init_sun_syl_wd_0__0085

This model is a fine-tuned version of [openai/whisper-tiny](https://huggingface.co/openai/whisper-tiny) on an unknown dataset.
It achieves the following results on the evaluation set:
- Train Loss: 0.2122
- Train Accuracy: 0.0345
- Train Wermet: 0.0284
- Train Wermet Syl: 0.0346
- Validation Loss: 1.2518
- Validation Accuracy: 0.0208
- Validation Wermet: 0.3241
- Validation Wermet Syl: 0.2884
- Epoch: 84

## Model description

More information needed

## Intended uses & limitations

More information needed

## Training and evaluation data

More information needed

## Training procedure

### Training hyperparameters

The following hyperparameters were used during training:
- optimizer: {'name': 'AdamWeightDecay', 'learning_rate': 1e-05, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False, 'weight_decay_rate': 0}
- training_precision: float32

### Training results

| Train Loss | Train Accuracy | Train Wermet | Train Wermet Syl | Validation Loss | Validation Accuracy | Validation Wermet | Validation Wermet Syl | Epoch |
|:----------:|:--------------:|:------------:|:----------------:|:---------------:|:-------------------:|:-----------------:|:---------------------:|:-----:|
| 5.3409     | 0.0111         | 1.3547       | 1.2898           | 3.9789          | 0.0114              | 0.9710            | 0.9563                | 0     |
| 4.7143     | 0.0116         | 0.8622       | 0.8228           | 3.9404          | 0.0113              | 0.9823            | 0.9735                | 1     |
| 4.6752     | 0.0117         | 0.8472       | 0.8057           | 3.9081          | 0.0114              | 0.9579            | 0.9359                | 2     |
| 4.6500     | 0.0117         | 0.8382       | 0.7945           | 3.8820          | 0.0115              | 0.9213            | 0.8856                | 3     |
| 4.6282     | 0.0118         | 0.8286       | 0.7805           | 3.8738          | 0.0114              | 0.9433            | 0.9119                | 4     |
| 4.6095     | 0.0118         | 0.8190       | 0.7696           | 3.8630          | 0.0115              | 0.9117            | 0.8698                | 5     |
| 4.5875     | 0.0119         | 0.7976       | 0.7465           | 3.8341          | 0.0116              | 0.8976            | 0.8552                | 6     |
| 4.5682     | 0.0120         | 0.7753       | 0.7227           | 3.8277          | 0.0116              | 0.9014            | 0.8653                | 7     |
| 4.5376     | 0.0121         | 0.7528       | 0.7005           | 3.7844          | 0.0118              | 0.8332            | 0.7815                | 8     |
| 4.5060     | 0.0122         | 0.7392       | 0.6844           | 3.7537          | 0.0118              | 0.8578            | 0.8152                | 9     |
| 4.4580     | 0.0124         | 0.7221       | 0.6694           | 3.7038          | 0.0120              | 0.8190            | 0.7679                | 10    |
| 4.3989     | 0.0125         | 0.7156       | 0.6636           | 3.6169          | 0.0122              | 0.7979            | 0.7429                | 11    |
| 4.3056     | 0.0128         | 0.7069       | 0.6557           | 3.5098          | 0.0125              | 0.7924            | 0.7396                | 12    |
| 4.1673     | 0.0132         | 0.7054       | 0.6584           | 3.3542          | 0.0128              | 0.7759            | 0.7240                | 13    |
| 3.9762     | 0.0138         | 0.6987       | 0.6559           | 3.1318          | 0.0133              | 0.7644            | 0.7231                | 14    |
| 3.7385     | 0.0145         | 0.6835       | 0.6448           | 2.9144          | 0.0138              | 0.7392            | 0.6955                | 15    |
| 3.5040     | 0.0152         | 0.6644       | 0.6298           | 2.7413          | 0.0142              | 0.7019            | 0.6548                | 16    |
| 3.2728     | 0.0160         | 0.6408       | 0.6101           | 2.5183          | 0.0149              | 0.6798            | 0.6363                | 17    |
| 3.0657     | 0.0167         | 0.6188       | 0.5912           | 2.3594          | 0.0153              | 0.6528            | 0.6103                | 18    |
| 2.8703     | 0.0174         | 0.5936       | 0.5685           | 2.2644          | 0.0156              | 0.6310            | 0.5925                | 19    |
| 2.6850     | 0.0181         | 0.5680       | 0.5453           | 2.1296          | 0.0160              | 0.6040            | 0.5652                | 20    |
| 2.5227     | 0.0188         | 0.5423       | 0.5215           | 2.0019          | 0.0165              | 0.5793            | 0.5403                | 21    |
| 2.3878     | 0.0194         | 0.5199       | 0.5015           | 1.8996          | 0.0169              | 0.5592            | 0.5229                | 22    |
| 2.2437     | 0.0201         | 0.4959       | 0.4788           | 1.8141          | 0.0172              | 0.5414            | 0.5045                | 23    |
| 2.1205     | 0.0207         | 0.4752       | 0.4607           | 1.7245          | 0.0175              | 0.5208            | 0.4838                | 24    |
| 1.9919     | 0.0213         | 0.4533       | 0.4390           | 1.6673          | 0.0178              | 0.5026            | 0.4659                | 25    |
| 1.9140     | 0.0217         | 0.4355       | 0.4216           | 1.6041          | 0.0181              | 0.4873            | 0.4512                | 26    |
| 1.8225     | 0.0222         | 0.4184       | 0.4052           | 1.6271          | 0.0179              | 0.4852            | 0.4511                | 27    |
| 1.7265     | 0.0227         | 0.4016       | 0.3895           | 1.5219          | 0.0184              | 0.4635            | 0.4275                | 28    |
| 1.6240     | 0.0233         | 0.3833       | 0.3729           | 1.4718          | 0.0186              | 0.4515            | 0.4170                | 29    |
| 1.5610     | 0.0236         | 0.3697       | 0.3588           | 1.4404          | 0.0188              | 0.4407            | 0.4056                | 30    |
| 1.4719     | 0.0242         | 0.3540       | 0.3449           | 1.4125          | 0.0189              | 0.4310            | 0.3961                | 31    |
| 1.4152     | 0.0245         | 0.3421       | 0.3339           | 1.3655          | 0.0191              | 0.4234            | 0.3881                | 32    |
| 1.3546     | 0.0249         | 0.3277       | 0.3195           | 1.3419          | 0.0192              | 0.4156            | 0.3816                | 33    |
| 1.2565     | 0.0256         | 0.3135       | 0.3060           | 1.3172          | 0.0194              | 0.4065            | 0.3722                | 34    |
| 1.2135     | 0.0258         | 0.3026       | 0.2958           | 1.3019          | 0.0194              | 0.4006            | 0.3662                | 35    |
| 1.1739     | 0.0261         | 0.2923       | 0.2861           | 1.3843          | 0.0190              | 0.3951            | 0.3587                | 36    |
| 1.0950     | 0.0267         | 0.2782       | 0.2733           | 1.2665          | 0.0197              | 0.3883            | 0.3541                | 37    |
| 1.0435     | 0.0271         | 0.2673       | 0.2631           | 1.2567          | 0.0197              | 0.3837            | 0.3497                | 38    |
| 0.9922     | 0.0275         | 0.2580       | 0.2542           | 1.2566          | 0.0197              | 0.3801            | 0.3444                | 39    |
| 0.9387     | 0.0279         | 0.2464       | 0.2438           | 1.2441          | 0.0198              | 0.3767            | 0.3423                | 40    |
| 0.9345     | 0.0278         | 0.2393       | 0.2373           | 1.2221          | 0.0199              | 0.3682            | 0.3336                | 41    |
| 0.8574     | 0.0285         | 0.2268       | 0.2255           | 1.2258          | 0.0199              | 0.3680            | 0.3338                | 42    |
| 0.8275     | 0.0287         | 0.2183       | 0.2180           | 1.2044          | 0.0201              | 0.3628            | 0.3290                | 43    |
| 0.8201     | 0.0288         | 0.2114       | 0.2108           | 1.2056          | 0.0201              | 0.3601            | 0.3270                | 44    |
| 0.7684     | 0.0292         | 0.2020       | 0.2029           | 1.1879          | 0.0202              | 0.3553            | 0.3215                | 45    |
| 0.7262     | 0.0295         | 0.1938       | 0.1947           | 1.2263          | 0.0200              | 0.3537            | 0.3177                | 46    |
| 0.7286     | 0.0295         | 0.1876       | 0.1898           | 1.1772          | 0.0203              | 0.3485            | 0.3135                | 47    |
| 0.6807     | 0.0300         | 0.1775       | 0.1797           | 1.1761          | 0.0203              | 0.3490            | 0.3155                | 48    |
| 0.6609     | 0.0301         | 0.1713       | 0.1742           | 1.1853          | 0.0203              | 0.3484            | 0.3153                | 49    |
| 0.6062     | 0.0306         | 0.1615       | 0.1653           | 1.1660          | 0.0204              | 0.3432            | 0.3090                | 50    |
| 0.5755     | 0.0309         | 0.1547       | 0.1584           | 1.1698          | 0.0204              | 0.3428            | 0.3089                | 51    |
| 0.5600     | 0.0310         | 0.1482       | 0.1524           | 1.1667          | 0.0204              | 0.3398            | 0.3058                | 52    |
| 0.5715     | 0.0308         | 0.1449       | 0.1496           | 1.1614          | 0.0205              | 0.3381            | 0.3036                | 53    |
| 0.5247     | 0.0313         | 0.1358       | 0.1411           | 1.1639          | 0.0205              | 0.3359            | 0.3025                | 54    |
| 0.5085     | 0.0315         | 0.1301       | 0.1358           | 1.2420          | 0.0202              | 0.3412            | 0.3064                | 55    |
| 0.4827     | 0.0317         | 0.1239       | 0.1295           | 1.1677          | 0.0205              | 0.3349            | 0.3009                | 56    |
| 0.4848     | 0.0317         | 0.1207       | 0.1280           | 1.1653          | 0.0205              | 0.3326            | 0.2991                | 57    |
| 0.4323     | 0.0322         | 0.1109       | 0.1185           | 1.1602          | 0.0206              | 0.3299            | 0.2953                | 58    |
| 0.4183     | 0.0323         | 0.1057       | 0.1133           | 1.1622          | 0.0206              | 0.3307            | 0.2962                | 59    |
| 0.4329     | 0.0322         | 0.1028       | 0.1100           | 1.1714          | 0.0206              | 0.3300            | 0.2950                | 60    |
| 0.3962     | 0.0326         | 0.0964       | 0.1045           | 1.1726          | 0.0206              | 0.3311            | 0.2967                | 61    |
| 0.3642     | 0.0329         | 0.0898       | 0.0973           | 1.1699          | 0.0206              | 0.3289            | 0.2936                | 62    |
| 0.3786     | 0.0327         | 0.0884       | 0.0963           | 1.1734          | 0.0206              | 0.3279            | 0.2929                | 63    |
| 0.3698     | 0.0328         | 0.0842       | 0.0925           | 1.1728          | 0.0207              | 0.3282            | 0.2932                | 64    |
| 0.3219     | 0.0333         | 0.0765       | 0.0850           | 1.1830          | 0.0207              | 0.3258            | 0.2907                | 65    |
| 0.3035     | 0.0335         | 0.0725       | 0.0811           | 1.1840          | 0.0207              | 0.3261            | 0.2904                | 66    |
| 0.3522     | 0.0330         | 0.0745       | 0.0826           | 1.2107          | 0.0206              | 0.3299            | 0.2955                | 67    |
| 0.3001     | 0.0335         | 0.0663       | 0.0749           | 1.1810          | 0.0207              | 0.3264            | 0.2909                | 68    |
| 0.2729     | 0.0338         | 0.0595       | 0.0677           | 1.1911          | 0.0207              | 0.3247            | 0.2886                | 69    |
| 0.2696     | 0.0338         | 0.0572       | 0.0654           | 1.1950          | 0.0207              | 0.3260            | 0.2905                | 70    |
| 0.2840     | 0.0337         | 0.0563       | 0.0648           | 1.2094          | 0.0207              | 0.3250            | 0.2887                | 71    |
| 0.2319     | 0.0342         | 0.0484       | 0.0569           | 1.2107          | 0.0207              | 0.3250            | 0.2878                | 72    |
| 0.2371     | 0.0342         | 0.0464       | 0.0541           | 1.2059          | 0.0207              | 0.3240            | 0.2880                | 73    |
| 0.2666     | 0.0338         | 0.0486       | 0.0575           | 1.2036          | 0.0207              | 0.3241            | 0.2887                | 74    |
| 0.2443     | 0.0340         | 0.0442       | 0.0522           | 1.2106          | 0.0207              | 0.3241            | 0.2877                | 75    |
| 0.2118     | 0.0344         | 0.0380       | 0.0456           | 1.2172          | 0.0207              | 0.3240            | 0.2871                | 76    |
| 0.1997     | 0.0346         | 0.0354       | 0.0428           | 1.2247          | 0.0208              | 0.3219            | 0.2852                | 77    |
| 0.2461     | 0.0341         | 0.0386       | 0.0466           | 1.2257          | 0.0207              | 0.3240            | 0.2874                | 78    |
| 0.2367     | 0.0342         | 0.0364       | 0.0431           | 1.2173          | 0.0208              | 0.3234            | 0.2870                | 79    |
| 0.1857     | 0.0347         | 0.0294       | 0.0365           | 1.2287          | 0.0208              | 0.3244            | 0.2876                | 80    |
| 0.1504     | 0.0351         | 0.0244       | 0.0314           | 1.2425          | 0.0207              | 0.3238            | 0.2871                | 81    |
| 0.1438     | 0.0352         | 0.0227       | 0.0287           | 1.2495          | 0.0208              | 0.3222            | 0.2861                | 82    |
| 0.1545     | 0.0350         | 0.0232       | 0.0288           | 1.2612          | 0.0207              | 0.3257            | 0.2898                | 83    |
| 0.2122     | 0.0345         | 0.0284       | 0.0346           | 1.2518          | 0.0208              | 0.3241            | 0.2884                | 84    |


### Framework versions

- Transformers 4.34.0.dev0
- TensorFlow 2.13.0
- Tokenizers 0.13.3