Hugging Face's logo

Chemsseddine
/
donut-sroie

Image-Text-to-Text
Transformers
PyTorch
TensorBoard
vision-encoder-decoder
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
Chemsseddine commited on
Commit
0e752d0
•
1 Parent(s): 0a372a2

End of training

Browse files
Files changed (9) hide show
  1. README.md +54 -0
  2. added_tokens.json +309 -0
  3. generation_config.json +8 -0
  4. preprocessor_config.json +26 -0
  5. runs/Apr09_02-47-45_ef19cc40986f/events.out.tfevents.1681008476.ef19cc40986f.351.0 +2 -2
  6. sentencepiece.bpe.model +3 -0
  7. special_tokens_map.json +323 -0
  8. tokenizer.json +0 -0
  9. tokenizer_config.json +21 -0
README.md ADDED
@@ -0,0 +1,54 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ tags:
4
+ - generated_from_trainer
5
+ datasets:
6
+ - imagefolder
7
+ model-index:
8
+ - name: donut-sroie
9
+ results: []
10
+ ---
11
+
12
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
13
+ should probably proofread and complete it, then remove this comment. -->
14
+
15
+ # donut-sroie
16
+
17
+ This model is a fine-tuned version of [naver-clova-ix/donut-base](https://huggingface.co/naver-clova-ix/donut-base) on the imagefolder dataset.
18
+
19
+ ## Model description
20
+
21
+ More information needed
22
+
23
+ ## Intended uses & limitations
24
+
25
+ More information needed
26
+
27
+ ## Training and evaluation data
28
+
29
+ More information needed
30
+
31
+ ## Training procedure
32
+
33
+ ### Training hyperparameters
34
+
35
+ The following hyperparameters were used during training:
36
+ - learning_rate: 2e-05
37
+ - train_batch_size: 2
38
+ - eval_batch_size: 8
39
+ - seed: 42
40
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
41
+ - lr_scheduler_type: linear
42
+ - num_epochs: 30
43
+ - mixed_precision_training: Native AMP
44
+
45
+ ### Training results
46
+
47
+
48
+
49
+ ### Framework versions
50
+
51
+ - Transformers 4.28.0.dev0
52
+ - Pytorch 2.0.0+cu118
53
+ - Datasets 2.11.0
54
+ - Tokenizers 0.13.3
added_tokens.json ADDED
@@ -0,0 +1,309 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "</s_ABSORPTION_ACOUSTIQUE10>": 57818,
3
+ "</s_ABSORPTION_ACOUSTIQUE11>": 57816,
4
+ "</s_ABSORPTION_ACOUSTIQUE12>": 57814,
5
+ "</s_ABSORPTION_ACOUSTIQUE2>": 57666,
6
+ "</s_ABSORPTION_ACOUSTIQUE3>": 57664,
7
+ "</s_ABSORPTION_ACOUSTIQUE4>": 57662,
8
+ "</s_ABSORPTION_ACOUSTIQUE5>": 57660,
9
+ "</s_ABSORPTION_ACOUSTIQUE6>": 57658,
10
+ "</s_ABSORPTION_ACOUSTIQUE7>": 57656,
11
+ "</s_ABSORPTION_ACOUSTIQUE8>": 57654,
12
+ "</s_ABSORPTION_ACOUSTIQUE9>": 57812,
13
+ "</s_ABSORPTION_ACOUSTIQUE>": 57668,
14
+ "</s_CODE_DU_PRODUIT2>": 57822,
15
+ "</s_CODE_DU_PRODUIT3>": 57820,
16
+ "</s_CODE_DU_PRODUIT>": 57674,
17
+ "</s_CONDUCTIVITE2>": 57650,
18
+ "</s_CONDUCTIVITE3>": 57648,
19
+ "</s_CONDUCTIVITE4>": 57646,
20
+ "</s_CONDUCTIVITE5>": 57644,
21
+ "</s_CONDUCTIVITE6>": 57642,
22
+ "</s_CONDUCTIVITE7>": 57640,
23
+ "</s_CONDUCTIVITE8>": 57638,
24
+ "</s_CONDUCTIVITE>": 57652,
25
+ "</s_DATE>": 57682,
26
+ "</s_EPAISSEUR_MAX2>": 57790,
27
+ "</s_EPAISSEUR_MAX3>": 57788,
28
+ "</s_EPAISSEUR_MAX4>": 57798,
29
+ "</s_EPAISSEUR_MAX5>": 57796,
30
+ "</s_EPAISSEUR_MAX6>": 57810,
31
+ "</s_EPAISSEUR_MAX>": 57680,
32
+ "</s_EPAISSEUR_MIN2>": 57676,
33
+ "</s_EPAISSEUR_MIN3>": 57786,
34
+ "</s_EPAISSEUR_MIN4>": 57794,
35
+ "</s_EPAISSEUR_MIN5>": 57792,
36
+ "</s_EPAISSEUR_MIN6>": 57808,
37
+ "</s_EPAISSEUR_MIN>": 57678,
38
+ "</s_FOURNISSEUR>": 57672,
39
+ "</s_INDICE_DISOLEMENT_AUX_BRUITS_AERIENS_DIRECTS2>": 57634,
40
+ "</s_INDICE_DISOLEMENT_AUX_BRUITS_AERIENS_DIRECTS3>": 57632,
41
+ "</s_INDICE_DISOLEMENT_AUX_BRUITS_AERIENS_DIRECTS4>": 57630,
42
+ "</s_INDICE_DISOLEMENT_AUX_BRUITS_AERIENS_DIRECTS5>": 57628,
43
+ "</s_INDICE_DISOLEMENT_AUX_BRUITS_AERIENS_DIRECTS6>": 57626,
44
+ "</s_INDICE_DISOLEMENT_AUX_BRUITS_AERIENS_DIRECTS7>": 57624,
45
+ "</s_INDICE_DISOLEMENT_AUX_BRUITS_AERIENS_DIRECTS8>": 57622,
46
+ "</s_INDICE_DISOLEMENT_AUX_BRUITS_AERIENS_DIRECTS>": 57636,
47
+ "</s_NOM10>": 57710,
48
+ "</s_NOM11>": 57708,
49
+ "</s_NOM12>": 57706,
50
+ "</s_NOM13>": 57704,
51
+ "</s_NOM14>": 57702,
52
+ "</s_NOM15>": 57700,
53
+ "</s_NOM16>": 57784,
54
+ "</s_NOM17>": 57782,
55
+ "</s_NOM18>": 57780,
56
+ "</s_NOM19>": 57778,
57
+ "</s_NOM20>": 57776,
58
+ "</s_NOM21>": 57774,
59
+ "</s_NOM22>": 57772,
60
+ "</s_NOM23>": 57770,
61
+ "</s_NOM24>": 57768,
62
+ "</s_NOM25>": 57766,
63
+ "</s_NOM2>": 57618,
64
+ "</s_NOM3>": 57616,
65
+ "</s_NOM4>": 57614,
66
+ "</s_NOM5>": 57612,
67
+ "</s_NOM6>": 57610,
68
+ "</s_NOM7>": 57608,
69
+ "</s_NOM8>": 57606,
70
+ "</s_NOM9>": 57698,
71
+ "</s_NOM>": 57620,
72
+ "</s_PERMEABILITE_A_LA_VAPEUR_DEAU10>": 57806,
73
+ "</s_PERMEABILITE_A_LA_VAPEUR_DEAU11>": 57804,
74
+ "</s_PERMEABILITE_A_LA_VAPEUR_DEAU12>": 57802,
75
+ "</s_PERMEABILITE_A_LA_VAPEUR_DEAU2>": 57602,
76
+ "</s_PERMEABILITE_A_LA_VAPEUR_DEAU3>": 57600,
77
+ "</s_PERMEABILITE_A_LA_VAPEUR_DEAU4>": 57598,
78
+ "</s_PERMEABILITE_A_LA_VAPEUR_DEAU5>": 57596,
79
+ "</s_PERMEABILITE_A_LA_VAPEUR_DEAU6>": 57594,
80
+ "</s_PERMEABILITE_A_LA_VAPEUR_DEAU7>": 57592,
81
+ "</s_PERMEABILITE_A_LA_VAPEUR_DEAU8>": 57590,
82
+ "</s_PERMEABILITE_A_LA_VAPEUR_DEAU9>": 57800,
83
+ "</s_PERMEABILITE_A_LA_VAPEUR_DEAU>": 57604,
84
+ "</s_REACTION_AU_FEU10>": 57696,
85
+ "</s_REACTION_AU_FEU11>": 57694,
86
+ "</s_REACTION_AU_FEU12>": 57692,
87
+ "</s_REACTION_AU_FEU13>": 57690,
88
+ "</s_REACTION_AU_FEU14>": 57688,
89
+ "</s_REACTION_AU_FEU15>": 57686,
90
+ "</s_REACTION_AU_FEU16>": 57764,
91
+ "</s_REACTION_AU_FEU17>": 57762,
92
+ "</s_REACTION_AU_FEU18>": 57760,
93
+ "</s_REACTION_AU_FEU19>": 57758,
94
+ "</s_REACTION_AU_FEU20>": 57756,
95
+ "</s_REACTION_AU_FEU21>": 57754,
96
+ "</s_REACTION_AU_FEU22>": 57752,
97
+ "</s_REACTION_AU_FEU23>": 57750,
98
+ "</s_REACTION_AU_FEU24>": 57748,
99
+ "</s_REACTION_AU_FEU25>": 57746,
100
+ "</s_REACTION_AU_FEU2>": 57586,
101
+ "</s_REACTION_AU_FEU3>": 57584,
102
+ "</s_REACTION_AU_FEU4>": 57582,
103
+ "</s_REACTION_AU_FEU5>": 57580,
104
+ "</s_REACTION_AU_FEU6>": 57578,
105
+ "</s_REACTION_AU_FEU7>": 57576,
106
+ "</s_REACTION_AU_FEU8>": 57574,
107
+ "</s_REACTION_AU_FEU9>": 57684,
108
+ "</s_REACTION_AU_FEU>": 57588,
109
+ "</s_RESISTANCE_A LA_FLEXION10>": 57744,
110
+ "</s_RESISTANCE_A LA_FLEXION11>": 57742,
111
+ "</s_RESISTANCE_A LA_FLEXION12>": 57740,
112
+ "</s_RESISTANCE_A LA_FLEXION13>": 57738,
113
+ "</s_RESISTANCE_A LA_FLEXION14>": 57736,
114
+ "</s_RESISTANCE_A LA_FLEXION15>": 57734,
115
+ "</s_RESISTANCE_A LA_FLEXION16>": 57732,
116
+ "</s_RESISTANCE_A LA_FLEXION17>": 57730,
117
+ "</s_RESISTANCE_A LA_FLEXION18>": 57728,
118
+ "</s_RESISTANCE_A LA_FLEXION19>": 57726,
119
+ "</s_RESISTANCE_A LA_FLEXION20>": 57724,
120
+ "</s_RESISTANCE_A LA_FLEXION21>": 57722,
121
+ "</s_RESISTANCE_A LA_FLEXION22>": 57720,
122
+ "</s_RESISTANCE_A LA_FLEXION23>": 57718,
123
+ "</s_RESISTANCE_A LA_FLEXION24>": 57716,
124
+ "</s_RESISTANCE_A LA_FLEXION25>": 57714,
125
+ "</s_RESISTANCE_A LA_FLEXION2>": 57570,
126
+ "</s_RESISTANCE_A LA_FLEXION3>": 57568,
127
+ "</s_RESISTANCE_A LA_FLEXION4>": 57566,
128
+ "</s_RESISTANCE_A LA_FLEXION5>": 57564,
129
+ "</s_RESISTANCE_A LA_FLEXION6>": 57562,
130
+ "</s_RESISTANCE_A LA_FLEXION7>": 57560,
131
+ "</s_RESISTANCE_A LA_FLEXION8>": 57558,
132
+ "</s_RESISTANCE_A LA_FLEXION9>": 57712,
133
+ "</s_RESISTANCE_A LA_FLEXION>": 57572,
134
+ "</s_RESISTANCE_MAX2>": 57554,
135
+ "</s_RESISTANCE_MAX3>": 57552,
136
+ "</s_RESISTANCE_MAX4>": 57550,
137
+ "</s_RESISTANCE_MAX5>": 57548,
138
+ "</s_RESISTANCE_MAX6>": 57546,
139
+ "</s_RESISTANCE_MAX7>": 57544,
140
+ "</s_RESISTANCE_MAX8>": 57542,
141
+ "</s_RESISTANCE_MAX>": 57556,
142
+ "</s_RESISTANCE_MIN2>": 57538,
143
+ "</s_RESISTANCE_MIN3>": 57536,
144
+ "</s_RESISTANCE_MIN4>": 57534,
145
+ "</s_RESISTANCE_MIN5>": 57532,
146
+ "</s_RESISTANCE_MIN6>": 57530,
147
+ "</s_RESISTANCE_MIN7>": 57528,
148
+ "</s_RESISTANCE_MIN8>": 57526,
149
+ "</s_RESISTANCE_MIN>": 57540,
150
+ "</s_USAGE2>": 57828,
151
+ "</s_USAGE3>": 57826,
152
+ "</s_USAGE4>": 57824,
153
+ "</s_USAGE>": 57670,
154
+ "<s_ABSORPTION_ACOUSTIQUE10>": 57817,
155
+ "<s_ABSORPTION_ACOUSTIQUE11>": 57815,
156
+ "<s_ABSORPTION_ACOUSTIQUE12>": 57813,
157
+ "<s_ABSORPTION_ACOUSTIQUE2>": 57665,
158
+ "<s_ABSORPTION_ACOUSTIQUE3>": 57663,
159
+ "<s_ABSORPTION_ACOUSTIQUE4>": 57661,
160
+ "<s_ABSORPTION_ACOUSTIQUE5>": 57659,
161
+ "<s_ABSORPTION_ACOUSTIQUE6>": 57657,
162
+ "<s_ABSORPTION_ACOUSTIQUE7>": 57655,
163
+ "<s_ABSORPTION_ACOUSTIQUE8>": 57653,
164
+ "<s_ABSORPTION_ACOUSTIQUE9>": 57811,
165
+ "<s_ABSORPTION_ACOUSTIQUE>": 57667,
166
+ "<s_CODE_DU_PRODUIT2>": 57821,
167
+ "<s_CODE_DU_PRODUIT3>": 57819,
168
+ "<s_CODE_DU_PRODUIT>": 57673,
169
+ "<s_CONDUCTIVITE2>": 57649,
170
+ "<s_CONDUCTIVITE3>": 57647,
171
+ "<s_CONDUCTIVITE4>": 57645,
172
+ "<s_CONDUCTIVITE5>": 57643,
173
+ "<s_CONDUCTIVITE6>": 57641,
174
+ "<s_CONDUCTIVITE7>": 57639,
175
+ "<s_CONDUCTIVITE8>": 57637,
176
+ "<s_CONDUCTIVITE>": 57651,
177
+ "<s_DATE>": 57681,
178
+ "<s_EPAISSEUR_MAX2>": 57789,
179
+ "<s_EPAISSEUR_MAX3>": 57787,
180
+ "<s_EPAISSEUR_MAX4>": 57797,
181
+ "<s_EPAISSEUR_MAX5>": 57795,
182
+ "<s_EPAISSEUR_MAX6>": 57809,
183
+ "<s_EPAISSEUR_MAX>": 57679,
184
+ "<s_EPAISSEUR_MIN2>": 57675,
185
+ "<s_EPAISSEUR_MIN3>": 57785,
186
+ "<s_EPAISSEUR_MIN4>": 57793,
187
+ "<s_EPAISSEUR_MIN5>": 57791,
188
+ "<s_EPAISSEUR_MIN6>": 57807,
189
+ "<s_EPAISSEUR_MIN>": 57677,
190
+ "<s_FOURNISSEUR>": 57671,
191
+ "<s_INDICE_DISOLEMENT_AUX_BRUITS_AERIENS_DIRECTS2>": 57633,
192
+ "<s_INDICE_DISOLEMENT_AUX_BRUITS_AERIENS_DIRECTS3>": 57631,
193
+ "<s_INDICE_DISOLEMENT_AUX_BRUITS_AERIENS_DIRECTS4>": 57629,
194
+ "<s_INDICE_DISOLEMENT_AUX_BRUITS_AERIENS_DIRECTS5>": 57627,
195
+ "<s_INDICE_DISOLEMENT_AUX_BRUITS_AERIENS_DIRECTS6>": 57625,
196
+ "<s_INDICE_DISOLEMENT_AUX_BRUITS_AERIENS_DIRECTS7>": 57623,
197
+ "<s_INDICE_DISOLEMENT_AUX_BRUITS_AERIENS_DIRECTS8>": 57621,
198
+ "<s_INDICE_DISOLEMENT_AUX_BRUITS_AERIENS_DIRECTS>": 57635,
199
+ "<s_NOM10>": 57709,
200
+ "<s_NOM11>": 57707,
201
+ "<s_NOM12>": 57705,
202
+ "<s_NOM13>": 57703,
203
+ "<s_NOM14>": 57701,
204
+ "<s_NOM15>": 57699,
205
+ "<s_NOM16>": 57783,
206
+ "<s_NOM17>": 57781,
207
+ "<s_NOM18>": 57779,
208
+ "<s_NOM19>": 57777,
209
+ "<s_NOM20>": 57775,
210
+ "<s_NOM21>": 57773,
211
+ "<s_NOM22>": 57771,
212
+ "<s_NOM23>": 57769,
213
+ "<s_NOM24>": 57767,
214
+ "<s_NOM25>": 57765,
215
+ "<s_NOM2>": 57617,
216
+ "<s_NOM3>": 57615,
217
+ "<s_NOM4>": 57613,
218
+ "<s_NOM5>": 57611,
219
+ "<s_NOM6>": 57609,
220
+ "<s_NOM7>": 57607,
221
+ "<s_NOM8>": 57605,
222
+ "<s_NOM9>": 57697,
223
+ "<s_NOM>": 57619,
224
+ "<s_PERMEABILITE_A_LA_VAPEUR_DEAU10>": 57805,
225
+ "<s_PERMEABILITE_A_LA_VAPEUR_DEAU11>": 57803,
226
+ "<s_PERMEABILITE_A_LA_VAPEUR_DEAU12>": 57801,
227
+ "<s_PERMEABILITE_A_LA_VAPEUR_DEAU2>": 57601,
228
+ "<s_PERMEABILITE_A_LA_VAPEUR_DEAU3>": 57599,
229
+ "<s_PERMEABILITE_A_LA_VAPEUR_DEAU4>": 57597,
230
+ "<s_PERMEABILITE_A_LA_VAPEUR_DEAU5>": 57595,
231
+ "<s_PERMEABILITE_A_LA_VAPEUR_DEAU6>": 57593,
232
+ "<s_PERMEABILITE_A_LA_VAPEUR_DEAU7>": 57591,
233
+ "<s_PERMEABILITE_A_LA_VAPEUR_DEAU8>": 57589,
234
+ "<s_PERMEABILITE_A_LA_VAPEUR_DEAU9>": 57799,
235
+ "<s_PERMEABILITE_A_LA_VAPEUR_DEAU>": 57603,
236
+ "<s_REACTION_AU_FEU10>": 57695,
237
+ "<s_REACTION_AU_FEU11>": 57693,
238
+ "<s_REACTION_AU_FEU12>": 57691,
239
+ "<s_REACTION_AU_FEU13>": 57689,
240
+ "<s_REACTION_AU_FEU14>": 57687,
241
+ "<s_REACTION_AU_FEU15>": 57685,
242
+ "<s_REACTION_AU_FEU16>": 57763,
243
+ "<s_REACTION_AU_FEU17>": 57761,
244
+ "<s_REACTION_AU_FEU18>": 57759,
245
+ "<s_REACTION_AU_FEU19>": 57757,
246
+ "<s_REACTION_AU_FEU20>": 57755,
247
+ "<s_REACTION_AU_FEU21>": 57753,
248
+ "<s_REACTION_AU_FEU22>": 57751,
249
+ "<s_REACTION_AU_FEU23>": 57749,
250
+ "<s_REACTION_AU_FEU24>": 57747,
251
+ "<s_REACTION_AU_FEU25>": 57745,
252
+ "<s_REACTION_AU_FEU2>": 57585,
253
+ "<s_REACTION_AU_FEU3>": 57583,
254
+ "<s_REACTION_AU_FEU4>": 57581,
255
+ "<s_REACTION_AU_FEU5>": 57579,
256
+ "<s_REACTION_AU_FEU6>": 57577,
257
+ "<s_REACTION_AU_FEU7>": 57575,
258
+ "<s_REACTION_AU_FEU8>": 57573,
259
+ "<s_REACTION_AU_FEU9>": 57683,
260
+ "<s_REACTION_AU_FEU>": 57587,
261
+ "<s_RESISTANCE_A LA_FLEXION10>": 57743,
262
+ "<s_RESISTANCE_A LA_FLEXION11>": 57741,
263
+ "<s_RESISTANCE_A LA_FLEXION12>": 57739,
264
+ "<s_RESISTANCE_A LA_FLEXION13>": 57737,
265
+ "<s_RESISTANCE_A LA_FLEXION14>": 57735,
266
+ "<s_RESISTANCE_A LA_FLEXION15>": 57733,
267
+ "<s_RESISTANCE_A LA_FLEXION16>": 57731,
268
+ "<s_RESISTANCE_A LA_FLEXION17>": 57729,
269
+ "<s_RESISTANCE_A LA_FLEXION18>": 57727,
270
+ "<s_RESISTANCE_A LA_FLEXION19>": 57725,
271
+ "<s_RESISTANCE_A LA_FLEXION20>": 57723,
272
+ "<s_RESISTANCE_A LA_FLEXION21>": 57721,
273
+ "<s_RESISTANCE_A LA_FLEXION22>": 57719,
274
+ "<s_RESISTANCE_A LA_FLEXION23>": 57717,
275
+ "<s_RESISTANCE_A LA_FLEXION24>": 57715,
276
+ "<s_RESISTANCE_A LA_FLEXION25>": 57713,
277
+ "<s_RESISTANCE_A LA_FLEXION2>": 57569,
278
+ "<s_RESISTANCE_A LA_FLEXION3>": 57567,
279
+ "<s_RESISTANCE_A LA_FLEXION4>": 57565,
280
+ "<s_RESISTANCE_A LA_FLEXION5>": 57563,
281
+ "<s_RESISTANCE_A LA_FLEXION6>": 57561,
282
+ "<s_RESISTANCE_A LA_FLEXION7>": 57559,
283
+ "<s_RESISTANCE_A LA_FLEXION8>": 57557,
284
+ "<s_RESISTANCE_A LA_FLEXION9>": 57711,
285
+ "<s_RESISTANCE_A LA_FLEXION>": 57571,
286
+ "<s_RESISTANCE_MAX2>": 57553,
287
+ "<s_RESISTANCE_MAX3>": 57551,
288
+ "<s_RESISTANCE_MAX4>": 57549,
289
+ "<s_RESISTANCE_MAX5>": 57547,
290
+ "<s_RESISTANCE_MAX6>": 57545,
291
+ "<s_RESISTANCE_MAX7>": 57543,
292
+ "<s_RESISTANCE_MAX8>": 57541,
293
+ "<s_RESISTANCE_MAX>": 57555,
294
+ "<s_RESISTANCE_MIN2>": 57537,
295
+ "<s_RESISTANCE_MIN3>": 57535,
296
+ "<s_RESISTANCE_MIN4>": 57533,
297
+ "<s_RESISTANCE_MIN5>": 57531,
298
+ "<s_RESISTANCE_MIN6>": 57529,
299
+ "<s_RESISTANCE_MIN7>": 57527,
300
+ "<s_RESISTANCE_MIN8>": 57525,
301
+ "<s_RESISTANCE_MIN>": 57539,
302
+ "<s_USAGE2>": 57827,
303
+ "<s_USAGE3>": 57825,
304
+ "<s_USAGE4>": 57823,
305
+ "<s_USAGE>": 57669,
306
+ "<s_iitcdip>": 57523,
307
+ "<s_synthdog>": 57524,
308
+ "<sep/>": 57522
309
+ }
generation_config.json ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_from_model_config": true,
3
+ "bos_token_id": 0,
4
+ "eos_token_id": 2,
5
+ "forced_eos_token_id": 2,
6
+ "pad_token_id": 1,
7
+ "transformers_version": "4.28.0.dev0"
8
+ }
preprocessor_config.json ADDED
@@ -0,0 +1,26 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "do_align_long_axis": false,
3
+ "do_normalize": true,
4
+ "do_pad": true,
5
+ "do_rescale": true,
6
+ "do_resize": true,
7
+ "do_thumbnail": true,
8
+ "image_mean": [
9
+ 0.5,
10
+ 0.5,
11
+ 0.5
12
+ ],
13
+ "image_processor_type": "DonutImageProcessor",
14
+ "image_std": [
15
+ 0.5,
16
+ 0.5,
17
+ 0.5
18
+ ],
19
+ "processor_class": "DonutProcessor",
20
+ "resample": 2,
21
+ "rescale_factor": 0.00392156862745098,
22
+ "size": [
23
+ 720,
24
+ 960
25
+ ]
26
+ }
runs/Apr09_02-47-45_ef19cc40986f/events.out.tfevents.1681008476.ef19cc40986f.351.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:732cb585980bdff548b5fed6f90ac9af142cfd7aa0e7fa55c3d849cf1213415e
3
- size 14017
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:482b475376b07837d250284c10b9386090f1ed5ff1d0509a05c1fbe9a3d71687
3
+ size 14371
sentencepiece.bpe.model ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cb9e3dce4c326195d08fc3dd0f7e2eee1da8595c847bf4c1a9c78b7a82d47e2d
3
+ size 1296245
special_tokens_map.json ADDED
@@ -0,0 +1,323 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "additional_special_tokens": [
3
+ "<s_RESISTANCE_MIN8>",
4
+ "</s_RESISTANCE_MIN8>",
5
+ "<s_RESISTANCE_MIN7>",
6
+ "</s_RESISTANCE_MIN7>",
7
+ "<s_RESISTANCE_MIN6>",
8
+ "</s_RESISTANCE_MIN6>",
9
+ "<s_RESISTANCE_MIN5>",
10
+ "</s_RESISTANCE_MIN5>",
11
+ "<s_RESISTANCE_MIN4>",
12
+ "</s_RESISTANCE_MIN4>",
13
+ "<s_RESISTANCE_MIN3>",
14
+ "</s_RESISTANCE_MIN3>",
15
+ "<s_RESISTANCE_MIN2>",
16
+ "</s_RESISTANCE_MIN2>",
17
+ "<s_RESISTANCE_MIN>",
18
+ "</s_RESISTANCE_MIN>",
19
+ "<s_RESISTANCE_MAX8>",
20
+ "</s_RESISTANCE_MAX8>",
21
+ "<s_RESISTANCE_MAX7>",
22
+ "</s_RESISTANCE_MAX7>",
23
+ "<s_RESISTANCE_MAX6>",
24
+ "</s_RESISTANCE_MAX6>",
25
+ "<s_RESISTANCE_MAX5>",
26
+ "</s_RESISTANCE_MAX5>",
27
+ "<s_RESISTANCE_MAX4>",
28
+ "</s_RESISTANCE_MAX4>",
29
+ "<s_RESISTANCE_MAX3>",
30
+ "</s_RESISTANCE_MAX3>",
31
+ "<s_RESISTANCE_MAX2>",
32
+ "</s_RESISTANCE_MAX2>",
33
+ "<s_RESISTANCE_MAX>",
34
+ "</s_RESISTANCE_MAX>",
35
+ "<s_RESISTANCE_A LA_FLEXION8>",
36
+ "</s_RESISTANCE_A LA_FLEXION8>",
37
+ "<s_RESISTANCE_A LA_FLEXION7>",
38
+ "</s_RESISTANCE_A LA_FLEXION7>",
39
+ "<s_RESISTANCE_A LA_FLEXION6>",
40
+ "</s_RESISTANCE_A LA_FLEXION6>",
41
+ "<s_RESISTANCE_A LA_FLEXION5>",
42
+ "</s_RESISTANCE_A LA_FLEXION5>",
43
+ "<s_RESISTANCE_A LA_FLEXION4>",
44
+ "</s_RESISTANCE_A LA_FLEXION4>",
45
+ "<s_RESISTANCE_A LA_FLEXION3>",
46
+ "</s_RESISTANCE_A LA_FLEXION3>",
47
+ "<s_RESISTANCE_A LA_FLEXION2>",
48
+ "</s_RESISTANCE_A LA_FLEXION2>",
49
+ "<s_RESISTANCE_A LA_FLEXION>",
50
+ "</s_RESISTANCE_A LA_FLEXION>",
51
+ "<s_REACTION_AU_FEU8>",
52
+ "</s_REACTION_AU_FEU8>",
53
+ "<s_REACTION_AU_FEU7>",
54
+ "</s_REACTION_AU_FEU7>",
55
+ "<s_REACTION_AU_FEU6>",
56
+ "</s_REACTION_AU_FEU6>",
57
+ "<s_REACTION_AU_FEU5>",
58
+ "</s_REACTION_AU_FEU5>",
59
+ "<s_REACTION_AU_FEU4>",
60
+ "</s_REACTION_AU_FEU4>",
61
+ "<s_REACTION_AU_FEU3>",
62
+ "</s_REACTION_AU_FEU3>",
63
+ "<s_REACTION_AU_FEU2>",
64
+ "</s_REACTION_AU_FEU2>",
65
+ "<s_REACTION_AU_FEU>",
66
+ "</s_REACTION_AU_FEU>",
67
+ "<s_PERMEABILITE_A_LA_VAPEUR_DEAU8>",
68
+ "</s_PERMEABILITE_A_LA_VAPEUR_DEAU8>",
69
+ "<s_PERMEABILITE_A_LA_VAPEUR_DEAU7>",
70
+ "</s_PERMEABILITE_A_LA_VAPEUR_DEAU7>",
71
+ "<s_PERMEABILITE_A_LA_VAPEUR_DEAU6>",
72
+ "</s_PERMEABILITE_A_LA_VAPEUR_DEAU6>",
73
+ "<s_PERMEABILITE_A_LA_VAPEUR_DEAU5>",
74
+ "</s_PERMEABILITE_A_LA_VAPEUR_DEAU5>",
75
+ "<s_PERMEABILITE_A_LA_VAPEUR_DEAU4>",
76
+ "</s_PERMEABILITE_A_LA_VAPEUR_DEAU4>",
77
+ "<s_PERMEABILITE_A_LA_VAPEUR_DEAU3>",
78
+ "</s_PERMEABILITE_A_LA_VAPEUR_DEAU3>",
79
+ "<s_PERMEABILITE_A_LA_VAPEUR_DEAU2>",
80
+ "</s_PERMEABILITE_A_LA_VAPEUR_DEAU2>",
81
+ "<s_PERMEABILITE_A_LA_VAPEUR_DEAU>",
82
+ "</s_PERMEABILITE_A_LA_VAPEUR_DEAU>",
83
+ "<s_NOM8>",
84
+ "</s_NOM8>",
85
+ "<s_NOM7>",
86
+ "</s_NOM7>",
87
+ "<s_NOM6>",
88
+ "</s_NOM6>",
89
+ "<s_NOM5>",
90
+ "</s_NOM5>",
91
+ "<s_NOM4>",
92
+ "</s_NOM4>",
93
+ "<s_NOM3>",
94
+ "</s_NOM3>",
95
+ "<s_NOM2>",
96
+ "</s_NOM2>",
97
+ "<s_NOM>",
98
+ "</s_NOM>",
99
+ "<s_INDICE_DISOLEMENT_AUX_BRUITS_AERIENS_DIRECTS8>",
100
+ "</s_INDICE_DISOLEMENT_AUX_BRUITS_AERIENS_DIRECTS8>",
101
+ "<s_INDICE_DISOLEMENT_AUX_BRUITS_AERIENS_DIRECTS7>",
102
+ "</s_INDICE_DISOLEMENT_AUX_BRUITS_AERIENS_DIRECTS7>",
103
+ "<s_INDICE_DISOLEMENT_AUX_BRUITS_AERIENS_DIRECTS6>",
104
+ "</s_INDICE_DISOLEMENT_AUX_BRUITS_AERIENS_DIRECTS6>",
105
+ "<s_INDICE_DISOLEMENT_AUX_BRUITS_AERIENS_DIRECTS5>",
106
+ "</s_INDICE_DISOLEMENT_AUX_BRUITS_AERIENS_DIRECTS5>",
107
+ "<s_INDICE_DISOLEMENT_AUX_BRUITS_AERIENS_DIRECTS4>",
108
+ "</s_INDICE_DISOLEMENT_AUX_BRUITS_AERIENS_DIRECTS4>",
109
+ "<s_INDICE_DISOLEMENT_AUX_BRUITS_AERIENS_DIRECTS3>",
110
+ "</s_INDICE_DISOLEMENT_AUX_BRUITS_AERIENS_DIRECTS3>",
111
+ "<s_INDICE_DISOLEMENT_AUX_BRUITS_AERIENS_DIRECTS2>",
112
+ "</s_INDICE_DISOLEMENT_AUX_BRUITS_AERIENS_DIRECTS2>",
113
+ "<s_INDICE_DISOLEMENT_AUX_BRUITS_AERIENS_DIRECTS>",
114
+ "</s_INDICE_DISOLEMENT_AUX_BRUITS_AERIENS_DIRECTS>",
115
+ "<s_CONDUCTIVITE8>",
116
+ "</s_CONDUCTIVITE8>",
117
+ "<s_CONDUCTIVITE7>",
118
+ "</s_CONDUCTIVITE7>",
119
+ "<s_CONDUCTIVITE6>",
120
+ "</s_CONDUCTIVITE6>",
121
+ "<s_CONDUCTIVITE5>",
122
+ "</s_CONDUCTIVITE5>",
123
+ "<s_CONDUCTIVITE4>",
124
+ "</s_CONDUCTIVITE4>",
125
+ "<s_CONDUCTIVITE3>",
126
+ "</s_CONDUCTIVITE3>",
127
+ "<s_CONDUCTIVITE2>",
128
+ "</s_CONDUCTIVITE2>",
129
+ "<s_CONDUCTIVITE>",
130
+ "</s_CONDUCTIVITE>",
131
+ "<s_ABSORPTION_ACOUSTIQUE8>",
132
+ "</s_ABSORPTION_ACOUSTIQUE8>",
133
+ "<s_ABSORPTION_ACOUSTIQUE7>",
134
+ "</s_ABSORPTION_ACOUSTIQUE7>",
135
+ "<s_ABSORPTION_ACOUSTIQUE6>",
136
+ "</s_ABSORPTION_ACOUSTIQUE6>",
137
+ "<s_ABSORPTION_ACOUSTIQUE5>",
138
+ "</s_ABSORPTION_ACOUSTIQUE5>",
139
+ "<s_ABSORPTION_ACOUSTIQUE4>",
140
+ "</s_ABSORPTION_ACOUSTIQUE4>",
141
+ "<s_ABSORPTION_ACOUSTIQUE3>",
142
+ "</s_ABSORPTION_ACOUSTIQUE3>",
143
+ "<s_ABSORPTION_ACOUSTIQUE2>",
144
+ "</s_ABSORPTION_ACOUSTIQUE2>",
145
+ "<s_ABSORPTION_ACOUSTIQUE>",
146
+ "</s_ABSORPTION_ACOUSTIQUE>",
147
+ "<s_USAGE>",
148
+ "</s_USAGE>",
149
+ "<s_FOURNISSEUR>",
150
+ "</s_FOURNISSEUR>",
151
+ "<s_CODE_DU_PRODUIT>",
152
+ "</s_CODE_DU_PRODUIT>",
153
+ "<s_EPAISSEUR_MIN2>",
154
+ "</s_EPAISSEUR_MIN2>",
155
+ "<s_EPAISSEUR_MIN>",
156
+ "</s_EPAISSEUR_MIN>",
157
+ "<s_EPAISSEUR_MAX>",
158
+ "</s_EPAISSEUR_MAX>",
159
+ "<s_DATE>",
160
+ "</s_DATE>",
161
+ "<s_REACTION_AU_FEU9>",
162
+ "</s_REACTION_AU_FEU9>",
163
+ "<s_REACTION_AU_FEU15>",
164
+ "</s_REACTION_AU_FEU15>",
165
+ "<s_REACTION_AU_FEU14>",
166
+ "</s_REACTION_AU_FEU14>",
167
+ "<s_REACTION_AU_FEU13>",
168
+ "</s_REACTION_AU_FEU13>",
169
+ "<s_REACTION_AU_FEU12>",
170
+ "</s_REACTION_AU_FEU12>",
171
+ "<s_REACTION_AU_FEU11>",
172
+ "</s_REACTION_AU_FEU11>",
173
+ "<s_REACTION_AU_FEU10>",
174
+ "</s_REACTION_AU_FEU10>",
175
+ "<s_NOM9>",
176
+ "</s_NOM9>",
177
+ "<s_NOM15>",
178
+ "</s_NOM15>",
179
+ "<s_NOM14>",
180
+ "</s_NOM14>",
181
+ "<s_NOM13>",
182
+ "</s_NOM13>",
183
+ "<s_NOM12>",
184
+ "</s_NOM12>",
185
+ "<s_NOM11>",
186
+ "</s_NOM11>",
187
+ "<s_NOM10>",
188
+ "</s_NOM10>",
189
+ "<s_RESISTANCE_A LA_FLEXION9>",
190
+ "</s_RESISTANCE_A LA_FLEXION9>",
191
+ "<s_RESISTANCE_A LA_FLEXION25>",
192
+ "</s_RESISTANCE_A LA_FLEXION25>",
193
+ "<s_RESISTANCE_A LA_FLEXION24>",
194
+ "</s_RESISTANCE_A LA_FLEXION24>",
195
+ "<s_RESISTANCE_A LA_FLEXION23>",
196
+ "</s_RESISTANCE_A LA_FLEXION23>",
197
+ "<s_RESISTANCE_A LA_FLEXION22>",
198
+ "</s_RESISTANCE_A LA_FLEXION22>",
199
+ "<s_RESISTANCE_A LA_FLEXION21>",
200
+ "</s_RESISTANCE_A LA_FLEXION21>",
201
+ "<s_RESISTANCE_A LA_FLEXION20>",
202
+ "</s_RESISTANCE_A LA_FLEXION20>",
203
+ "<s_RESISTANCE_A LA_FLEXION19>",
204
+ "</s_RESISTANCE_A LA_FLEXION19>",
205
+ "<s_RESISTANCE_A LA_FLEXION18>",
206
+ "</s_RESISTANCE_A LA_FLEXION18>",
207
+ "<s_RESISTANCE_A LA_FLEXION17>",
208
+ "</s_RESISTANCE_A LA_FLEXION17>",
209
+ "<s_RESISTANCE_A LA_FLEXION16>",
210
+ "</s_RESISTANCE_A LA_FLEXION16>",
211
+ "<s_RESISTANCE_A LA_FLEXION15>",
212
+ "</s_RESISTANCE_A LA_FLEXION15>",
213
+ "<s_RESISTANCE_A LA_FLEXION14>",
214
+ "</s_RESISTANCE_A LA_FLEXION14>",
215
+ "<s_RESISTANCE_A LA_FLEXION13>",
216
+ "</s_RESISTANCE_A LA_FLEXION13>",
217
+ "<s_RESISTANCE_A LA_FLEXION12>",
218
+ "</s_RESISTANCE_A LA_FLEXION12>",
219
+ "<s_RESISTANCE_A LA_FLEXION11>",
220
+ "</s_RESISTANCE_A LA_FLEXION11>",
221
+ "<s_RESISTANCE_A LA_FLEXION10>",
222
+ "</s_RESISTANCE_A LA_FLEXION10>",
223
+ "<s_REACTION_AU_FEU25>",
224
+ "</s_REACTION_AU_FEU25>",
225
+ "<s_REACTION_AU_FEU24>",
226
+ "</s_REACTION_AU_FEU24>",
227
+ "<s_REACTION_AU_FEU23>",
228
+ "</s_REACTION_AU_FEU23>",
229
+ "<s_REACTION_AU_FEU22>",
230
+ "</s_REACTION_AU_FEU22>",
231
+ "<s_REACTION_AU_FEU21>",
232
+ "</s_REACTION_AU_FEU21>",
233
+ "<s_REACTION_AU_FEU20>",
234
+ "</s_REACTION_AU_FEU20>",
235
+ "<s_REACTION_AU_FEU19>",
236
+ "</s_REACTION_AU_FEU19>",
237
+ "<s_REACTION_AU_FEU18>",
238
+ "</s_REACTION_AU_FEU18>",
239
+ "<s_REACTION_AU_FEU17>",
240
+ "</s_REACTION_AU_FEU17>",
241
+ "<s_REACTION_AU_FEU16>",
242
+ "</s_REACTION_AU_FEU16>",
243
+ "<s_NOM25>",
244
+ "</s_NOM25>",
245
+ "<s_NOM24>",
246
+ "</s_NOM24>",
247
+ "<s_NOM23>",
248
+ "</s_NOM23>",
249
+ "<s_NOM22>",
250
+ "</s_NOM22>",
251
+ "<s_NOM21>",
252
+ "</s_NOM21>",
253
+ "<s_NOM20>",
254
+ "</s_NOM20>",
255
+ "<s_NOM19>",
256
+ "</s_NOM19>",
257
+ "<s_NOM18>",
258
+ "</s_NOM18>",
259
+ "<s_NOM17>",
260
+ "</s_NOM17>",
261
+ "<s_NOM16>",
262
+ "</s_NOM16>",
263
+ "<s_EPAISSEUR_MIN3>",
264
+ "</s_EPAISSEUR_MIN3>",
265
+ "<s_EPAISSEUR_MAX3>",
266
+ "</s_EPAISSEUR_MAX3>",
267
+ "<s_EPAISSEUR_MAX2>",
268
+ "</s_EPAISSEUR_MAX2>",
269
+ "<s_EPAISSEUR_MIN5>",
270
+ "</s_EPAISSEUR_MIN5>",
271
+ "<s_EPAISSEUR_MIN4>",
272
+ "</s_EPAISSEUR_MIN4>",
273
+ "<s_EPAISSEUR_MAX5>",
274
+ "</s_EPAISSEUR_MAX5>",
275
+ "<s_EPAISSEUR_MAX4>",
276
+ "</s_EPAISSEUR_MAX4>",
277
+ "<s_PERMEABILITE_A_LA_VAPEUR_DEAU9>",
278
+ "</s_PERMEABILITE_A_LA_VAPEUR_DEAU9>",
279
+ "<s_PERMEABILITE_A_LA_VAPEUR_DEAU12>",
280
+ "</s_PERMEABILITE_A_LA_VAPEUR_DEAU12>",
281
+ "<s_PERMEABILITE_A_LA_VAPEUR_DEAU11>",
282
+ "</s_PERMEABILITE_A_LA_VAPEUR_DEAU11>",
283
+ "<s_PERMEABILITE_A_LA_VAPEUR_DEAU10>",
284
+ "</s_PERMEABILITE_A_LA_VAPEUR_DEAU10>",
285
+ "<s_EPAISSEUR_MIN6>",
286
+ "</s_EPAISSEUR_MIN6>",
287
+ "<s_EPAISSEUR_MAX6>",
288
+ "</s_EPAISSEUR_MAX6>",
289
+ "<s_ABSORPTION_ACOUSTIQUE9>",
290
+ "</s_ABSORPTION_ACOUSTIQUE9>",
291
+ "<s_ABSORPTION_ACOUSTIQUE12>",
292
+ "</s_ABSORPTION_ACOUSTIQUE12>",
293
+ "<s_ABSORPTION_ACOUSTIQUE11>",
294
+ "</s_ABSORPTION_ACOUSTIQUE11>",
295
+ "<s_ABSORPTION_ACOUSTIQUE10>",
296
+ "</s_ABSORPTION_ACOUSTIQUE10>",
297
+ "<s_CODE_DU_PRODUIT3>",
298
+ "</s_CODE_DU_PRODUIT3>",
299
+ "<s_CODE_DU_PRODUIT2>",
300
+ "</s_CODE_DU_PRODUIT2>",
301
+ "<s_USAGE4>",
302
+ "</s_USAGE4>",
303
+ "<s_USAGE3>",
304
+ "</s_USAGE3>",
305
+ "<s_USAGE2>",
306
+ "</s_USAGE2>",
307
+ "<s>",
308
+ "</s>"
309
+ ],
310
+ "bos_token": "<s>",
311
+ "cls_token": "<s>",
312
+ "eos_token": "</s>",
313
+ "mask_token": {
314
+ "content": "<mask>",
315
+ "lstrip": true,
316
+ "normalized": true,
317
+ "rstrip": false,
318
+ "single_word": false
319
+ },
320
+ "pad_token": "<pad>",
321
+ "sep_token": "</s>",
322
+ "unk_token": "<unk>"
323
+ }
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer_config.json ADDED
@@ -0,0 +1,21 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token": "<s>",
3
+ "clean_up_tokenization_spaces": true,
4
+ "cls_token": "<s>",
5
+ "eos_token": "</s>",
6
+ "mask_token": {
7
+ "__type": "AddedToken",
8
+ "content": "<mask>",
9
+ "lstrip": true,
10
+ "normalized": true,
11
+ "rstrip": false,
12
+ "single_word": false
13
+ },
14
+ "model_max_length": 1000000000000000019884624838656,
15
+ "pad_token": "<pad>",
16
+ "processor_class": "DonutProcessor",
17
+ "sep_token": "</s>",
18
+ "sp_model_kwargs": {},
19
+ "tokenizer_class": "XLMRobertaTokenizer",
20
+ "unk_token": "<unk>"
21
+ }