Hugging Face's logo

qanastek
/
XLMRoberta-Alexa-Intents-NER-NLU

Token Classification
Transformers
PyTorch
Transformers
Token Classification
Slot Annotation
sequence-tagger-model
Inference Endpoints
Model card Files Community
2
qanastek commited on
Commit
790fd5d
•
1 Parent(s): 8d82603

Update without bio format

Browse files
Files changed (2) hide show
  1. README.md +59 -113
  2. ner_multi.log → ner_no_bio.log +2 -2
README.md CHANGED
@@ -220,119 +220,65 @@ Outputs:
220
  ## Evaluation results
221
 
222
  ```plain
223
- precision recall f1-score support
224
 
225
- B-alarm_type 0.8077 0.1074 0.1896 391
226
- B-app_name 0.3954 0.5581 0.4629 559
227
- B-artist_name 0.7424 0.8188 0.7787 7594
228
- B-audiobook_author 0.7626 0.2751 0.4044 607
229
- B-audiobook_name 0.7448 0.6036 0.6668 2863
230
- B-business_name 0.7705 0.8122 0.7908 11120
231
- B-business_type 0.6715 0.6630 0.6672 3596
232
- B-change_amount 0.7830 0.7719 0.7774 846
233
- B-coffee_type 0.4705 0.7298 0.5722 459
234
- B-color_type 0.6674 0.9244 0.7751 2618
235
- B-cooking_type 0.8630 0.4087 0.5547 986
236
- B-currency_name 0.8851 0.9250 0.9046 4496
237
- B-date 0.8638 0.9276 0.8946 33909
238
- B-definition_word 0.9051 0.8398 0.8712 6474
239
- B-device_type 0.8446 0.8407 0.8426 7459
240
- B-drink_type 0.0000 0.0000 0.0000 127
241
- B-email_address 0.9084 0.9684 0.9374 1075
242
- B-email_folder 0.7464 0.9457 0.8343 663
243
- B-event_name 0.7695 0.7648 0.7671 26880
244
- B-food_type 0.6861 0.8487 0.7588 9047
245
- B-game_name 0.8716 0.7366 0.7984 2866
246
- B-general_frequency 0.7587 0.7920 0.7750 1548
247
- B-house_place 0.9137 0.8814 0.8972 5765
248
- B-ingredient 0.6176 0.0479 0.0890 876
249
- B-joke_type 0.8029 0.7780 0.7903 1126
250
- B-list_name 0.8563 0.7582 0.8043 6195
251
- B-meal_type 0.5883 0.9148 0.7161 1948
252
- B-media_type 0.9111 0.8302 0.8688 13301
253
- B-movie_name 0.5312 0.3696 0.4359 230
254
- B-movie_type 0.2829 0.3931 0.3290 290
255
- B-music_album 0.0000 0.0000 0.0000 104
256
- B-music_descriptor 0.2987 0.2500 0.2722 760
257
- B-music_genre 0.7731 0.7953 0.7840 4821
258
- B-news_topic 0.6437 0.6668 0.6551 5441
259
- B-order_type 0.6739 0.8073 0.7346 2091
260
- B-person 0.8290 0.9138 0.8693 25490
261
- B-personal_info 0.6177 0.6765 0.6458 1249
262
- B-place_name 0.8696 0.8252 0.8468 30683
263
- B-player_setting 0.6816 0.6156 0.6469 4048
264
- B-playlist_name 0.5858 0.4923 0.5350 1942
265
- B-podcast_descriptor 0.7211 0.5209 0.6049 2367
266
- B-podcast_name 0.6930 0.5462 0.6109 2091
267
- B-radio_name 0.7304 0.7598 0.7448 4126
268
- B-relation 0.7852 0.8708 0.8258 5689
269
- B-song_name 0.6053 0.6909 0.6453 4131
270
- B-sport_type 0.0000 0.0000 0.0000 0
271
- B-time 0.8729 0.7341 0.7975 17338
272
- B-time_zone 0.7031 0.6352 0.6674 1428
273
- B-timeofday 0.7367 0.8168 0.7747 4853
274
- B-transport_agency 0.8161 0.7100 0.7594 1000
275
- B-transport_descriptor 0.8333 0.1014 0.1807 148
276
- B-transport_name 0.7979 0.3002 0.4363 513
277
- B-transport_type 0.9332 0.8942 0.9133 5858
278
- B-weather_descriptor 0.8501 0.7775 0.8122 8815
279
- I-alarm_type 1.0000 0.1500 0.2609 120
280
- I-app_name 0.0000 0.0000 0.0000 101
281
- I-artist_name 0.7325 0.8246 0.7758 3819
282
- I-audiobook_author 0.8373 0.2800 0.4197 625
283
- I-audiobook_name 0.6729 0.5007 0.5742 2227
284
- I-business_name 0.7715 0.6326 0.6952 4265
285
- I-business_type 0.5932 0.4661 0.5220 1004
286
- I-change_amount 0.7876 0.8715 0.8274 817
287
- I-coffee_type 0.9160 0.5755 0.7069 417
288
- I-color_type 0.2781 0.1912 0.2266 272
289
- I-cooking_type 0.0000 0.0000 0.0000 17
290
- I-currency_name 0.8220 0.9327 0.8738 2005
291
- I-date 0.7864 0.8482 0.8161 15957
292
- I-definition_word 0.8707 0.6955 0.7733 1859
293
- I-device_type 0.8837 0.8907 0.8872 4172
294
- I-drink_type 0.0000 0.0000 0.0000 4
295
- I-email_address 0.9701 0.9794 0.9747 2911
296
- I-email_folder 0.6881 0.9186 0.7868 221
297
- I-event_name 0.6499 0.5553 0.5989 11745
298
- I-food_type 0.6568 0.7825 0.7141 3306
299
- I-game_name 0.8183 0.6053 0.6959 1652
300
- I-general_frequency 0.8168 0.8338 0.8252 1625
301
- I-house_place 0.9368 0.7289 0.8199 1302
302
- I-ingredient 0.2857 0.0070 0.0137 285
303
- I-joke_type 0.7941 0.6117 0.6910 309
304
- I-list_name 0.7382 0.3989 0.5179 1993
305
- I-meal_type 0.5699 0.8174 0.6716 334
306
- I-media_type 0.8355 0.7420 0.7860 4450
307
- I-movie_name 0.6250 0.1244 0.2075 201
308
- I-movie_type 0.0190 0.0541 0.0281 74
309
- I-music_album 0.0000 0.0000 0.0000 42
310
- I-music_descriptor 0.4231 0.5631 0.4832 293
311
- I-music_genre 0.6716 0.5455 0.6020 1087
312
- I-news_topic 0.6384 0.4187 0.5057 3824
313
- I-order_type 0.4850 0.8050 0.6053 523
314
- I-person 0.7844 0.8400 0.8113 8218
315
- I-personal_info 0.7343 0.8363 0.7820 727
316
- I-place_name 0.6855 0.6703 0.6778 8198
317
- I-player_setting 0.5293 0.4982 0.5132 1361
318
- I-playlist_name 0.4696 0.5182 0.4927 1729
319
- I-podcast_descriptor 0.7448 0.4563 0.5659 2584
320
- I-podcast_name 0.5923 0.5192 0.5534 1248
321
- I-radio_name 0.7907 0.8404 0.8148 5766
322
- I-relation 0.4455 0.4873 0.4655 788
323
- I-song_name 0.5495 0.7433 0.6319 3120
324
- I-sport_type 0.0000 0.0000 0.0000 0
325
- I-time 0.8115 0.8288 0.8201 18118
326
- I-time_zone 0.9708 0.1670 0.2850 1395
327
- I-timeofday 0.7531 0.5734 0.6511 1287
328
- I-transport_agency 0.6667 0.1961 0.3030 51
329
- I-transport_descriptor 0.6429 0.0849 0.1500 106
330
- I-transport_name 0.8469 0.5453 0.6634 497
331
- I-transport_type 0.9556 0.7248 0.8243 505
332
- I-weather_descriptor 0.7756 0.4046 0.5318 2887
333
- O 0.9502 0.9560 0.9531 1031927
334
 
335
- accuracy 0.9031 1455270
336
- macro avg 0.6674 0.5860 0.5972 1455270
337
- weighted avg 0.9032 0.9031 0.9013 1455270
338
  ```
 
220
  ## Evaluation results
221
 
222
  ```plain
223
+ precision recall f1-score support
224
 
225
+ O 0.9537 0.9498 0.9517 1031927
226
+ alarm_type 0.8214 0.1800 0.2953 511
227
+ app_name 0.3448 0.5318 0.4184 660
228
+ artist_name 0.7143 0.8487 0.7757 11413
229
+ audiobook_author 0.7038 0.2971 0.4178 1232
230
+ audiobook_name 0.7271 0.5381 0.6185 5090
231
+ business_name 0.8301 0.7862 0.8075 15385
232
+ business_type 0.7009 0.6196 0.6577 4600
233
+ change_amount 0.8179 0.9104 0.8617 1663
234
+ coffee_type 0.6147 0.8322 0.7071 876
235
+ color_type 0.6999 0.9176 0.7941 2890
236
+ cooking_type 0.7037 0.5184 0.5970 1003
237
+ currency_name 0.8479 0.9686 0.9042 6501
238
+ date 0.8667 0.9348 0.8995 49866
239
+ definition_word 0.9043 0.8135 0.8565 8333
240
+ device_type 0.8502 0.8825 0.8661 11631
241
+ drink_type 0.0000 0.0000 0.0000 131
242
+ email_address 0.9715 0.9747 0.9731 3986
243
+ email_folder 0.5913 0.9740 0.7359 884
244
+ event_name 0.7659 0.7630 0.7645 38625
245
+ food_type 0.6502 0.8697 0.7441 12353
246
+ game_name 0.8974 0.6275 0.7386 4518
247
+ general_frequency 0.8012 0.8673 0.8329 3173
248
+ house_place 0.9337 0.9168 0.9252 7067
249
+ ingredient 0.5481 0.0491 0.0901 1161
250
+ joke_type 0.8147 0.9101 0.8598 1435
251
+ list_name 0.8411 0.7275 0.7802 8188
252
+ meal_type 0.6072 0.8926 0.7227 2282
253
+ media_type 0.8578 0.8522 0.8550 17751
254
+ movie_name 0.4598 0.1856 0.2645 431
255
+ movie_type 0.2673 0.4341 0.3309 364
256
+ music_album 0.0000 0.0000 0.0000 146
257
+ music_descriptor 0.2906 0.3979 0.3359 1053
258
+ music_genre 0.7999 0.7483 0.7732 5908
259
+ news_topic 0.7052 0.5702 0.6306 9265
260
+ order_type 0.6374 0.8845 0.7409 2614
261
+ person 0.8173 0.9376 0.8733 33708
262
+ personal_info 0.7035 0.7444 0.7234 1976
263
+ place_name 0.8616 0.8228 0.8417 38881
264
+ player_setting 0.6429 0.6212 0.6319 5409
265
+ playlist_name 0.5852 0.5293 0.5559 3671
266
+ podcast_descriptor 0.7486 0.5413 0.6283 4951
267
+ podcast_name 0.6858 0.5675 0.6211 3339
268
+ radio_name 0.8196 0.8013 0.8103 9892
269
+ relation 0.6662 0.8569 0.7496 6477
270
+ song_name 0.5617 0.7527 0.6433 7251
271
+ sport_type 0.0000 0.0000 0.0000 0
272
+ time 0.9032 0.8195 0.8593 35456
273
+ time_zone 0.8368 0.4467 0.5824 2823
274
+ timeofday 0.7931 0.8459 0.8187 6140
275
+ transport_agency 0.7876 0.7764 0.7820 1051
276
+ transport_descriptor 0.5738 0.2756 0.3723 254
277
+ transport_name 0.8497 0.5149 0.6412 1010
278
+ transport_type 0.9303 0.8980 0.9139 6363
279
+ weather_descriptor 0.8584 0.7466 0.7986 11702
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
280
 
281
+ accuracy 0.9092 1455270
282
+ macro avg 0.6940 0.6668 0.6613 1455270
283
+ weighted avg 0.9111 0.9092 0.9086 1455270
284
  ```
ner_multi.log → ner_no_bio.log RENAMED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:358cb0ae12d8b1cd563f1dff6706909cbdc0af4dfb98215f62ac258aacb9e21d
3
- size 23837329
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:afc36ff90c602f30b36a62d156308284600f60eeeb3c9c774ebf7efbe02f358b
3
+ size 22254103