File size: 1,368 Bytes
074114b
 
 
 
 
 
 
 
 
21250f6
fd9ddd0
 
 
074114b
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
25789fd
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
---
tags:
- spacy
- text-classification
language:
- zh
model-index:
- name: zh_Overall_Layer_Classifier
  results: []
widget:
- text: 小温加油!美津濃加油🔥🔥
datasets:
- scfengv/TVL_Overall_Layer_topics
---

### Label Scheme
| Component | Labels |
| --- | --- |
| **`textcat_multilabel`** | `比賽`, `加油`, `轉播`, `閒聊` |


### Accuracy

| Type | Score |
| --- | --- |
| `CATS_SCORE` | 99.55 |
| `CATS_MACRO_P` | 97.85 |
| `CATS_MACRO_R` | 96.77 |
| `CATS_MACRO_F` | 97.28 |
| `CATS_MACRO_AUC` | 99.55 |

### Performance

| METHOD                   | SCORE    | MARCO_P  | MARCO_R  | MARCO_F1  |
|--------------------------|----------|----------|----------|-----------|
| RAW                      | 0.995517 | 0.978480 | 0.967706 | 0.972831  |
| Remove Emoji             | 0.991850 | 0.981976 | 0.976106 | 0.978919  |
| Emoji to Description (zh)| 0.993988 | 0.976781 | 0.967531 | 0.972057  |
| Emoji to Description (en)| 0.987205 | 0.964049 | 0.962588 | 0.962881  |
| Remove Punctuation       | 0.977612 | 0.960703 | 0.953537 | 0.956064  |

| CATEGORY | PRECISION | RECALL    | F1        |
|----------|-----------|-----------|-----------|
| 比賽     | 0.967742  | 0.991476  | 0.979465  |
| 加油     | 0.988474  | 0.939456  | 0.963342  |
| 轉播     | 0.969380  | 0.982041  | 0.975669  |
| 閒聊     | 0.988324  | 0.957852  | 0.972849  |