Update README.md
Browse files
README.md
CHANGED
@@ -12,17 +12,8 @@ widget:
|
|
12 |
datasets:
|
13 |
- scfengv/TVL_Overall_Layer_topics
|
14 |
---
|
15 |
-
| Feature | Description |
|
16 |
-
| --- | --- |
|
17 |
-
| **Name** | `zh_Overall_Layer_Classifier` |
|
18 |
-
| **Version** | `0.0.0` |
|
19 |
-
| **spaCy** | `>=3.6.1,<3.7.0` |
|
20 |
-
| **Default Pipeline** | `transformer`, `textcat_multilabel` |
|
21 |
-
| **Components** | `transformer`, `textcat_multilabel` |
|
22 |
|
23 |
### Label Scheme
|
24 |
-
|
25 |
-
|
26 |
| Component | Labels |
|
27 |
| --- | --- |
|
28 |
| **`textcat_multilabel`** | `比賽`, `加油`, `轉播`, `閒聊` |
|
@@ -33,12 +24,24 @@ datasets:
|
|
33 |
| Type | Score |
|
34 |
| --- | --- |
|
35 |
| `CATS_SCORE` | 99.55 |
|
36 |
-
| `CATS_MICRO_P` | 97.83 |
|
37 |
-
| `CATS_MICRO_R` | 96.92 |
|
38 |
-
| `CATS_MICRO_F` | 97.37 |
|
39 |
| `CATS_MACRO_P` | 97.85 |
|
40 |
| `CATS_MACRO_R` | 96.77 |
|
41 |
| `CATS_MACRO_F` | 97.28 |
|
42 |
| `CATS_MACRO_AUC` | 99.55 |
|
43 |
-
|
44 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
12 |
datasets:
|
13 |
- scfengv/TVL_Overall_Layer_topics
|
14 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
15 |
|
16 |
### Label Scheme
|
|
|
|
|
17 |
| Component | Labels |
|
18 |
| --- | --- |
|
19 |
| **`textcat_multilabel`** | `比賽`, `加油`, `轉播`, `閒聊` |
|
|
|
24 |
| Type | Score |
|
25 |
| --- | --- |
|
26 |
| `CATS_SCORE` | 99.55 |
|
|
|
|
|
|
|
27 |
| `CATS_MACRO_P` | 97.85 |
|
28 |
| `CATS_MACRO_R` | 96.77 |
|
29 |
| `CATS_MACRO_F` | 97.28 |
|
30 |
| `CATS_MACRO_AUC` | 99.55 |
|
31 |
+
|
32 |
+
### Performance
|
33 |
+
|
34 |
+
| METHOD | SCORE | MARCO_P | MARCO_R | MARCO_F1 |
|
35 |
+
|--------------------------|----------|----------|----------|-----------|
|
36 |
+
| RAW | 0.995517 | 0.978480 | 0.967706 | 0.972831 |
|
37 |
+
| Remove Emoji | 0.991850 | 0.981976 | 0.976106 | 0.978919 |
|
38 |
+
| Emoji to Description (zh)| 0.993988 | 0.976781 | 0.967531 | 0.972057 |
|
39 |
+
| Emoji to Description (en)| 0.987205 | 0.964049 | 0.962588 | 0.962881 |
|
40 |
+
| Remove Punctuation | 0.977612 | 0.960703 | 0.953537 | 0.956064 |
|
41 |
+
|
42 |
+
| CATEGORY | PRECISION | RECALL | F1 |
|
43 |
+
|----------|-----------|-----------|-----------|
|
44 |
+
| 比賽 | 0.967742 | 0.991476 | 0.979465 |
|
45 |
+
| 加油 | 0.988474 | 0.939456 | 0.963342 |
|
46 |
+
| 轉播 | 0.969380 | 0.982041 | 0.975669 |
|
47 |
+
| 閒聊 | 0.988324 | 0.957852 | 0.972849 |
|