scfengv commited on
Commit
25789fd
1 Parent(s): be1bb5a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -14
README.md CHANGED
@@ -12,17 +12,8 @@ widget:
12
  datasets:
13
  - scfengv/TVL_Overall_Layer_topics
14
  ---
15
- | Feature | Description |
16
- | --- | --- |
17
- | **Name** | `zh_Overall_Layer_Classifier` |
18
- | **Version** | `0.0.0` |
19
- | **spaCy** | `>=3.6.1,<3.7.0` |
20
- | **Default Pipeline** | `transformer`, `textcat_multilabel` |
21
- | **Components** | `transformer`, `textcat_multilabel` |
22
 
23
  ### Label Scheme
24
-
25
-
26
  | Component | Labels |
27
  | --- | --- |
28
  | **`textcat_multilabel`** | `比賽`, `加油`, `轉播`, `閒聊` |
@@ -33,12 +24,24 @@ datasets:
33
  | Type | Score |
34
  | --- | --- |
35
  | `CATS_SCORE` | 99.55 |
36
- | `CATS_MICRO_P` | 97.83 |
37
- | `CATS_MICRO_R` | 96.92 |
38
- | `CATS_MICRO_F` | 97.37 |
39
  | `CATS_MACRO_P` | 97.85 |
40
  | `CATS_MACRO_R` | 96.77 |
41
  | `CATS_MACRO_F` | 97.28 |
42
  | `CATS_MACRO_AUC` | 99.55 |
43
- | `TRANSFORMER_LOSS` | 4021.60 |
44
- | `TEXTCAT_MULTILABEL_LOSS` | 930.96 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
12
  datasets:
13
  - scfengv/TVL_Overall_Layer_topics
14
  ---
 
 
 
 
 
 
 
15
 
16
  ### Label Scheme
 
 
17
  | Component | Labels |
18
  | --- | --- |
19
  | **`textcat_multilabel`** | `比賽`, `加油`, `轉播`, `閒聊` |
 
24
  | Type | Score |
25
  | --- | --- |
26
  | `CATS_SCORE` | 99.55 |
 
 
 
27
  | `CATS_MACRO_P` | 97.85 |
28
  | `CATS_MACRO_R` | 96.77 |
29
  | `CATS_MACRO_F` | 97.28 |
30
  | `CATS_MACRO_AUC` | 99.55 |
31
+
32
+ ### Performance
33
+
34
+ | METHOD | SCORE | MARCO_P | MARCO_R | MARCO_F1 |
35
+ |--------------------------|----------|----------|----------|-----------|
36
+ | RAW | 0.995517 | 0.978480 | 0.967706 | 0.972831 |
37
+ | Remove Emoji | 0.991850 | 0.981976 | 0.976106 | 0.978919 |
38
+ | Emoji to Description (zh)| 0.993988 | 0.976781 | 0.967531 | 0.972057 |
39
+ | Emoji to Description (en)| 0.987205 | 0.964049 | 0.962588 | 0.962881 |
40
+ | Remove Punctuation | 0.977612 | 0.960703 | 0.953537 | 0.956064 |
41
+
42
+ | CATEGORY | PRECISION | RECALL | F1 |
43
+ |----------|-----------|-----------|-----------|
44
+ | 比賽 | 0.967742 | 0.991476 | 0.979465 |
45
+ | 加油 | 0.988474 | 0.939456 | 0.963342 |
46
+ | 轉播 | 0.969380 | 0.982041 | 0.975669 |
47
+ | 閒聊 | 0.988324 | 0.957852 | 0.972849 |