|
--- |
|
tags: |
|
- spacy |
|
- text-classification |
|
language: |
|
- zh |
|
model-index: |
|
- name: zh_Overall_Layer_Classifier |
|
results: [] |
|
widget: |
|
- text: 小温加油！美津濃加油🔥🔥 |
|
datasets: |
|
- scfengv/TVL_Overall_Layer_topics |
|
--- |
|
|
|
### Label Scheme |
|
| Component | Labels | |
|
| --- | --- | |
|
| **`textcat_multilabel`** | `比賽`, `加油`, `轉播`, `閒聊` | |
|
|
|
|
|
### Accuracy |
|
|
|
| Type | Score | |
|
| --- | --- | |
|
| `CATS_SCORE` | 99.55 | |
|
| `CATS_MACRO_P` | 97.85 | |
|
| `CATS_MACRO_R` | 96.77 | |
|
| `CATS_MACRO_F` | 97.28 | |
|
| `CATS_MACRO_AUC` | 99.55 | |
|
|
|
### Performance |
|
|
|
| METHOD | SCORE | MARCO_P | MARCO_R | MARCO_F1 | |
|
|--------------------------|----------|----------|----------|-----------| |
|
| RAW | 0.995517 | 0.978480 | 0.967706 | 0.972831 | |
|
| Remove Emoji | 0.991850 | 0.981976 | 0.976106 | 0.978919 | |
|
| Emoji to Description (zh)| 0.993988 | 0.976781 | 0.967531 | 0.972057 | |
|
| Emoji to Description (en)| 0.987205 | 0.964049 | 0.962588 | 0.962881 | |
|
| Remove Punctuation | 0.977612 | 0.960703 | 0.953537 | 0.956064 | |
|
|
|
| CATEGORY | PRECISION | RECALL | F1 | |
|
|----------|-----------|-----------|-----------| |
|
| 比賽 | 0.967742 | 0.991476 | 0.979465 | |
|
| 加油 | 0.988474 | 0.939456 | 0.963342 | |
|
| 轉播 | 0.969380 | 0.982041 | 0.975669 | |
|
| 閒聊 | 0.988324 | 0.957852 | 0.972849 | |
|
|
