|
--- |
|
language: |
|
- yue |
|
pretty_name: "Cantonese (yue) G2PW model - bert base" |
|
tags: |
|
- g2p |
|
license: "cc-by-4.0" |
|
task_categories: |
|
- text2text-generation |
|
datasets: |
|
- Naozumi0512/g2p-Cantonese-aggregate-pos-retag |
|
--- |
|
|
|
# g2pW-canto-20241206-bert-base |
|
|
|
This is a **G2P (Grapheme-to-Phoneme)** model trained on the [Naozumi0512/g2p-Cantonese-aggregate-pos-retag](https://huggingface.co/datasets/Naozumi0512/g2p-Cantonese-aggregate-pos-retag) dataset and evaluated on the [yue-g2p-benchmark](https://github.com/hon9kon9ize/yue-g2p-benchmark). |
|
|
|
## Model Overview |
|
|
|
The model uses **[hon9kon9ize/bert-base-cantonese](https://huggingface.co/hon9kon9ize/bert-base-cantonese)**. For more details see https://github.com/Naozumi520/g2pW-Cantonese . |
|
|
|
--- |
|
|
|
## Dataset |
|
|
|
The model was trained on the [Naozumi0512/g2p-Cantonese-aggregate-pos-retag](https://huggingface.co/datasets/Naozumi0512/g2p-Cantonese-aggregate-pos-retag) dataset, which includes: |
|
|
|
- **68,500 Cantonese words/phrases** with corresponding phonetic transcriptions. |
|
- Data is formatted to align with the **CPP (Chinese Polyphones with Pinyin)** structure. |
|
- Sources include: |
|
- Rime Cantonese Input Schema (`jyut6ping3.words.dict.yaml`) |
|
- 粵典 Words.hk |
|
- CantoDict |
|
|
|
--- |
|
|
|
## Evaluation |
|
|
|
The model was evaluated on the [yue-g2p-benchmark](https://github.com/hon9kon9ize/yue-g2p-benchmark): |
|
|
|
| Metric | Score | |
|
|-------------------------|--------| |
|
| **Accuracy** | 0.6873 | |
|
| **Levenshtein Distance**| 0.1789 | |
|
| **Phoneme Error Rate** | 0.2083 | |
|
|
|
--- |
|
|
|
## Inference |
|
|
|
https://github.com/Naozumi520/g2pW-Cantonese/tree/20241206-bert-base |
|
|
