everdoubling commited on
Commit
85281fd
β€’
1 Parent(s): 1fe96d0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -6
README.md CHANGED
@@ -18,14 +18,15 @@ ByT5-Korean was pre-trained on [mC4](https://www.tensorflow.org/datasets/catalog
18
  ```text
19
  id: token
20
  0: <pad>
21
- 1: <unk>
22
- 2: <eos>
23
  3~258: utf-8 encoding
24
- 259~277: beginning consonants(μ΄ˆμ„±), from γ„± to γ…Ž
25
- 279~299: middle vowel(쀑성), from ㅏ to γ…£
26
- 300~327: final consonant(μ’…μ„±), None, from γ„± to γ…Ž
27
- 328~384: from <extra_id_0> to <extra_id_56>
28
  ```
 
29
  ## Example Inference
30
 
31
  ```python
 
18
  ```text
19
  id: token
20
  0: <pad>
21
+ 1: <eos>
22
+ 2: <unk>
23
  3~258: utf-8 encoding
24
+ 259~277: beginning consonants(μ΄ˆμ„±), 19개(γ„±γ„²γ„΄γ„·γ„Έγ„Ήγ…γ…‚γ…ƒγ……γ…†γ…‡γ…ˆγ…‰γ…Šγ…‹γ…Œγ…γ…Ž)
25
+ 278~298: middle vowel(쀑성), 21개(γ…γ…γ…‘γ…’γ…“γ…”γ…•γ…–γ…—γ…˜γ…™γ…šγ…›γ…œγ…γ…žγ…Ÿγ… γ…‘γ…’γ…£)
26
+ 299~326: final consonant(μ’…μ„±), 무쒅성+27개(γ„±γ„²γ„³γ„΄γ„΅γ„Άγ„·γ„Ήγ„Ίγ„»γ„Όγ„½γ„Ύγ„Ώγ…€γ…γ…‚γ…„γ……γ…†γ…‡γ…ˆγ…Šγ…‹γ…Œγ…γ…Ž)
27
+ 327~384: from <extra_id_0> to <extra_id_57>
28
  ```
29
+
30
  ## Example Inference
31
 
32
  ```python