Year: 2020

Abstract:
Inspired by the phenomenon of performance disparity between languages in machine translation, we investigate whether and to what extent languages are equally hard to “conditional-language-model”. Our goal is to improve our understanding and expectation of the relationship between language, data representation, size, and performance. We study one-to-one, bilingual conditional language modeling through a series of systematically controlled experiments with the Transformer and the 6 languages from the United Nations Parallel Corpus. We examine character, byte, and word models in 30 language directions and 5 data sizes, and observe indications suggesting a script bias on the character level, a length bias on the byte level, and a word bias that gives rise to a hierarchy in performance across languages. We also identify two types of sample-wise non-monotonicity — while word-based representations are prone to exhibit Double Descent, length can induce unstable performance across the size range studied in a novel meta phenomenon which we term erraticity. By eliminating statistically significant performance disparity on the character and byte levels by normalizing length and vocabulary in the data, we show that, in the context of computing with the Transformer, there is no complexity intrinsic to languages other than that related to their statistical attributes and that performance disparity is not a necessary condition but a byproduct of word segmentation. Our application of statistical comparisons as a fairness measure also serves as a novel rigorous method for the intrinsic evaluation of languages, resolving a decades-long debate on language complexity. While all these quantitative biases leading to disparity are mitigable through a shallower network, we find room for a human bias to be reflected upon. We hope our work helps open up new directions in the area of language and computing that would be fairer and more flexible and foster a new transdisciplinary perspective for DL-inspired scientific progress.

text: Inspired by the phenomenon of performance disparity between languages in machine translation, we investigate whether and to what extent languages are equally hard to “conditional-language-model”. Our goal is to improve our understanding and expectation of the relationship between language, data representation, size, and performance. We study one-to-one, bilingual conditional language modeling through a series of systematically controlled experiments with the Transformer and the 6 languages from the United Nations Parallel Corpus. We examine character, byte, and word models in 30 language directions and 5 data sizes, and observe indications suggesting a script bias on the character level, a length bias on the byte level, and a word bias that gives rise to a hierarchy in performance across languages. We also identify two types of sample-wise non-monotonicity — while word-based representations are prone to exhibit Double Descent, length can induce unstable performance across the size range studied in a novel meta phenomenon which we term erraticity. By eliminating statistically significant performance disparity on the character and byte levels by normalizing length and vocabulary in the data, we show that, in the context of computing with the Transformer, there is no complexity intrinsic to languages other than that related to their statistical attributes and that performance disparity is not a necessary condition but a byproduct of word segmentation. Our application of statistical comparisons as a fairness measure also serves as a novel rigorous method for the intrinsic evaluation of languages, resolving a decades-long debate on language complexity. While all these quantitative biases leading to disparity are mitigable through a shallower network, we find room for a human bias to be reflected upon. We hope our work helps open up new directions in the area of language and computing that would be fairer and more flexible and foster a new transdisciplinary perspective for DL-inspired scientific progress.

heading: 1 INTRODUCTION
text: With a transdisciplinary approach to explore a space at the intersection of Deep Learning (DL) / Neural Networks (NNs), language sciences, and language engineering, we report our undertaking in use-inspired basic research — with an application-related phenomenon as inspiration, we seek fundamental scientific understanding through empirical experimentation. This is not an application or machine translation (MT) paper, but one that strives to evaluate and seek new insights on language in the context of DL with a consideration to contribute to our evaluation, segmentation, and model interpretation practice in multilingual Natural Language Processing (NLP).
Our inspiration: performance disparity in MT The use case that inspired our investigation is the disparity of MT results reported in Junczys-Dowmunt et al. (2016). Of the 6 official languages of the United Nations (UN) — Arabic (AR), English (EN), Spanish (ES), French (FR), Russian (RU), and Chinese (ZH), results with target languages AR, RU, and ZH seem to be worse than those with EN/ES/FR, regardless of the algorithm, may it be from phrased-based Statistical MT (SMT/Moses
(Koehn et al., 2007)) or Neural MT (NMT).1 The languages have the same amount of line-aligned, high-quality parallel data available for training, evaluation, and testing. This prompts the question: are some languages indeed harder to translate from or to?
Problem statement: are all languages equally hard to Conditional-Language-Model (CLM)? A similar question concerning (monolingual) language modeling (LMing) was posed in Cotterell et al. (2018) and Mielke et al. (2019) along with the introduction of a method to evaluate LMs with multiway parallel corpora (multitexts) in information-theoretic terms. To explicitly focus on modeling the complexities that may or may not be intrinsic to the languages, we study the more fundamental process of CLMing without performing any translation. This allows us to eliminate confounds associated with generation and other evaluation metrics. One could think of our effort as estimating conditional probabilities with the Transformer, with a bilingual setup where perplexity of one target language (ltrg) is estimated given the parallel data in one source language (lsrc), where lsrc 6= ltrg. We focus on the very basics and examine the first step in our pipeline — input representation, holding everything else constant. Instead of measuring absolute cross-entropy scores, we evaluate the relative differences between languages from across 5 magnitudes of data sizes in 3 different representation types/levels. We consider bias to be present when performance disparity in our Transformer models is statistically significant.

heading: 1.1 SUMMARY OF FINDINGS AND CONTRIBUTIONS
text: In investigating performance disparity as a function of size and data with respect to language and representation on the Transformer in the context of CLMing, we find:
1. in a bilingual (one-to-one) CLMing setup, there is neutralization of source language instances, i.e. there are no statistically significant differences between source language pairs. Only pairs of target languages differ significantly (see Table 1). 2. We identify 2 types of sample-wise non-monotonicity on each of the primary representation levels we studied:
(a) Double Descent (Belkin et al., 2019; Nakkiran et al., 2020): on the word level, for all languages, performance at 102 lines is typically better than at 103 before it improves again at 104 and beyond. This phenomenon can also be observed in character models with ZH as a target language as well as on the word level with non-neural n-gram LMs; (b) erraticity: performance is irregular and exhibits great variance across runs. We find sequence length to be predictive of this phenomenon. We show that this can be rectified by data transformation or hyperparameter tuning. In our study, erraticity affects AR and RU on the byte level where the sequences are too long with UTF-8 encoding and ZH when decomposed into strokes on the character level. 3. In eliminating performance disparity through lossless data transformation on the character and byte levels, we resolve language complexity (§ 4 and App. J). We show that, in the context of computing with the Transformer, unless word-based methods are used, there is no linguistic/morphological complexity applicable or necessary. There is no complexity that is intrinsic to a language aside from its statistical properties. Hardness in modeling is relative to and bounded by its representation level (representation relativity). On the character and byte levels, hardness is correlated with statistical properties concerning sequence length and vocabulary of a language, irrespective of its linguistic typological, phylogenetic, historical, or geographical profile, and can be eliminated. On the word level, hardness is correlated with vocabulary, and a complexity hierarchy arises through the manual preprocessing step of word tokenization. This complexity/disparity effected by word segmentation cannot be eliminated due to the fundamental qualitative differences in the definition of a “word” being one that neither holds universally nor is suitable/consistent for fair crosslinguistic comparisons. We find clarification of this expectation of disparity necessary because more diligent error analyses need to be afforded instead of simply accepting massively disparate results or inappropriately attributing under-performance to linguistic reasons. 4. Representational units of finer granularity can help close the gap in performance disparity. 5. Bigger/overparameterized models can magnify/exacerbate the effects of differences in data
statistics. Quantitative biases that lead to disparity are mitigable through numerical methods.
1We provide a re-visualization of these grouped in 6 facets by target language in Figure 4 in Appendix A.
Outline of the paper In § 2, we define our method and experimental setup. We present our results and analyses on the primary representations in § 3 and those from secondary set of controls in § 4 in a progressive manner to ease understanding. Meta analyses on fairness evaluation, non-monotonic behavior, and discussion on biases are in § 5. Additional related work is in § 6. We refer our readers to the Appendices for more detailed descriptions/discussions and reports on supplementary experiments.

heading: 2 METHOD AND DEFINITIONS
text: Controlled experiments as basic research for scientific understanding Using the United Nations Parallel Corpus (Ziemski et al., 2016), the data from which the MT results in Junczys-Dowmunt et al. (2016) stem, we perform a series of controlled experiments on the Transformer, holding the hyperparameter settings for all 30 one-to-one language directions from the 6 languages constant. We control for size (from 102 to 106 lines) and language with respect to representational granularity. We examine 3 primary representation types — character, byte (UTF-8), and word, and upon encountering some unusual phenomena, we perform a secondary set of controls with 5 alternate representations — on the character level: Pinyin and Wubi (ASCII representations for ZH phones and character strokes, respectively), on the byte level: code page 1256 (for AR) and code page 1251 (for RU), and on the word level: Byte Pair Encoding (BPE) (Sennrich et al., 2016), an adapted compression algorithm from Gage (1994). These symbolic variants allow us to manipulate the statistical properties of the representations, while staying as “faithful” to the language as possible. We adopt this symbolic data-centric approach because we would like to more directly interpret the confounds, if any, that make language data different from other data types. We operate on a smaller data size range as this is more common in traditional domain sciences and one of our higher goals is to bridge an understanding between language sciences and engineering (the latter being the dominant focus in NLP). We run statistical tests to identify the strongest correlates of performance and to assess whether the differences between the mean performance of different groups are indeed significant. We are concerned not with the absolute scores, but with the relations between scores from different languages and the generalizations derived therefrom.
Information-theoretic, fair evaluation with multitexts Most sequence-to-sequence models are optimized using a cross-entropy loss (see Appendix B for definition). Cotterell et al. (2018) propose to use “renormalized” perplexity (PP) to evaluate LMs fairly using the total number of bits divided by some constant. In our case, we choose instead a simpler method of using an “unnormalized” PP, directly using the total number of bits needed to encode the development (dev) set, which has a constant size of 3,077 lines per language.
Disparity/Inequality In the context of our CLMing experiments, we consider there to be “disparity” or “inequality” between languages l1 and l2 if there are significant differences between the performance distributions of these two languages with respect to each representation. Here, by performance we mean the number of bits required to encode the held-out data using a trained CLM. With 30 directions, there are 15 pairs of source languages (lsrc1, lsrc2) and 15 pairs of target languages (ltrg1, ltrg2) possible. To assess whether the differences are significant, we perform unpaired two-sided significance tests with the null hypothesis that the score distributions for the two languages are not different. Upon testing for normality with the Shapiro-Wilk test (Shapiro & Wilk, 1965; Royston, 1995), we use the parametric unpaired two-sample Welch’s t-test (Welch, 1947) (when normal) or the non-parametric unpaired Wilcoxon test (Wilcoxon, 1945) (when not normal) for the comparisons. We use the implementation in R (R Core Team, 2014) for these 3 tests. To account for the multiple comparisons we are performing, we correct all p-values using Bonferroni’s correction (Benjamini & Heller, 2008; Dror et al., 2017) and follow Holm’s procedure2 (Holm, 1979; Dror et al., 2017) to identify the pairs of l1 and l2 with significant differences after correction. We report all 3 levels of significance (α ≤ 0.05, 0.01, 0.001) for a more comprehensive evaluation.
Experimental setup The systematic, identical treatment we give to our data is described as follows with further preprocessing and hyperparameter details in Appendices B and C, respectively. The distinctive point of our experiment is that the training regime is the same for all (intuition in App. O.1).
2using implementation from https://github.com/rtmdrr/replicability-analysis-NLP
After filtering length to 300 characters maximum per line in parallel for the 6 languages, we made 3 subsets of the data with 1 million lines each — one having lines in the order of the original corpus (dataset A) and two other randomly sampled (without replacement) from the full corpus (datasets B & C). Lines in all datasets are extracted in parallel and remain fully aligned for the 6 languages. For each run and each representation, there are 30 pairwise directions (i.e. one lsrc to one ltrg) that result from the 6 languages. We trained all 150 (for 5 sizes) 6-layer Transformer models for each run using the SOCKEYE Toolkit (Hieber et al., 2018). We optimize using PP and use early stopping if no PP improvement occurs after 3 checkpoints up to 50 epochs maximum, taking the best checkpoint. Characters and bytes are supposed to mitigate the out-of-vocabulary (OOV) problem on the word level. In order to assess the effect of modeling with finer granularity more precisely, all vocabulary items appearing once in the train set are accounted for (i.e. full vocabulary on train, as in Gerz et al. (2018a;b)). But we allow our system to categorize all unknown items in the dev set to be unknown (UNK) so to measure OOVs (open vocabulary on dev (Jurafsky & Martin, 2009)). To identify correlates of performance, we perform Spearman’s correlation (Spearman, 1904) with some basic statistical properties of the data (e.g. length, vocabulary size (|V |), type-token-ratio, OOV rate) as metrics — a complete list thereof is provided in Appendix F. For each of the 3 primary representations — character, byte, and word, we performed 5 runs total in 5 sizes (102-106 lines) (runs A0, B0, C0, A1, & A2) and 7 more runs in 4 sizes (102-105 lines) (A3-7, B1, & C1), also controlling for seeds. For the alternate/secondary representations, we ran 3 runs each in 5 sizes (102-106 lines) (A0, B0, & C0).

heading: 3 EXPERIMENTAL RESULTS OF PRIMARY REPRESENTATIONS
text: Subfigures 1a, 1b, and 1c present the mean results across 12 runs of the 3 primary representations — character, byte, and word, respectively. The x-axis represents data size in number of lines and y-axis the total conditional cross-entropy, measured in bits (Eq. 1 in Appendix B). Each line connects 5 data points corresponding to the number of bits the CLMs (trained with training data of 102, 103, 104, 105, and 106 lines) need to encode the target language dev set given the corresponding text in the source language. These are the same data in the same 30 language directions and 5 sizes with the same training regime, just preprocessed/segmented differently. This confirms representation relativity — languages (or any objects being modeled) need to be evaluated relative to their representation. “One size does not fit all” (Durrani et al., 2019), our conventional way of referring to “language” (as a socio-cultural product or with traditional word-based approaches, or even for most multilingual tasks and competitions) is too coarse-grained (see also Fisch et al. (2019) and Ponti et al. (2020)).
Subfigures 1d, 1e, and 1f display the corresponding information sorted into facets by target language, source languages represented as line types. Through these we see more clearly that results can be grouped rather neatly by target language (cf. figures sorted by source language in Appendix H) — as implicit in the Transformer’s architecture, the decoder is unaware of the source language in the encoder. As shown in Table 1 in § 5 summarizing the number of source and target language pairs with significant differences, there are no significant differences across any source language pairs. The Transformer neutralizes source language instances. This could explain why transfer learning or multilingual/zero-shot translation (Johnson et al., 2017) is possible at all on a conceptual level.
In general, for character and byte models, most language directions do seem to converge at 104 lines to similar values across all target languages, with few notable exceptions. There are some fluctuations past 104, indicating further tuning of hyperparameters would be beneficial due to our present setting possibly working most favorably at 104. On the character level, target language ZH (ZHtrg) shows a different learning pattern throughout. And on the byte level, ARtrg and RUtrg display non-monotonic and unstable behavior, which we refer to as erratic. Word models exhibit Double Descent across the board (note the spike at 103), but overall, difficult/easy languages stay consistent, with AR and RU being the hardest, followed by ES and FR, then EN and ZH. A practical takeaway from this set of experiments: in order to obtain more robust training results, use bytes for ZH (as suggested in Li et al. (2019a)) and characters for AR and RU (e.g. Lee et al. (2017)) — also if one wanted to avoid any “class” problems in performance disparity with words. Performance disparity for these representations is reported in Table 1 under “CHAR”, “BYTE”, and “WORD”. Do note, however, that the intrinsic performance of ZH with word segmentation is not particularly subpar. But this often does not correlate with its poorer downstream tasks results (recall results from Junczys-Dowmunt et al. (2016)). Since the notion of word in ZH is highly contested and
ambiguous — 1) it is often aimed to align with that in other languages so to accommodate manual feature engineering and academic theories, 2) there is great variation among different conventions, 3) native ZH speakers identify characters as words — there are reasons to rethink this procedure now that fairer and language-independent processing in finer granularity is possible (cf. Li et al. (2019b) as well as Duanmu (2017) for a summary on the contested nature of wordhood in ZH). A more native analysis of ZH, despite being considered a high-resource language, has not yet been recognized in NLP.

heading: 4 UNDERSTANDING THE PHENOMENA WITH ALTERNATE REPRESENTATIONS
text: To understand why some languages show different results than others, we carried out a secondary set of control experiments with representations targeting the problematic statistical properties of the corresponding target languages. (An extended version of this section is provided in Appendix P.)
Character level We reduced the high |V | in ZH with representations in ASCII characters — Pinyin and Wubi. The former is a romanization of ZH characters based on their pronunciations and the latter an input algorithm that decomposes character-internal information into stroke shape and ordering and matches these to 5 classes of radicals (Lunde, 2008). We replaced the ZH data in these formats only on the target side and reran the experiments involving ZHtrg on the character level. Results in Figure 2 and Table 1 show that the elimination of disparity on character level is possible if ZH is represented
500000
1000000
1500000
2000000
2500000
1e+03 1e+05 number of lines
nu m
be r
of b
its
TRG
AR EN ES FR RU ZH SRC
AR EN ES FR RU ZH
(a) Wubi
AR EN ES
FR RU ZH
1000000
1500000
2000000
1000000
1500000
2000000
1e+03 1e+05 1e+03 1e+05 1e+03 1e+05 number of lines
nu m
be r
of b
its
TRG
AR EN ES FR RU ZH SRC
AR EN ES FR RU ZH
(b) Wubi by target
500000
1000000
1500000
2000000
2500000
1e+03 1e+05 number of lines
nu m
be r
of b
its
TRG
AR EN ES FR RU ZH SRC
AR EN ES FR RU ZH
(c) Pinyin
AR EN ES
FR RU ZH
1000000
1500000
2000000
1000000
1500000
2000000
1e+03 1e+05 1e+03 1e+05 1e+03 1e+05 number of lines
nu m
be r
of b
its
TRG
AR EN ES FR RU ZH SRC
AR EN ES FR RU ZH
(d) Pinyin by target
(a) Code page 1256 & 1251
(b) Code page by target
(c) BPE
(d) BPE by target
Figure 3: Byte-level (Subfigures 3a & 3b) remedies with code page 1256 for target AR and 1251 for target RU, and word-level (Subfigures 3c & 3d) remedy with BPE for all languages.
through Pinyin (transliteration), as in Subfigure 2c. But models with ZH logographic scripts display a behaviorial tendency unlike those with other (phonetic) alphabetic scripts (Subfigure 2a). Work published thus far using Wubi with the Transformer seems to have needed some form of architectural modification (Gao et al., 2020) or a different architecture altogether (Nikolov et al., 2018; Zhang et al., 2019), suggesting a possible script bias (to be further discussed in § 5 under “Basis for biases”).
Byte level Length is the most salient statistical attribute that makes AR and RU outliers. To shorten their sequence lengths, we tested with alternate encodings on ARtrg and RUtrg — code page 1256 and 1251, which provide 1-byte encodings specific to AR and RU, respectively. Results are shown in Subfigures 3a and 3b. Not only is erraticity resolved, the number of 15 possible target language pairs with significant differences reduces from 8 with the UTF-8 byte representation to 0 (Table 1 under “ARRUt”), indicating that we eliminated disparity with this optimization heuristic. Since our heuristic is a lossless and reversible transform, it shows that a complexity that is intrinsic and necessary in language3 does not exist in computing, however diverse they may be, as our 6 are, from the conventional linguistic typological, phylogenetic, historical, or geographical perspectives. Please refer to Appendix J for our discussion on language complexity.
Word level The main difference between word and character/byte models is length not being a top contributing factor correlating with performance, but instead |V | is. This is understandable as word segmentation neutralizes sequence lengths. To remedy the OOV problem, we use BPE, which learns a fixed vocabulary of variable-length character sequences (on word level, as it presupposes word
3aside from its statistical properties related to length and vocabulary. “Language” here refers to language represented through all representations.
segmentation) from the training data. It is more fine-grained than word segmentation and is known for its capability to model subword units for morphologically complex languages (e.g. AR and RU). We use the same vocabulary of 30,000 as specified in Junczys-Dowmunt et al. (2016). This reduced our averaged OOV token rate by 89-100% across the 5 sizes. The number of language pairs with significant differences reduced to 7 from 8 for word models, showing how finer-grained modeling has a positive effect on closing the disparity gap.

heading: 5 META-RESULTS, ANALYSIS, AND DISCUSSION
text: Performance disparity Table 1 lists the number of language pairs with significant differences under the representations studied. Considering how it is possible for our character and byte models to effect no performance disparity for the same languages on the same data, this indicates that disparity is not a necessary condition. In fact, the customary expectation that languages ought to perform differently stems from our word segmentation practice. Furthermore, the order of AR/RU > ES/FR > EN/ZH (Figure 1c) resembles the idea of morphological complexity. Considering there are character-internal meaningful units in languages with logographic script such as ZH (cf. Zhang & Komachi (2018)) that are rarely captured, studied, or referred to as “morphemes”, this goes to show that linguistic morphology, along with its complexity, as is practiced today4 and that which has occurred in the NLP discourse thus far, has only been relevant on and is bounded to the “word” level. The definition of word, however, has been recognized as problematic for a very long time in the language sciences (see Haspelmath (2011) and references therein from the past century). Since the conventional notion of word, which has been centered on English and languages with alphabetic scripts, has a negative impact on languages both morphologically rich (see Minkov et al. (2007), Seddah et al. (2010), inter alia), AR and RU in our case, as well as morphologically “frugal” (Koehn, 2005), as in ZH, finer-grained modeling with characters and bytes (or n-gram variants/pieces thereof) is indeed a more sensible option and enables a greater variety of languages to be handled with more simplicity, fairness, independence, and flexibility.
While the lack of significant differences between pairs of source languages would signify neutralization of source language instances, it does not mean that source languages have no effect on target. For our byte solutions with code pages, we experimented also with source side optimization in the directions that involve AR/RU as source. This affected the distribution of the disparity results for that representation — with 2 pairs being significantly different (see Table 1 under “ARRUs,t”). We defer further investigation on the nature of source language neutralization to future work.
Sample-wise Double Descent (DD) Sample-wise non-monotonicity/DD (Nakkiran et al., 2020) denotes a degradation followed by an improvement in performance with increasing data size. We notice word models and character models with ZHtrg, i.e. models with high target |V |, are prone to exhibit a spike at 103. A common pattern for these is the ratio of target training token count to number of parameters falls into O(10−4) for 102 lines, O(10−3) at 103, O(10−2) at 104, and O(10−1) for 105 lines and so on. But for more atomic units such as alphabetic (not logographic) characters (may it be Latin, Cyrillic, or Abjad) and for bytes, this progression instead begins at O(10−3) at 102 lines. Instead of thinking this spike of 103 as irregular, we may instead want to
4But there are no reasons why linguistics or linguistic typology cannot encompass a statistical science of language beyond/without “words”, or with continuous representations of characters and bytes. In fact, that could complement the needs of language engineering and the NNs/DL/ML communities better.
think of this learning curve as shifted by 1 order of magnitude to the right for characters and bytes and/or the performance at 102 lines for words and ZH-characters due to being overparameterized and hence abnormal. This would also fit in with the findings by Belkin et al. (2019) and Nakkiran et al. (2020) attributing DD to overparameterization. If we could use this ratio and logic of higher |V | to automatically detect “non-atomic” units, ones that can be further decomposed, this observation could potentially be beneficial for advancing other sciences, e.g. biology. From a cognitive modeling perspective, the similarity in behavior of ZH characters and words of other languages can affirm the interpretation of wordhood for those ZH speakers who identify ZH characters as words (see also last paragraph in § 3 and Appendix J). While almost all work attribute DD to algorithmic reasons, concurrent work by Chen et al. (2020) corroborates our observation and confirms that DD arises due to “the interaction between the properties of the data and the inductive biases of learning algorithms”. Other related work on DD and its more recent development can also be found in their work.
We performed additional experiments testing our setting on the datasets used by the Nakkiran et al. (2020) and testing our data on a non-neural LM. Results support our findings and are provided in Appendix K. Number of model parameters can be found in Appendix L.
Erraticity We observe another type of sample-wise non-monotonicity, one that signals irregular and unstable performance across data sizes and runs. Within one run, erraticity can be observed directly as changes in direction on the y-axis. Across runs, large variance can be observed, even with the same dataset (see Figure 18 in Appendix M). Erraticity can also be observed indirectly through a negative correlation between data size and performance. Many work on length bias in NMT have focused on solutions related to search, e.g. Murray & Chiang (2018). Our experiments show that a kind of length bias can surface already with CLMing, without generation taking place. If the connection between erraticity and length bias can indeed be drawn, it could strengthen the case for global conditioning (Sountsov & Sarawagi, 2016). (See Appendix M for more discussion and results.)
Script bias, erraticity, word bias — are these necessary conditions? To assess whether the observed phenomena are particular to this one setting, we performed one run with dataset A in 4 sizes with the primary representations on 1-layer Transformers (see Appendix N). We observed no significant disparity across the board. It shows that larger/overparameterized models can magnify/exacerbate the differences in the data statistics. That hyperparameter tuning — in this case, through the reduction of the number of layers — can mitigate effects from data statistics is, to the best of our knowledge, a novel insight, suggesting also that a general expectation of monotonic development as data size increases can indeed be held. Our other findings remain consistent (representational relativity, source language neutralization, and DD on word level).
Bases for biases Recall in § 1, we “consider bias to be present when performance disparity in our Transformer models is statistically significant”. As shown in our data statistics and analysis (Appendices D and P respectively), script bias, length bias wrt erraticity in CLMing, and word bias are all evident in the vocabulary and length information in the data statistics. Hence these disparities in performance are really a result of the Transformer being able to model these differences in data at such a magnitude that the differences are statistically significant. The meta phenomenon of erraticity, however, warrants an additional consideration indicative of the empirical limits of our compute (cf. Xu et al. (2020)), even when the non-monotonicity is not observed during the training of each model.
In eliminating performance disparity in character and byte models by normalizing vocabulary and length statistics in the data, we demonstrated that performance disparity as expected from the morphological complexity hierarchy is due to word tokenization, not intrinsic or necessary in language. This is the word bias. Qualitative issues in the concept of word will persist and make crosslinguistic comparison involving “words” unfair even if one were to be able to find a quantitative solution to mitigate the OOV issue, the bottleneck in word-based processing. We humans have a choice in how we see/process languages. That some might still prefer to continue with a crosslinguistic comparison with “words” and exert the superiority of “word” tokenization speaks for a view that is centered on “privileged” languages — in that case, word bias is a human bias.
And, in eliminating performance disparity across the board with our one-layer models, we show that all quantitative differences in data statistics between languages can also be modeled in a “zoomed-
out”/“desensitized” mode, suggesting that while languages can be perceived as being fundamentally different in different ways in different granularities, they can also be viewed as fundamentally similar.

heading: 6 ADDITIONAL RELATED WORK
text: Similar to our work in testing for hardness are Cotterell et al. (2018), Mielke et al. (2019), and Bugliarello et al. (2020). The first two studied (monolingual) LMs — the former tested on the Europarl languages (Koehn, 2005) with n-gram and character models and concluded that morphological complexity was the culprit to hardness, the latter studied 62 languages of the Bible corpus (Mayer & Cysouw, 2014) in addition and refuted the relevance of linguistic features in hardness based on character and BPE models on both corpora in word-tokenized form. Bugliarello et al. (2020) compared translation results of the Europarl languages with BPEs at one data size and concluded that it is easier to translate out of EN than into it, statistical significance was, however, not assessed. In contrast, we ablated away the confound of generation and studied CLMing with controls with a broader range of languages with more diverse statistical profiles in 3 granularities and up to 5 orders of magnitude in data size. That basic data statistics are the driver of success in performance in multilingual modeling has so far only been explicitly argued for in Mielke et al. (2019). We go beyond their work in monolingual LMs to study CLMs and evaluate also in relation to data size, representational granularity, and quantitative and qualitative fairness.
Bender (2009) advocated the relevance of linguistic typology for the design of language-independent NLP systems based on crosslinguistic differences in word-based structural notions, such as parts of speech. Ponti et al. (2019) found typological information to be beneficial in the few-shot setting on the character level for 77 languages with Latin scripts. But no multilingual work has thus far explicitly examined the relation between linguistic typology and the statistical properties of the data, involving languages with diverse statistical profiles in different granularities.
As obtaining training data is often the most difficult part of an NLP or Machine Learning (ML) project, Johnson et al. (2018) introduced an extrapolation methodology to directly model the relation between data size and performance. Our work can be viewed as one preliminary step towards this goal. To the best of our knowledge, there has been no prior work on demonstrating the neutralization of source language instances through statistical comparisons, a numerical analysis on DD for sequence-tosequence models, the meta phenomenon of a sample-wise non-monotonicity (erraticity) being related to length, or the connection between effects of data statistics and modification in architectural depth.

heading: 7 CONCLUSION
text: Summary We performed a novel, rigorous relational assessment of performance disparity across different languages, representations, and data sizes in CLMing with the Transformer. Different disparity patterns were observed on different representation types (character, byte, and word), which can be traced back to the data statistics. The disparity pattern reflected on the word level corresponds to the morphological complexity hierarchy, reminding us that the definition of morphology is predicated on the notion of word and indicating how morphological complexity can be modeled by the Transformer simply through word segmentation. As we were able to eliminate disparity on the same data on the character and byte levels by normalizing length and vocabulary, we showed that morphological complexity is not a necessary concept but one that results from word segmentation and is bounded to the word level, orthogonal to the performance of character or byte models. Representational units of finer granularity were shown to help eliminate performance disparity though at the cost of longer sequence length, which can have a negative impact on robustness. In addition, we found all word models and character models with ZHtrg to behave similarly in their being prone to exhibit a peak (as sample-wise DD) around 103 lines in our setting. While bigger/overparameterized models can magnify the effect of data statistics, exacerbating the disparity, we found a decrease in model depth can eliminate these quantitative biases, leaving only the qualitative aspect of “word” and the necessity of word segmentation in question.
Outlook Machine learning has enabled greater diversity in NLP (Joshi et al., 2020). Fairness, in the elimination of disparity, does not require big data. This paper made a pioneering attempt to bridge research in DL/NNs, language sciences, and language engineering through a data-centric perspective.
We believe a statistical science for NLP as a data science can well complement algorithmic analyses with an empirical view contributing to a more generalizable pool of knowledge for NNs/DL/ML. A more comprehensive study not only can lead us to new scientific frontiers, but also better design and evaluation, benefitting the development of a more general, diverse and inclusive Artificial Intelligence.

heading: B DATA SELECTION AND PREPROCESSING DETAILS 17

heading: C HYPERPARAMETER SETTING 19

heading: D DATA STATISTICS 20

heading: E SCORE TABLES 24

heading: F CORRELATION STATISTICS 25
text: G ENLARGED FIGURES FOR ALL 30 LANGUAGE DIRECTIONS (AGGREGATE RESULTS FROM ALL RUNS) 26
H SAMPLE FIGURES FROM RUN A0, ALSO SORTED BY SOURCE LANGUAGE FOR CONTRAST 42

heading: I LANGUAGE PAIRS WITH SIGNIFICANT DIFFERENCES 43

heading: J LANGUAGE COMPLEXITY 44

heading: K SAMPLE-WISE DOUBLE DESCENT (DD) 46
text: K.1 OUR EXPERIMENTAL FRAMEWORK ON DD DATASETS FROM (NAKKIRAN
ET AL., 2020) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 K.2 TOKEN-TO-PARAMETER RATIO FOR NON-NEURAL MONOLINGUAL LMS . . . 47

heading: L NUMBER OF MODEL PARAMETERS 50

heading: M ERRATICITY 53
text: M.1 ERRATICITY AS LARGE VARIANCE: EVIDENCE FROM DIFFERENT RUNS OF THE
SAME DATA . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53 M.2 ADDITIONAL EXPERIMENT WITH LENGTH FILTERING TO 300 BYTES . . . . . 53

heading: N EXPERIMENTS WITH ONE-LAYER TRANSFORMER 56

heading: O PAQS (PREVIOUSLY ASKED QUESTIONS) 57
text: O.1 ONE SETTING FOR ALL . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57 O.2 TRANSLATIONESE / WORD ORDER . . . . . . . . . . . . . . . . . . . . . . 57
P UNDERSTANDING THE PHENOMENA WITH ALTERNATE REPRESENTATIONS (EXTENDED VERSION) 59

heading: A RE-VISUALIZATION OF FIGURE 1 IN JUNCZYS-DOWMUNT ET AL. (2016) IN
text: 6 FACETS BY TARGET LANGUAGE

heading: B DATA SELECTION AND PREPROCESSING DETAILS
text: The UN Parallel Corpus v1.0 (Ziemski et al., 2016) consists of manually translated UN documents from 1990 to 2014 in the 6 official UN languages. Therein is a subcorpus that is fully aligned by line, comprising the 6-way parallel corpus we use. We tried to have as little preprocessing or filtering as necessary to eliminate possible confounds. But as the initial runs of our experiment failed due to insufficient memory on a single GPU with 12 GB VRAM5, we filtered out lines with more than 300 characters in any language in lockstep with one another for all the 6 languages such that the subcorpora would remain parallel, thereby keeping the material of each language semantically equivalent to one another. 8,944,859 lines for each language were retained as our training data which cover up to the 75th percentile in line length for all 6 languages. In order to monitor the effect of data size, we made subcorpora of each language in 5 sizes by heading the first 102, 103, 104, 105, 106 lines6. We refer to this as dataset A. In addition, to better understand and verify the consistency of the phenomena observed, we made 2 supplemental datasets by shuffling the 8,944,859 lines two different times randomly and heading the number of lines in our 5 sizes for each language, again in lockstep with one another (datasets B and C).
5GPUs used for experiments in this paper range from a NVIDIA TITAN RTX (24 GB), NVIDIA GeForce RTX 2080 Ti (11 GB), a GTX Titan X (12 GB), to a GTX 1080 (8 GB). All jobs were run on a single GPU setting. Some word-level experiments involving ARtrg or RUtrg at 106 had to be run on a CPU as 24 GB VRAM were not sufficient. Models with higher maximum sequence lengths (e.g. byte models) were trained with 24 GB VRAM. Difference in equipment does not necessarily lead to degradation/improvement in scores.
6The terms “line” and “sentence” have been used interchangeably in the NLP literature. We use “line” to denote a sequence that ends with a newline character and “sentence” as one with an ending punctuation. Most parallel corpora, such as ours, are aligned by line, as a line may be part of a sentence or without an ending punctuation (e.g. a header/title). Using a standardized unit such as “line” would also be a fairer measure to linguae/scriptiones continuae (languages/scripts with no explicit punctuation).
For character modeling, we used a dummy symbol to denote each whitespace. For byte, we turned each UTF-8-encoded character into a byte string in decimal value, such that each token is a number between 0 and 255, inclusive. For word, we followed (Junczys-Dowmunt et al., 2016) and used the Moses tokenizer (Koehn et al., 2007) as is standard in NMT practice when word tokenization is applied and Jieba7 for segmentation in ZH.
For Pinyin, we used the implementation from https://github.com/lxyu/pinyin in the numerical format such that each character/syllable is followed by a single digit indicating its lexical tone in Mandarin. For Wubi, we used the dictionary from the implementation from https:// github.com/arcsecw/wubi.
We have implemented all representations such that they would be reversible even when the sequence contains code-mixing.
We used the official dev set as provided in (Ziemski et al., 2016), 3,077 lines per language remained from 4,000 after filtering line length to 300 characters. Data statistics is provided in Appendix D for reference.
The systematic training regime that we give to our language directions are identical for all. For each primary representation type (character, byte, and word), we performed:
• 5 runs in 5 sizes (102 − 106): A0 (seed=13), B0 (13), C0 (9948), A1 (9948), A2 (265), and • 7 more runs in 4 sizes (102 − 105): A3 (777), A4 (42), A5 (340589), A6 (1000), A7 (83146),
B1 (9948), & C1 (13).
For each run and each size, there are 30 pairwise directions (i.e. 1 source language to 1 target language, e.g. AR-EN for Arabic to English) that result from the 6 languages. We trained all 150 jobs for each run and representation using the Transformer model (Vaswani et al., 2017) as supported by the SOCKEYE Toolkit (Hieber et al., 2018) (version 1.18.85), based on MXNet (Chen et al., 2015). A detailed description of the architecture of the Transformer can be found in (Vaswani et al., 2017). The same set of hyperparameters applies to all and its values are listed in Appendix C.
Notes on training time Each run of 30 directions in 5 sizes took approximately 8-12 days for character and byte models. Byte models generally took longer — hence training time is positively correlated with length (concurring with observations by Cherry et al. (2018) as they compared character with BPE models). A maximum length of 300 characters entails a maximum length of at least 300 bytes in UTF-8. Each run of word models (30 directions, 5 sizes) took about 6 days (excluding the training of some 7-9 directions out of 30 per run involving ARtrg or RUtrg at 106 on word level which took about 12-18 hours each direction to train on a CPU as these required more space and would run out of memory (OOM) on our GPUs otherwise). These figures do not include the additional probing experiments described in § 4.
Evaluation metric Most sequence-to-sequence models are optimized using a cross-entropy loss, defined as:
H(t, s) = − N∑ i=1 log2 p(ti | t<i, s) (1)
where t is the sequence of tokens to be predicted, ti refers to the ith token in that sequence, s is the sequence of tokens conditioned on, and N = |t|. It is customary to report scores as PP, which is 2 1 N H(t,s), i.e. 2 to the power of the cross-entropy averaged by the number of tokens (based on whichever granularity of unit is used for training) in the data. Cotterell et al. (2018) propose to use “renormalized” PP to evaluate LMs fairly through the division of an arbitrary constant. In our case, we choose instead a simpler method of using an “unnormalized” PP, i.e. the total number of bits needed to encode the development (dev) set, which has a constant size of 3,077 lines per language (after length filtering of the same dev set used in Junczys-Dowmunt et al. (2016)) for all various training sizes. As the implementation we used (SOCKEYE (Hieber et al., 2018)) only reports PP, we transform it back to entropy as defined above by noting that H(t, s) = log2 PP (t|s)×N .
7https://github.com/fxsjy/jieba
C HYPERPARAMETER SETTING
• encoder transformer; • decoder transformer; • num-layers 6:6; • num-embed 512:512; • transformer-model-size 512; • transformer-attention-heads 8; • transformer-feed-forward-num-hidden 2048; • transformer-activation-type relu; • transformer-positional-embedding-type fixed; • transformer-preprocess d; transformer-postprocess drn; • transformer-dropout-attention 0.1; • transformer-dropout-act 0.1; • transformer-dropout-prepost 0.1; • batch-size 15; • batch-type sentence; • max-num-checkpoint-not-improved 3; • max-num-epochs 50; • optimizer adam; • optimized-metric perplexity; • optimizer-params epsilon: 0.000000001, beta1: 0.9, beta2: 0.98; • label-smoothing 0.0; • learning-rate-reduce-num-not-improved 4; • learning-rate-reduce-factor 0.001; • loss-normalization-type valid; • max-seq-len 300 for character, word, and BPE, 672 for all bytes, 688 for Wubi, 680 for Pinyin; • checkpoint-frequency/interval 4000.
(For smaller datasets, the end of 50 epochs is often reached before the first checkpoint. Since SOCKEYE only outputs scores at checkpoints, we adjusted the checkpoint frequency as follows to get a score outputted by the end of 50 epochs: 1000 for 100 lines for all character & byte instances, 400 for 100 lines for word and 500 for 100 lines BPE, 3450 for 1000 lines for word & BPE. For the very few cases that this default does not suffice due to bucketing of similar length sequences, we manually set the checkpoint frequency to the last batch.)
D D
A TA
S TA
T IS
T IC S • N um be ro ft yp es ,i .e .v oc ab
ul ar
y si
ze (| V |)
.N ot
e th
at So
ck ey
e ad
ds fo
ri ts
ca lc
ul at
io n 4
ad di
tio na
lt yp
es :<
pa d>
,< s>
,< /s
>, <u
nk >.
• N
um be
ro ft
ok en
s. T
hi s
ex cl
ud es
th e 1
E O
S/ B
O S
(e nd
-/ be
gi nn
in g-
of -s
en te
nc e)
m ar
ke ra
dd ed
by So
ck ey
e to
ea ch
lin e.
• O
ut -o
fvo
ca bu
la ry
(O O
V )t
yp e
ra te
(i n
% ),
i.e .t
he fr
ac tio
n of
th e
ty pe
s in
th e
de v
da ta
th at
is no
tc ov
er ed
by th
e ty
pe s
in th
e tr
ai ni
ng da
ta .
• O
O V
to ke
n ra
te (i
n %
), i.e
.t he
fr ac
tio n
of to
ke ns
in th
e de
v da
ta th
at is
tr ea
te d
as U
N K
no w
ns .
• Ty
pe -t
ok en
-r at
io (i
n %
), i.e
.t he
ra tio
be tw
ee n
th e
nu m
be ro
ft yp
es an
d to
ke ns
in th
e da
ta .T
hi s
is a
ro ug
h pr
ox y
fo rl
ex ic
al di
ve rs
ity in
th at
a va
lu e
of 1
w ou
ld in
di ca
te th
at no
ty pe
is ev
er se
en tw
ic e,
an d
a va
lu e
ve ry
cl os
e to
0 w
ou ld
in di
ca te
th at
ve ry
fe w
di st
in ct
ty pe
s ac
co un
tf or
al m
os ta
ll of
th e
da ta . • L in e le ng th (e xc l. E O S/ B O S m ar ke r) :m ea n±
st an
da rd
de vi
at io
n, an
d th
e 0/
25 /5
0/ 75
/1 00
-t h
pe rc
en til
e. S ta
tis tic
s fo
rd at
as et A R ep re se nt at io n C H A R B Y T
E W
O R
D B PE N um be ro fl in es 10 0 1, 00 0 1 0, 00 0 1 00 ,0 0 0 1 ,0 00 ,0 0 0 10 0 1 ,0 00 1 0, 00 0 1 00 ,0 00 1 ,0 00 ,0 00 1 00 1 ,0 00 10 ,0 00 1 0 0, 00 0 1 ,0 0 0, 0 00 1 00 1 ,0 0 0 10 ,0 00
10 0, 00 0
1 ,0 00 ,0 00
N um
be r
of T
Y PE S A R 82
10 7
1 4 9
1 76
2 39
73 95
1 30
1 45
1 62
8 66
5 ,8 65
26 ,1 05
9 7, 99 4
30 4, 9 75
7 0 0
4, 17 1
18 ,2 02
29 ,7 06
29 ,9 61
E N
75 8 1
1 22
16 7
24 4
76 82
12 7
15 1
16 6
67 9
3 ,2 89
1 2, 0 1 1
37 ,2 61
1 22 ,4 5 4
64 5
2, 85 6
10 ,2 25
26 ,1 84
29 ,0 68
E S
84 9 0
1 14
17 3
25 4
85 91
11 8
15 1
16 6
70 7
3 ,8 36
1 5, 1 1 3
49 ,4 96
1 42 ,8 0 6
66 1
3, 23 2
12 ,0 83
27 ,9 08
29 ,4 45
FR 86
9 4
1 30
17 5
25 6
87 96
13 0
15 3
17 2
7 42
3 ,8 78
1 3, 9 9 5
42 ,8 67
1 18 ,2 0 1
72 3
3, 19 3
11 ,7 31
27 ,3 93
29 ,3 33
R U
9 5
1 0 8
1 60
18 7
26 0
97 11 0
14 8
15 7
16 6
8 83
5 ,4 30
2 3, 40 0
8 1, 3 39
2 3 6, 08 5
8 42
4, 3 1 9
17 ,9 9 5
29 ,2 39
29 ,8 07
Z H
6 02
1, 2 36
2, 2 67
3, 4 00
4, 8 85
13 7
14 3
15 3
16 4
19 3
62 7
3, 17 8
1 3, 1 3 4
46 ,9 38
1 34 ,4 8 9
80 0
2, 8 49
1 0, 65 6
27 ,2 84
29 ,1 48
Z H
_p in
yi n
79 90
1 0 4
1 5 4
5 64
Z H
_w ub
i 10 0
10 6
1 2 3
1 70
5 42
A R
_c p1
25 6
8 2
10 7
14 9
17 6
23 9
R U
_c p1
25 1
9 5
10 8
16 0
18 7
26 0
N um
be r
of TO
K E
N S
A R
9 ,0 7 9
1 23 ,8 32
1 ,0 83 ,5 1 7
1 0 ,6 2 5 ,0 47
1 0 2 ,0 6 4 ,2 30
16 ,6 55
22 7, 1 63
1 ,9 85 ,0 1 4
19 ,4 8 7, 68 9
18 6 ,1 7 1, 18 0
1 ,7 76
2 3, 4 60
2 06 ,5 49
2 ,0 35 ,1 9 0
19 ,4 1 0, 5 02
2 ,9 07
2 8, 22 7
2 23 ,5 10
2 ,2 18 ,0 44
21 ,3 44 ,9 00
E N
1 1 ,7 30
15 9, 44 4
1 ,3 44 ,0 0 1
1 3 ,1 3 2 ,8 62
1 2 3 ,4 9 1 ,8 71
11 ,7 31
15 9, 4 49
1 ,3 45 ,7 7 1
13 ,1 5 8, 94 8
12 3 ,7 0 5, 12 8
2 ,0 71
2 7, 39 8
23 6, 5 6 9
2 ,3 3 9, 1 09
2 1 ,9 4 3 ,1 3 9
2 ,9 8 0
29 ,7 78
24 3, 62 8
2 ,3 69 ,7 23
22 ,3 51 ,0 59
E S
1 2 ,3 7 4
1 71 ,1 04
1 ,4 84 ,8 0 4
14 ,5 49 ,7 0 3
13 8 ,5 96 ,0 3 6
12 ,6 29
17 5, 28 6
1 ,5 13 ,7 82
1 4 ,8 21 ,4 95
14 1 ,2 76 ,7 66
2 ,2 3 2
29 ,4 61
2 63 ,0 2 4
2 ,5 88 ,7 9 1
2 4 ,6 54 ,4 4 9
3 ,1 80
3 2, 3 2 3
2 71 ,9 9 5
2 ,6 44 ,0 55
25 ,2 64 ,4 39
FR 1 2 ,4 56
1 7 9, 04 8
1 ,4 9 0 ,9 8 3
1 4 ,5 2 8 ,5 93
1 3 8 ,0 4 9, 1 89
12 ,8 75
1 85 ,2 27
1 ,5 42 ,1 05
15 ,0 55 ,6 57
1 43 ,4 95 ,6 67
2 ,2 98
3 2, 0 11
2 73 ,1 95
2 ,6 8 4, 98 2
25 ,5 9 5, 4 87
3 ,2 4 5
3 4, 80 1
2 8 0, 9 28
2 ,7 27 ,3 86
26 ,0 77 ,5 53
R U
1 1 ,9 80
16 8, 15 6
1 ,4 3 6 ,0 7 8
1 4 ,1 5 1 ,7 28
1 3 4 ,7 0 6, 1 20
2 1 ,7 5 1
3 09 ,2 79
2 ,6 36 ,5 91
25 ,9 90 ,2 63
2 47 ,0 98 ,7 58
1 ,8 54
2 4, 74 6
21 6, 63 8
2 ,1 5 0 ,7 4 6
2 0 ,4 2 1 ,9 6 5
3 ,1 1 0
29 ,1 06
23 1, 29 3
2 ,3 07 ,6 56
22 ,0 66 ,9 45
Z H
3, 3 18
4 2, 5 7 2
37 2, 0 03
3 ,6 59 ,6 1 7
34 ,6 72 ,6 1 2
8 ,5 59
1 16 ,6 67
1 ,0 19 ,9 6 9
9 ,9 9 0, 04 6
94 ,2 68 ,8 4 0
1 ,7 5 1
23 ,5 68
2 07 ,7 14
2 ,0 38 ,6 3 9
1 9 ,3 61 ,1 0 1
2 ,2 23
2 5, 45 9
2 15 ,1 79
2 ,0 83 ,6 32
19 ,8 85 ,7 89
Z H
_p in
yi n
10 ,8 11
1 48 ,0 8 3
1 ,2 7 9, 58 6
1 2 ,5 3 0 ,5 67
1 18 ,4 71 ,2 2 9
Z H
_w ub
i 9, 2 45
12 7, 19 0
1 ,1 0 4 ,5 2 9
1 0 ,8 8 5 ,5 08
1 0 2 ,9 0 8, 1 55
A R
_c p1
25 6
9, 07 9
12 3, 83 2
1 ,0 83 ,5 17
10 ,6 25 ,0 47
1 02 ,0 64 ,2 30
R U
_c p1
25 1
11 ,9 80
16 8, 15 6
1 ,4 36 ,0 78
14 ,1 51 ,7 28
13 4 ,7 06 ,1 20
O O
V ty
pe ra
te (% ) A R 40 .7 7
23 .0 8
2 .3 1
0 .0 0
0 .0 0
40 .6 5
2 2 .7 6
2 .4 4
0 .0 0
0 .0 0
95 .8 0
79 .8 0
4 8 .0 2
2 4 .1 9
8 .1 4
1 0 .1 7
1 .3 9
0 .0 9
0 .0 0
0 .0 0
E N
2 3. 71
2 0 .6 2
11 .3 4
4 .1 2
2 .0 6
2 6 .4 7
23 .5 3
6 .8 6
0 .9 8
0 .0 0
92 .0 7
6 9 .0 8
33 .5 6
1 5 .2 7
7 .3 8
4 .7 3
1 .0 1
0 .1 8
0 .0 5
0 .0 1
E S
2 5. 23
20 .7 2
1 6 .2 2
8 .1 1
7 .2 1
2 3 .6 4
19 .0 9
11 .8 2
4 .5 5
0 .9 1
9 3 .3 2
71 .9 0
3 4 .7 2
13 .2 4
6 .1 2
5 .4 4
1 .0 6
0 .2 7
0 .1 0
0 .0 8
FR 25 .6 6
19 .4 7
1 1 .5 0
4 .4 2
2 .6 5
27 .1 2
20 .3 4
7 .6 3
2 .5 4
0 .0 0
9 2 .5 0
70 .2 5
3 2 .1 6
1 2 .3 1
5 .6 2
5 .1 1
0 .9 9
0 .2 6
0 .0 5
0 .0 2
R U
34 .9 3
2 6 .7 1
4 .1 1
2 .0 5
0 .0 0
32 .6 4
24 .3 1
3 .4 7
1 .3 9
0 .0 0
94 .5 2
7 5 .8 4
39 .1 4
1 4 .5 4
5 .6 9
6 .3 8
1 .2 7
0 .0 6
0 .0 2
0 .0 0
Z H
6 9 .7 9
3 9 .7 3
10 .5 8
1 .8 7
0 .5 6
10 .4 6
7 .1 9
3 .2 7
1 .3 1
0 .0 0
93 .1 9
7 3 .2 9
38 .5 9
1 5 .6 3
5 .6 5
76 .0 9
40 .9 5
8 .5 2
0 .8 9
0 .2 1
Z H
_p in
yi n
2 0 .4 1
1 5 .3 1
8 .1 6
4 .0 8
0 .0 0
Z H
_w ub
i 17 .5 0
1 3 .3 3
5 .8 3
3 .3 3
0 .0 0
A R
_c p1
25 6
4 0 .7 7
2 3 .0 8
2 .3 1
0 .0 0
0 .0 0
R U
_c p1
25 1
34 .9 3
26 .7 1
4 .1 1
2 .0 5
0 .0 0
O O
V to
ke n
ra te
(% )
A R
0 .7 5
0 .3 5
0 .0 0
0 .0 0
0 .0 0
0 .4 1
0 .1 9
0 .0 0
0 .0 0
0 .0 0
60 .8 6
40 .2 8
17 .9 4
8 .6 2
2 .1 0
2 .5 7
1 .9 9
0 .1 1
0 .0 0
0 .0 0
E N
0 .0 5
0 .0 2
0 .0 0
0 .0 0
0 .0 0
0 .0 6
0 .0 2
0 .0 0
0 .0 0
0 .0 0
3 9 .0 4
18 .5 7
6 .1 6
2 .7 0
1 .0 1
0 .3 5
0 .0 8
0 .0 2
0 .0 1
0 .0 0
E S
0 .0 7
0 .0 1
0 .0 1
0 .0 1
0 .0 1
0 .0 7
0 .0 2
0 .0 1
0 .0 1
0 .0 0
36 .2 1
1 8 .2 8
6 .2 8
2 .3 4
0 .8 6
0 .2 8
0 .1 3
0 .0 5
0 .0 3
0 .0 3
FR 0 .1 9
0 .1 0
0 .0 7
0 .0 0
0 .0 0
0 .2 1
0 .1 1
0 .0 7
0 .0 0
0 .0 0
35 .4 4
17 .4 7
6 .0 4
2 .1 3
0 .7 6
0 .6 4
0 .5 2
0 .3 6
0 .0 1
0 .0 0
R U
0 .3 0
0 .2 4
0 .1 6
0 .0 0
0 .0 0
0 .1 6
0 .1 3
0 .0 8
0 .0 0
0 .0 0
53 .2 2
30 .9 4
1 2 .5 9
4 .1 7
1 .2 8
0 .8 8
1 .0 7
0 .8 4
0 .0 1
0 .0 0
Z H
1 7. 83
3 .6 4
0 .3 8
0 .0 4
0 .0 1
0 .0 5
0 .0 2
0 .0 0
0 .0 0
0 .0 0
4 5 .4 8
22 .0 8
8 .3 4
3 .2 0
0 .8 3
31 .6 7
11 .7 6
1 .6 6
0 .1 4
0 .0 3
Z H
_p in
yi n
0 .0 6
0 .0 3
0 .0 0
0 .0 0
0 .0 0
Z H
_w ub
i 0 .0 7
0 .0 4
0 .0 0
0 .0 0
0 .0 0
A R
_c p1
25 6
0. 7 5
0 .3 5
0 .0 0
0 .0 0
0 .0 0
R U
_c p1
25 1
0. 3 0
0 .2 4
0 .1 6
0 .0 0
0 .0 0
T T
R (% ) A
R 0 .9 0
0 .0 9
0 .0 1
0 .0 0
0 .0 0
0 .4 4
0 .0 4
0 .0 1
0 .0 0
0 .0 0
48 .7 6
25 .0 0
12 .6 4
4 .8 1
1 .5 7
2 4 .0 8
1 4 .7 8
8 .1 4
1 .3 4
0 .1 4
E N
0 .6 4
0 .0 5
0 .0 1
0 .0 0
0 .0 0
0 .6 5
0 .0 5
0 .0 1
0 .0 0
0 .0 0
3 2 .7 9
12 .0 0
5 .0 8
1 .5 9
0 .5 6
2 1 .6 4
9 .5 9
4 .2 0
1 .1 0
0 .1 3
E S
0 .6 8
0 .0 5
0 .0 1
0 .0 0
0 .0 0
0 .6 7
0 .0 5
0 .0 1
0 .0 0
0 .0 0
31 .6 8
1 3 .0 2
5 .7 5
1 .9 1
0 .5 8
20 .7 9
10 .0 0
4 .4 4
1 .0 6
0 .1 2
FR 0 .6 9
0 .0 5
0 .0 1
0 .0 0
0 .0 0
0 .6 8
0 .0 5
0 .0 1
0 .0 0
0 .0 0
32 .2 9
12 .1 1
5 .1 2
1 .6 0
0 .4 6
2 2 .2 8
9 .1 8
4 .1 8
1 .0 0
0 .1 1
R U
0. 79
0 .0 6
0 .0 1
0 .0 0
0 .0 0
0 .4 5
0 .0 4
0 .0 1
0 .0 0
0 .0 0
47 .6 3
21 .9 4
1 0 .8 0
3 .7 8
1 .1 6
27 .0 7
14 .8 4
7 .7 8
1 .2 7
0 .1 4
Z H
18 .1 4
2 .9 0
0 .6 1
0 .0 9
0 .0 1
1 .6 0
0 .1 2
0 .0 2
0 .0 0
0 .0 0
3 5 .8 1
13 .4 8
6 .3 2
2 .3 0
0 .6 9
3 5 .9 9
1 1 .1 9
4 .9 5
1 .3 1
0 .1 5
Z H
_p in
yi n
0. 7 3
0 .0 6
0 .0 1
0 .0 0
0 .0 0
Z H
_w ub
i 1. 08
0 .0 8
0 .0 1
0 .0 0
0 .0 0
A R
_c p1
25 6
0. 90
0 .0 9
0 .0 1
0 .0 0
0 .0 0
R U
_c p1
25 1
0. 79
0 .0 6
0 .0 1
0 .0 0
0 .0 0
M ea
n lin
e le
ng th ±
st d
0/ 25
/5 0/
75 /1
00 -t
h
A R
90 .7 9 ± 5 4 .4 5
12 3 .8 3 ± 47 .0 9
1 0 8 .3 5 ± 5 3 .7 9
1 06 .2 5 ± 5 4 .8 8
1 02 .0 6 ± 5 7 .2 5
16 6 .5 5 ± 99 .8 8
22 7 .1 6 ± 86 .0 9
19 8 .5 0 ± 99 .0 2
19 4 .8 8 ± 1 01 .0 3
18 6 .1 7 ± 10 4 .8 6
17 .7 6 ± 1 0 .7 8
23 .4 6 ± 9. 12
2 0 .6 5 ± 10 .2 4
2 0 .3 5 ± 1 0 .4 6
19 .4 1 ± 10 .8 3
2 9 .0 7 ± 1 7 .4 8
2 8 .2 3 ± 1 1 .3 3
22 .3 5 ± 11 .3 0
22 .1 8 ± 11 .6 6
21 .3 4 ± 12 .1 3
8/ 33 / 91 / 13 6 /2 2 3
5 /9 4 /1 2 6/ 15 5 / 26 3
1/ 69 /1 09 / 14 7 /2 99
1/ 64 / 10 7 /1 4 7/ 29 9
1 /5 4 /1 0 2/ 1 4 5/ 30 0
16 /6 2 /1 66 / 2 47 /4 04
9/ 17 2/ 23 0/ 28 5/ 47 9
1/ 12 6/ 20 0/ 26 9/ 55 4
1 /1 17 /1 96 / 27 0 /5 61
1/ 9 8/ 18 7/ 26 5/ 56 5
1 /7 / 17 / 27 / 48
1/ 1 8 /2 4 /2 9 /5 6
1 / 13 / 2 0/ 28 /1 0 4
1/ 1 3/ 20 / 2 8/ 10 7
1/ 11 / 1 9/ 27 / 1 3 7
3/ 1 4/ 27 / 4 3/ 75
1/ 2 1 /2 8 /3 5 /7 1
1/ 14 / 2 2/ 3 0/ 1 1 3
1/ 14 / 22 / 30 / 12 2
1/ 12 / 21 / 30 / 17 3
E N
11 7 .3 0 ± 72 .5 1
1 5 9 .4 4 ± 5 8 .8 8
1 34 .4 0 ± 66 .7 9
13 1 .3 3 ± 68 .2 5
1 2 3 .4 9 ± 69 .5 3
1 1 7 .3 1 ± 7 2 .5 0
1 59 .4 5 ± 5 8. 88
13 4 .5 8 ± 6 6 .8 0
13 1 .5 9 ± 68 .3 4
12 3 .7 1 ± 69 .6 4
2 0 .7 1 ± 12 .1 6
27 .4 0 ± 10 .3 5
23 .6 6 ± 1 1 .6 8
2 3 .3 9 ± 1 2 .0 2
2 1 .9 4 ± 1 2 .2 9
29 .8 0 ± 1 7 .1 8
29 .7 8 ± 11 .3 2
2 4 .3 6 ± 1 2 .0 9
23 .7 0 ± 12 .2 0
22 .3 5 ± 12 .5 3
8 /4 9 /1 12 /1 7 0 / 26 5
8/ 11 7 /1 6 3/ 2 03 /2 8 5
1 /8 6 /1 37 /1 8 5 / 3 0 0
1/ 7 9/ 1 34 /1 83 /3 0 0
1 /6 5 /1 25 / 17 7 /3 00
8/ 4 9/ 1 12 /1 70 /2 6 5
8 /1 17 / 1 63 /2 03 / 28 5
1/ 87 / 13 7/ 18 5/ 30 0
1 / 80 / 13 4/ 18 4/ 30 0
1 /6 5 /1 25 / 1 77 /3 11
1 /9 / 19 / 30 / 46
1/ 2 0 /2 8 /3 5 /6 0
1 /1 5 /2 4 /3 2 /9 3
1 / 1 5/ 24 / 3 2/ 10 6
1/ 12 /2 2 /3 1 /1 3 6
3 /1 6 /2 7 /4 2 /7 0
1 /2 2 /3 0 /3 7 /6 8
1 / 16 / 2 4/ 33 / 1 01
1/ 15 /2 4 /3 2 /1 06
1 /1 2 /2 2 /3 2 /1 38
E S
12 3 .7 4 ± 7 8 .9 1
17 1 .1 0 ± 64 .0 3
1 4 8 .4 8 ± 73 .3 8
1 45 .5 0 ± 7 5 .3 2
1 38 .6 0 ± 7 7 .5 6
12 6 .2 9 ± 8 0. 2 1
17 5 .2 9 ± 65 .4 4
15 1 .3 8 ± 74 .7 0
14 8 .2 1 ± 76 .6 7
14 1 .2 8 ± 78 .9 6
22 .3 2 ± 13 .9 7
29 .4 6 ± 11 .3 5
2 6 .3 0 ± 1 3. 03
25 .8 9 ± 13 .3 5
2 4 .6 5 ± 1 3. 7 8
3 1 .8 0 ± 19 .3 9
32 .3 2 ± 1 2 .6 0
2 7 .2 0 ± 13 .5 7
26 .4 4 ± 13 .6 7
25 .2 6 ± 14 .1 4
6/ 4 2/ 1 19 /1 8 6 /2 96
6/ 12 7 /1 7 5/ 21 7 / 29 7
1/ 9 5/ 1 5 0/ 20 5 /3 0 0
1 /8 8 /1 48 / 20 4 /3 0 0
1/ 7 3/ 1 40 /2 0 0 /3 00
7 /4 4 /1 21 / 19 1 /3 0 2
7 /1 30 /1 79 / 2 22 /3 06
1 /9 7 /1 53 / 20 9/ 30 7
1 /8 9 /1 50 / 20 8/ 31 2
1 /7 4 /1 43 /2 03 / 31 8
1/ 7 /2 2 /3 2 /5 2
1/ 2 2/ 2 9/ 3 7/ 63
1 /1 7 /2 6 /3 6 /1 04
1 /1 6 /2 6 /3 6 /1 07
1 /1 3 /2 5 /3 5 /1 3 9
4 /1 6 /3 1 /4 3 /7 9
1/ 24 / 3 2/ 41 / 7 2
1 /1 8 /2 7 /3 7 /1 06
1 /1 6 /2 7 /3 7 /1 07
1 /1 4 /2 5 /3 6 /1 40
FR 12 4 .5 6 ± 79 .3 8
1 79 .0 5 ± 6 6 .4 4
14 9 .1 0 ± 74 .1 9
1 4 5 .2 9 ± 75 .7 5
1 3 8 .0 5 ± 7 7 .9 0
1 28 .7 5 ± 82 .1 6
1 85 .2 3 ± 68 .5 2
1 54 .2 1 ± 7 6. 66
15 0 .5 6 ± 78 .4 2
14 3 .5 0 ± 80 .9 9
22 .9 8 ± 1 4 .1 6
3 2 .0 1 ± 11 .9 9
2 7 .3 2 ± 13 .5 3
26 .8 5 ± 1 3 .8 9
25 .6 0 ± 14 .4 5
3 2 .4 5 ± 19 .5 2
34 .8 0 ± 1 3 .0 9
28 .0 9 ± 13 .9 6
27 .2 7 ± 14 .1 3
26 .0 8 ± 14 .7 1
5/ 4 5 /1 16 / 1 9 0/ 28 7
5/ 1 33 / 1 83 /2 2 8/ 30 0
1 /9 3 /1 5 2/ 2 0 6 /3 0 0
1 /8 7 /1 4 8/ 20 4 / 30 0
1/ 7 2 /1 40 / 19 9 /3 00
5/ 4 7 /1 2 1/ 19 6 / 29 7
5/ 1 38 /1 90 /2 36 / 3 12
1 /9 6 /1 57 /2 13 / 32 2
1 /9 0 /1 53 /2 12 / 32 2
1/ 75 / 14 5/ 20 7/ 33 1
1 /9 /2 2 /3 4 /5 0
1/ 2 4 /3 2 /4 1 /7 0
1 /1 7 /2 8 /3 7 /1 0 7
1 /1 6 /2 7 /3 7 /1 10
1/ 1 4/ 26 /3 7 /1 3 8
2 /1 6 /3 0 /4 6 /7 6
2 / 2 7/ 3 5/ 4 4/ 7 7
1 /1 8 /2 8 /3 8 /1 0 7
1 /1 7 /2 8 /3 8 /1 10
1 /1 4 /2 6 /3 7 /1 38
R U
11 9 .8 0 ± 7 2 .0 9
16 8 .1 6 ± 62 .1 1
1 43 .6 1 ± 7 1 .5 5
14 1 .5 2 ± 7 3. 9 5
1 34 .7 1 ± 76 .2 0
21 7 .5 1 ± 13 4 .5 1
30 9 .2 8 ± 11 4. 9 8
26 3 .6 6 ± 13 2. 7 7
25 9 .9 0 ± 13 7. 10
2 47 .1 0 ± 1 41 .1 4
1 8 .5 4 ± 10 .6 5
24 .7 5 ± 9. 53
2 1 .6 6 ± 10 .8 1
2 1 .5 1 ± 1 1 .1 2
20 .4 2 ± 1 1 .4 4
31 .1 0 ± 1 7. 42
2 9 .1 1 ± 11 .5 1
2 3 .1 3 ± 1 1 .7 1
23 .0 8 ± 12 .1 7
22 .0 7 ± 12 .5 7
1 0/ 4 4 /1 19 /1 83 / 2 6 0
5/ 12 6 / 17 4 /2 13 /2 9 8
1 /9 1 /1 46 / 19 7 /3 0 0
1 /8 5 /1 44 /1 9 9/ 3 00
1/ 70 /1 3 6/ 1 9 4/ 30 0
20 /7 7 /2 15 / 3 32 /4 89
10 /2 3 1/ 31 8 /3 9 2/ 55 4
1 /1 67 / 2 68 /3 63 /5 62
1 /1 55 /2 64 / 36 5/ 56 6
1 /1 27 /2 49 / 35 7 /5 67
1 /8 / 18 / 27 / 39
1/ 19 /2 5 /3 1 /5 8
1 / 14 /2 2 /2 9 /1 04
1/ 1 3/ 22 / 3 0/ 10 7
1/ 1 1/ 2 0/ 2 9/ 1 36
4/ 1 8/ 2 9/ 4 5/ 69
1/ 21 /2 9 /3 7 /6 8
1 /1 5 /2 3 /3 1 /1 0 4
1/ 14 / 23 / 32 /1 10
1/ 12 / 22 / 31 / 16 6
Z H
33 .1 8 ± 18 .3 8
4 2 .5 7 ± 1 6 .9 1
37 .2 0 ± 18 .4 6
3 6 .6 0 ± 19 .0 5
3 4 .6 7 ± 19 .2 9
85 .5 9 ± 51 .1 8
1 16 .6 7 ± 43 .8 2
1 02 .0 0 ± 50 .6 1
9 9 .9 0 ± 51 .4 9
94 .2 7 ± 52 .8 0
17 .5 1 ± 1 0 .6 8
2 3 .5 7 ± 9. 52
2 0 .7 7 ± 10 .4 8
2 0 .3 9 ± 1 0 .6 0
19 .3 6 ± 10 .8 7
2 2 .2 3 ± 1 2 .3 3
2 5 .4 6 ± 1 0. 29
21 .5 2 ± 10 .9 4
20 .8 4 ± 10 .9 2
19 .8 9 ± 11 .2 3
3 /1 9 /3 0 /4 5 /8 8
2 /3 2 /4 2 /5 3 /1 27
1 /2 4 /3 7 /4 9 /1 6 5
1 /2 3 /3 6 /4 9 /2 4 1
1 / 19 / 34 / 48 / 28 1
7/ 3 5 /8 1 /1 27 / 19 2
6/ 88 /1 17 / 14 8/ 24 3
1/ 66 / 10 3 /1 3 9/ 29 7
1 / 61 / 10 1 /1 38 /3 37
1 /5 1 /9 5 /1 34 / 59 4
2 /7 / 17 / 25 / 46
1/ 1 8 /2 3 /2 9 /7 6
1 / 13 / 2 0/ 28 / 1 08
1/ 1 3/ 2 0/ 2 8/ 11 1
1/ 1 1 /1 9 /2 7 /1 67
2 /1 3 /2 0 /3 1 /5 8
1 /1 9 /2 5 /3 2 /7 9
1/ 1 4/ 2 1/ 2 9/ 1 0 8
1/ 13 /2 1 /2 8 /1 11
1 /1 1 /2 0 /2 8 /1 67
Z H
_p in
yi n
1 08 .1 1 ± 65 .5 1
1 48 .0 8 ± 5 5 .5 7
12 7 .9 6 ± 63 .9 6
12 5 .3 1 ± 65 .2 5
1 1 8 .4 7 ± 6 6 .8 8
7 /4 3 /9 8 /1 61 /2 5 5
7 / 1 0 9 /1 4 9 /1 88 / 31 2
1/ 82 / 12 9 /1 7 5 /3 6 9
1 /7 6 /1 2 6/ 17 4 / 40 7
1/ 6 3/ 1 1 9/ 1 69 /6 4 5
Z H
_w ub
i 9 2. 4 5 ± 55 .2 6
1 2 7 .1 9 ± 4 8 .0 0
11 0 .4 5 ± 5 4. 7 1
10 8 .8 6 ± 56 .0 4
1 0 2 .9 1 ± 57 .4 1
8/ 3 9 /8 6 /1 37 / 21 8
7/ 94 /1 2 9 / 1 5 8/ 26 6
1/ 71 / 11 1 /1 5 0 /3 2 7
1 /6 7 /1 1 0/ 1 50 /3 6 4
1/ 5 5/ 1 0 3/ 1 46 / 62 7
A R
_c p1
25 6
90 .7 9 ± 54 .4 5
1 23 .8 3 ± 47 .0 9
10 8 .3 5 ± 53 .7 9
10 6 .2 5 ± 54 .8 8
10 2 .0 6 ± 57 .2 5
8 /3 3 /9 1 /1 3 6/ 22 3
5 /9 4 /1 26 /1 5 5/ 26 3
1/ 69 /1 09 / 14 7 /2 99
1 /6 4 /1 07 / 1 47 /2 99
1 /5 4 /1 0 2/ 14 5/ 30 0
R U
_c p1
25 1
1 1 9. 8 0 ± 72 .0 9
16 8 .1 6 ± 62 .1 1
1 43 .6 1 ± 71 .5 5
14 1 .5 2 ± 7 3 .9 5
13 4 .7 1 ± 76 .2 0
10 /4 4 /1 19 /1 8 3 / 26 0
5/ 1 26 / 1 74 /2 13 /2 98
1 / 91 / 14 6 /1 97 /3 00
1 /8 5 /1 44 / 19 9/ 30 0
1 /7 0 /1 36 / 19 4 /3 00
St at
is tic
s fo
rd at
as et
B
R ep
re se
nt at
io n
C H
A R
B Y
T E
W O
R D
B PE
N um
be ro
fl in
es 1 00
1, 0 0 0
10 ,0 00
10 0, 0 00
1 ,0 00 ,0 0 0
1 00
1 ,0 00
1 0, 00 0
1 00 ,0 00
1 ,0 00 ,0 00
1 00
1 ,0 0 0
1 0, 00 0
1 0 0, 0 00
1 ,0 00 ,0 0 0
10 0
1 ,0 0 0
10 ,0 00
10 0, 00 0
1 ,0 00 ,0 00
N um
be r
of T
Y PE S A R 8 7
1 34
1 68
25 1
43 1
88 12 4
14 7
15 9
18 1
1 ,1 2 9
6, 71 9
28 ,2 22
9 7, 46 7
31 1, 35 5
8 10
4, 40 8
18 ,8 00
29 ,6 80
29 ,9 59
E N
7 6
9 9
1 3 1
1 8 9
3 43
7 9
10 3
13 5
16 3
18 1
8 76
4 ,1 48
13 ,6 60
4 2, 84 4
14 0, 91 2
7 84
3, 40 8
10 ,7 56
26 ,8 20
29 ,1 78
E S
86 1 0 4
1 34
1 89
36 6
89 10 8
13 3
16 1
18 5
97 0
4 ,7 75
16 ,7 35
5 1, 36 6
15 4, 48 2
8 14
3, 70 5
12 ,5 29
28 ,0 68
29 ,4 71
FR 8 9
11 2
1 4 7
2 02
35 2
91 12 0
14 2
16 2
18 5
95 5
4 ,6 36
1 5, 6 39
4 5, 34 8
13 2, 88 1
8 12
3, 67 0
12 ,2 58
27 ,7 44
29 ,3 70
R U
1 0 9
1 4 2
1 73
2 04
32 0
11 2
14 1
15 9
16 1
18 0
1 ,1 42
6, 5 20
2 5, 9 59
8 3, 93 7
25 1, 3 55
99 3
4, 82 9
18 ,8 37
29 ,2 61
29 ,8 11
Z H
7 61
1, 5 75
2, 4 02
3, 4 65
4, 7 05
1 23
15 3
16 5
17 5
18 8
89 7
4, 16 2
14 ,7 14
4 6, 7 8 8
14 0, 18 8
1, 06 8
3, 7 17
1 1, 06 9
27 ,4 09
29 ,1 07
Z H
_p in
yi n
7 1
1 04
14 0
24 1
4 3 0
Z H
_w ub
i 8 7
1 24
15 4
24 6
4 2 1
A R
_c p1
25 6
8 7
13 4
16 8
25 1
43 1
R U
_c p1
25 1
1 09
1 42
1 73
2 04
3 20
N um
be r
of TO
K E
N S
A R
9 ,7 9 8
1 00 ,5 99
1 ,0 1 9, 69 6
10 ,2 48 ,9 7 6
10 2 ,4 81 ,8 1 6
1 7 ,6 5 6
18 1, 8 66
1 ,8 42 ,1 38
1 8 ,5 1 7, 66 9
18 5 ,1 72 ,6 1 8
1 ,8 2 5
18 ,7 6 0
19 0, 46 5
1 ,9 1 5 ,7 4 6
1 9 ,1 38 ,7 2 4
3 ,3 8 7
2 5, 2 34
21 0, 62 2
2 ,0 90 ,4 03
20 ,9 86 ,1 16
E N
1 1, 81 6
1 1 9, 7 9 6
1 ,2 0 1, 8 39
1 2 ,0 8 7, 92 2
1 20 ,9 6 9, 16 3
11 ,8 20
11 9, 83 9
1 ,2 02 ,2 17
12 ,0 91 ,6 02
12 1 ,0 06 ,8 03
2 ,0 47
21 ,0 58
2 11 ,0 29
2 ,1 22 ,3 6 5
21 ,2 3 4, 4 37
3 ,2 62
2 4, 63 4
2 20 ,3 90
2 ,1 59 ,5 66
21 ,6 69 ,7 69
E S
13 ,5 4 3
13 5, 1 06
1 ,3 63 ,4 5 4
13 ,7 09 ,4 9 3
13 7 ,1 80 ,5 4 2
13 ,7 9 0
13 7, 6 13
1 ,3 89 ,3 15
1 3 ,9 67 ,0 72
1 39 ,7 53 ,2 63
2 ,3 90
23 ,8 58
24 1, 78 9
2 ,4 3 1 ,5 7 9
24 ,3 26 ,0 5 5
3 ,7 0 2
2 8, 1 7 9
25 3, 07 5
2 ,4 85 ,2 92
24 ,9 33 ,9 87
FR 1 3, 17 3
1 34 ,7 02
1 ,3 5 8 ,5 6 7
13 ,6 62 ,0 2 4
13 6 ,8 11 ,8 7 0
13 ,6 17
1 39 ,2 50
1 ,4 04 ,0 01
14 ,1 21 ,6 29
1 41 ,4 03 ,2 57
2 ,3 62
24 ,4 42
24 7, 02 7
2 ,4 8 5 ,2 0 3
24 ,8 74 ,3 5 5
3 ,6 6 4
2 8, 5 4 1
25 7, 30 5
2 ,5 27 ,8 89
25 ,3 74 ,6 29
R U
13 ,1 06
1 3 0, 28 9
1 ,3 2 5 ,7 9 3
1 3 ,3 5 6 ,7 17
1 3 3 ,6 9 9 ,4 73
24 ,0 59
23 9, 14 5
2 ,4 33 ,1 54
24 ,5 12 ,9 4 9
24 5 ,3 96 ,3 32
1 ,9 60
19 ,6 42
2 0 0, 1 8 8
2 ,0 1 4, 8 89
2 0 ,1 53 ,1 2 4
3 ,7 6 0
26 ,1 36
21 8, 3 2 5
2 ,1 70 ,4 10
21 ,7 92 ,2 16
Z H
3 ,3 29
3 3, 76 8
3 40 ,6 9 2
3 ,4 19 ,8 0 3
34 ,2 06 ,1 0 6
9 ,1 2 2
92 ,6 89
9 35 ,1 72
9 ,4 02 ,7 43
94 ,0 64 ,3 53
1 ,8 66
18 ,6 97
1 8 9, 7 7 3
1 ,9 0 6, 7 04
1 9 ,0 73 ,1 3 3
2 ,5 6 3
21 ,6 30
19 9, 0 2 8
1 ,9 46 ,5 43
19 ,5 74 ,5 72
Z H
_p in
yi n
1 1, 39 1
1 15 ,5 77
1 ,1 6 6, 2 27
1 1 ,7 32 ,2 6 4
1 17 ,3 6 7, 34 9
Z H
_w ub
i 10 ,0 35
10 1, 04 9
1 ,0 1 9 ,1 1 3
1 0 ,2 4 2, 5 40
1 0 2 ,4 6 0 ,5 73
A R
_c p1
25 6
9, 79 8
10 0, 59 9
1 ,0 19 ,6 96
10 ,2 48 ,9 76
10 2 ,4 81 ,8 16
R U
_c p1
25 1
13 ,1 0 6
13 0, 2 89
1 ,3 25 ,7 93
13 ,3 56 ,7 17
13 3 ,6 99 ,4 7 3
O O
V ty
pe ra
te (% ) A R 35 .3 8
5 .3 8
0 .7 7
0 .0 0
0 .0 0
28 .4 6
4 .8 8
0 .8 1
0 .0 0
0 .0 0
93 .6 1
72 .0 7
35 .5 1
1 3 .0 7
4 .8 2
7 .8 6
0 .3 0
0 .0 2
0 .0 0
0 .0 0
E N
2 5 .7 7
1 1 .3 4
8 .2 5
2 .0 6
0 .0 0
26 .4 7
11 .7 6
5 .8 8
0 .0 0
0 .0 0
89 .5 8
61 .0 4
2 6 .2 8
10 .2 5
4 .1 8
4 .0 0
0 .4 4
0 .1 5
0 .0 4
0 .0 0
E S
2 6 .1 3
12 .6 1
1 1 .7 1
3 .6 0
0 .0 0
24 .5 5
1 0 .9 1
8 .1 8
0 .9 1
0 .0 0
90 .5 9
64 .2 7
2 7 .7 3
9 .6 1
3 .9 5
4 .0 8
0 .4 4
0 .1 7
0 .0 6
0 .0 0
FR 2 3 .0 1
1 1 .5 0
7 .9 6
2 .6 5
0 .0 0
24 .5 8
7 .6 3
5 .0 8
0 .8 5
0 .0 0
9 0 .2 3
62 .6 1
2 5 .7 9
8 .7 1
3 .3 6
3 .8 7
0 .4 7
0 .1 2
0 .0 5
0 .0 0
R U
26 .7 1
6 .1 6
2 .7 4
0 .0 0
0 .0 0
23 .6 1
4 .8 6
2 .0 8
0 .0 0
0 .0 0
93 .2 0
69 .7 5
32 .2 0
1 1 .1 0
3 .9 1
4 .3 9
0 .2 3
0 .0 3
0 .0 1
0 .0 0
Z H
61 .8 4
2 6 .9 7
6 .6 8
1 .0 1
0 .1 5
20 .2 6
2 .6 1
0 .6 5
0 .0 0
0 .0 0
8 9 .7 3
64 .1 0
2 9 .5 4
1 0 .4 4
3 .8 4
6 7 .8 9
27 .0 0
5 .2 7
0 .6 7
0 .0 4
Z H
_p in
yi n
27 .5 5
8 .1 6
2 .0 4
0 .0 0
0 .0 0
Z H
_w ub
i 2 8 .3 3
4 .1 7
0 .8 3
0 .0 0
0 .0 0
A R
_c p1
25 6
35 .3 8
5 .3 8
0 .7 7
0 .0 0
0 .0 0
R U
_c p1
25 1
2 6 .7 1
6 .1 6
2 .7 4
0 .0 0
0 .0 0
O O
V to
ke n
ra te
(% )
A R
0. 31
0 .0 1
0 .0 0
0 .0 0
0 .0 0
0 .1 1
0 .0 0
0 .0 0
0 .0 0
0 .0 0
53 .9 4
25 .8 9
9 .2 6
3 .1 4
1 .1 5
0 .8 2
0 .0 8
0 .0 0
0 .0 0
0 .0 0
E N
0. 05
0 .0 0
0 .0 0
0 .0 0
0 .0 0
0 .0 5
0 .0 0
0 .0 0
0 .0 0
0 .0 0
34 .1 1
12 .1 8
3 .5 0
1 .2 2
0 .5 0
0 .3 0
0 .0 2
0 .0 1
0 .0 1
0 .0 0
E S
0. 04
0 .0 1
0 .0 1
0 .0 0
0 .0 0
0 .0 4
0 .0 1
0 .0 1
0 .0 0
0 .0 0
3 1 .5 2
12 .5 7
3 .7 2
1 .1 5
0 .4 6
0 .1 9
0 .0 3
0 .0 4
0 .0 2
0 .0 0
FR 0. 07
0 .0 1
0 .0 0
0 .0 0
0 .0 0
0 .0 8
0 .0 0
0 .0 0
0 .0 0
0 .0 0
30 .9 6
11 .9 1
3 .3 8
0 .9 9
0 .3 9
0 .2 2
0 .0 5
0 .0 1
0 .0 1
0 .0 0
R U
0. 22
0 .0 0
0 .0 0
0 .0 0
0 .0 0
0 .1 1
0 .0 0
0 .0 0
0 .0 0
0 .0 0
4 9 .0 5
22 .7 5
7 .5 5
2 .3 6
0 .8 1
0 .7 1
0 .0 2
0 .0 0
0 .0 0
0 .0 0
Z H
10 .4 4
1 .2 1
0 .1 6
0 .0 2
0 .0 0
0 .1 0
0 .0 0
0 .0 0
0 .0 0
0 .0 0
3 7 .8 1
13 .7 4
4 .4 2
1 .4 2
0 .5 3
22 .0 2
4 .9 9
0 .7 9
0 .1 0
0 .0 0
Z H
_p in
yi n
0. 0 3
0 .0 0
0 .0 0
0 .0 0
0 .0 0
Z H
_w ub
i 0. 0 9
0 .0 0
0 .0 0
0 .0 0
0 .0 0
A R
_c p1
25 6
0. 31
0 .0 1
0 .0 0
0 .0 0
0 .0 0
R U
_c p1
25 1
0. 22
0 .0 0
0 .0 0
0 .0 0
0 .0 0
T T
R (% ) A
R 0. 89
0 .1 3
0 .0 2
0 .0 0
0 .0 0
0 .5 0
0 .0 7
0 .0 1
0 .0 0
0 .0 0
61 .8 6
35 .8 2
14 .8 2
5 .0 9
1 .6 3
2 3 .9 1
1 7 .4 7
8 .9 3
1 .4 2
0 .1 4
E N
0. 6 4
0 .0 8
0 .0 1
0 .0 0
0 .0 0
0 .6 7
0 .0 9
0 .0 1
0 .0 0
0 .0 0
4 2 .7 9
19 .7 0
6 .4 7
2 .0 2
0 .6 6
24 .0 3
1 3 .8 3
4 .8 8
1 .2 4
0 .1 3
E S
0. 6 4
0 .0 8
0 .0 1
0 .0 0
0 .0 0
0 .6 5
0 .0 8
0 .0 1
0 .0 0
0 .0 0
40 .5 9
20 .0 1
6 .9 2
2 .1 1
0 .6 4
2 1 .9 9
1 3 .1 5
4 .9 5
1 .1 3
0 .1 2
FR 0. 68
0 .0 8
0 .0 1
0 .0 0
0 .0 0
0 .6 7
0 .0 9
0 .0 1
0 .0 0
0 .0 0
40 .4 3
1 8 .9 7
6 .3 3
1 .8 2
0 .5 3
22 .1 6
12 .8 6
4 .7 6
1 .1 0
0 .1 2
R U
0. 8 3
0 .1 1
0 .0 1
0 .0 0
0 .0 0
0 .4 7
0 .0 6
0 .0 1
0 .0 0
0 .0 0
58 .2 7
33 .1 9
12 .9 7
4 .1 7
1 .2 5
2 6 .4 1
1 8 .4 8
8 .6 3
1 .3 5
0 .1 4
Z H
22 .8 6
4 .6 6
0 .7 1
0 .1 0
0 .0 1
1 .3 5
0 .1 7
0 .0 2
0 .0 0
0 .0 0
48 .0 7
22 .2 6
7 .7 5
2 .4 5
0 .7 4
4 1 .6 7
1 7 .1 8
5 .5 6
1 .4 1
0 .1 5
Z H
_p in
yi n
0. 62
0 .0 9
0 .0 1
0 .0 0
0 .0 0
Z H
_w ub
i 0. 87
0 .1 2
0 .0 2
0 .0 0
0 .0 0
A R
_c p1
25 6
0. 8 9
0 .1 3
0 .0 2
0 .0 0
0 .0 0
R U
_c p1
25 1
0. 83
0 .1 1
0 .0 1
0 .0 0
0 .0 0
M ea
n lin
e le
ng th ±
st d
0/ 25
/5 0/
75 /1
00 -t
h
A R
9 7 .9 8 ± 55 .4 7
1 00 .6 0 ± 5 9 .6 0
10 1 .9 7 ± 59 .1 0
10 2 .4 9 ± 58 .3 6
1 0 2 .4 8 ± 5 8. 39
1 76 .5 6 ± 10 1 .9 7
18 1 .8 7 ± 10 8. 68
1 84 .2 1 ± 10 7. 4 9
18 5 .1 8 ± 1 06 .2 2
18 5 .1 7 ± 10 6 .2 9
18 .2 5 ± 10 .1 2
18 .7 6 ± 11 .1 0
19 .0 5 ± 10 .9 5
1 9 .1 6 ± 1 0. 83
19 .1 4 ± 10 .8 2
33 .8 7 ± 1 8 .3 8
2 5 .2 3 ± 15 .2 6
2 1 .0 6 ± 1 2. 27
20 .9 0 ± 12 .0 2
20 .9 9 ± 12 .0 8
9/ 5 3/ 9 4/ 14 7 /2 34
2 /4 9 /1 0 1/ 1 47 /2 7 4
1/ 5 1/ 1 0 1/ 1 47 / 30 0
1/ 5 3 /1 03 / 14 7 /3 00
1 /5 3 /1 02 /1 4 7/ 3 00
1 4/ 98 / 1 70 /2 6 6/ 4 32
2 / 88 / 18 2/ 26 6/ 50 1
1 /9 0 /1 84 / 2 67 /5 51
1 /9 5 /1 85 / 26 6 /5 52
1 /9 5 /1 85 / 2 66 /5 61
2/ 10 / 17 / 27 / 43
1 /9 / 18 / 27 / 73
1/ 1 0/ 19 / 2 7/ 84
1/ 1 0 /1 9 /2 7 /1 4 3
1 /1 0 /1 9 /2 7 /1 2 9
2 /2 0 /3 2 /5 0 /7 3
1 / 13 / 2 4/ 36 /9 6
1 /1 1 /2 1 /3 0 /9 5
1 /1 1 /2 1 /2 9 /1 46
1 /1 1 /2 1 /2 9 /1 65
E N
1 18 .1 6 ± 6 8. 05
1 19 .8 0 ± 7 1. 1 5
12 0 .1 8 ± 70 .0 0
12 0 .8 8 ± 69 .4 3
1 2 0 .9 7 ± 6 9 .5 4
11 8 .2 0 ± 68 .0 5
11 9 .8 4 ± 71 .1 7
12 0 .2 2 ± 70 .0 2
12 0 .9 2 ± 69 .4 4
12 1 .0 1 ± 69 .5 5
20 .4 7 ± 11 .0 2
2 1 .0 6 ± 12 .6 0
2 1 .1 0 ± 12 .2 5
2 1 .2 2 ± 1 2. 14
2 1 .2 3 ± 12 .1 5
32 .6 2 ± 1 7. 93
2 4 .6 3 ± 1 4 .9 0
2 2 .0 4 ± 12 .7 8
21 .6 0 ± 12 .3 4
21 .6 7 ± 12 .4 0
7/ 6 4/ 1 14 /1 76 /2 56
2 /5 8 /1 2 2/ 17 4 / 28 8
1/ 6 0/ 1 2 1/ 1 76 /2 9 9
1 /6 2 /1 22 /1 7 5/ 3 0 0
1/ 6 2/ 1 22 /1 7 5 /3 00
7 / 6 4/ 11 4/ 17 6 /2 5 6
2 /5 8 /1 22 / 17 5 /2 88
1 /6 0 /1 21 / 17 6/ 29 9
1 /6 2 /1 22 /1 75 / 30 0
1 /6 2 /1 22 /1 75 / 3 03
1/ 12 /1 9 /3 1 /4 2
1 /1 1 /2 1 /3 1 /7 4
1 /1 1 /2 1 /3 0 /8 6
1 /1 1 /2 1 /3 0 /1 17
1 /1 1 /2 1 /3 0 /1 2 7
2 /1 9 /3 1 /4 7 /8 1
1/ 1 3/ 2 4/ 3 5/ 8 5
1/ 1 1/ 2 2/ 3 1 /8 9
1 /1 2 /2 2 /3 1 /1 17
1 /1 2 /2 2 /3 1 /1 29
E S
13 5 .4 3 ± 7 7 .5 4
1 35 .1 1 ± 7 9. 66
1 36 .3 5 ± 7 9 .0 0
13 7 .0 9 ± 78 .2 2
13 7 .1 8 ± 78 .4 5
1 37 .9 0 ± 78 .9 3
13 7 .6 1 ± 81 .0 3
1 38 .9 3 ± 8 0. 43
13 9 .6 7 ± 79 .6 1
13 9 .7 5 ± 79 .8 4
23 .9 0 ± 1 3 .2 9
23 .8 6 ± 14 .1 2
2 4 .1 8 ± 1 3 .9 4
24 .3 2 ± 1 3 .8 3
2 4 .3 3 ± 13 .8 6
3 7 .0 2 ± 20 .6 8
28 .1 8 ± 1 6 .9 6
25 .3 1 ± 14 .6 0
24 .8 5 ± 14 .1 3
24 .9 3 ± 14 .2 1
1 1 /8 0 /1 33 / 20 0 /2 86
2/ 65 / 13 7 /2 00 /3 0 0
1 /6 7 /1 3 8/ 2 00 /3 0 0
1 /7 0 /1 39 /1 9 9/ 3 0 0
1/ 70 /1 3 9/ 2 0 0/ 30 0
11 /8 1 /1 34 / 2 02 /2 88
2 /6 5 /1 40 /2 05 / 30 5
1 /6 9 /1 40 /2 04 / 30 9
1 /7 1 /1 41 /2 03 / 31 1
1/ 71 / 14 1 /2 03 /3 18
1 /1 4 /2 4 /3 4 /4 9
1/ 12 / 2 4/ 3 5/ 80
1/ 1 2 /2 4 /3 5 /8 7
1 /1 3 /2 4 /3 5 /1 1 9
1/ 13 / 2 4/ 35 /1 3 0
2 /2 2 /3 6 /5 4 /8 1
1 /1 4 /2 7 /4 1 /9 3
1 / 1 3/ 25 / 3 7/ 91
1 /1 3 /2 5 /3 6 /1 19
1 /1 3 /2 5 /3 6 /1 33
FR 13 1 .7 3 ± 7 5 .9 5
1 34 .7 0 ± 8 0 .4 8
1 35 .8 6 ± 7 9 .5 1
13 6 .6 2 ± 78 .7 1
13 6 .8 1 ± 78 .9 0
1 36 .1 7 ± 78 .5 0
13 9 .2 5 ± 83 .0 9
14 0 .4 0 ± 82 .1 8
14 1 .2 2 ± 8 1 .3 5
1 41 .4 0 ± 81 .5 5
23 .6 2 ± 13 .4 0
24 .4 4 ± 14 .6 9
2 4 .7 0 ± 1 4 .4 1
2 4 .8 5 ± 1 4 .2 7
2 4 .8 7 ± 14 .3 0
3 6 .6 4 ± 21 .1 8
28 .5 4 ± 17 .3 1
2 5 .7 3 ± 1 4 .9 6
25 .2 8 ± 14 .4 9
25 .3 7 ± 14 .5 7
8/ 7 4 /1 28 / 19 6 /2 8 9
2/ 6 4/ 1 35 /2 0 2 /3 00
1 /6 5 /1 3 7 / 1 9 9/ 30 0
1/ 69 / 13 8 /1 99 / 3 00
1/ 6 9 /1 38 / 2 00 /3 0 0
8 /7 7 /1 32 / 20 3 /2 96
2 /6 5 /1 40 /2 07 / 31 3
1 /6 8 /1 42 /2 06 / 3 15
1/ 7 1/ 1 43 /2 06 /3 22
1 / 7 1/ 1 43 /2 06 /3 25
1 /1 3 /2 3 /3 4 /5 3
1 / 12 / 24 / 36 / 7 8
1 /1 2 /2 5 /3 6 /9 2
1/ 1 3/ 25 / 3 6/ 11 8
1/ 1 3/ 2 5/ 36 / 1 32
2/ 2 1/ 35 / 5 4/ 83
1/ 15 /2 7 /4 2 /9 4
1 /1 3 /2 6 /3 7 /9 7
1 / 13 / 25 / 36 / 11 8
1/ 13 / 26 / 36 / 13 4
R U
1 31 .0 6 ± 7 6 .8 9
1 30 .2 9 ± 7 7 .8 0
13 2 .5 8 ± 77 .8 0
13 3 .5 7 ± 77 .0 9
1 3 3 .7 0 ± 7 7. 19
2 40 .5 9 ± 14 4 .2 5
2 39 .1 5 ± 1 44 .3 5
24 3 .3 2 ± 14 4 .1 4
24 5 .1 3 ± 14 2 .8 9
24 5 .4 0 ± 14 3. 0 8
1 9 .6 0 ± 1 0. 5 8
1 9 .6 4 ± 1 1 .5 8
20 .0 2 ± 11 .6 3
2 0 .1 5 ± 1 1 .5 0
20 .1 5 ± 1 1 .5 1
37 .6 0 ± 2 1 .3 0
2 6 .1 4 ± 15 .9 5
2 1 .8 3 ± 1 2 .7 9
21 .7 0 ± 12 .5 5
21 .7 9 ± 12 .6 3
10 /7 1 /1 2 3 /1 9 5/ 2 71
2/ 62 /1 3 0/ 1 9 3 /2 9 9
1 /6 5 /1 3 3/ 19 5 / 30 0
1/ 6 7/ 1 3 4/ 19 4 /3 0 0
1 /6 7 /1 34 / 19 5 /3 00
1 2 /1 2 5/ 22 9 /3 6 3 /5 05
2 /1 13 /2 38 / 3 52 /5 58
1 /1 17 /2 45 / 35 8 /5 65
1 /1 2 2/ 24 6/ 35 7/ 56 6
1/ 12 2/ 24 7 / 35 8/ 56 9
1 /1 2 /2 0 /2 8 /4 3
1 / 10 / 20 / 29 / 7 2
1 /1 0 /2 0 /2 9 /8 5
1/ 1 1/ 20 / 2 9/ 11 7
1/ 1 1/ 2 0/ 29 / 1 28
2/ 2 1/ 33 / 5 3/ 91
1/ 13 /2 5 /3 8 /8 9
1 /1 1 /2 2 /3 1 /8 7
1 / 11 / 22 / 31 / 12 0
1/ 11 /2 2 /3 1 /1 62
Z H
33 .2 9 ± 1 7 .4 1
33 .7 7 ± 19 .7 7
3 4 .0 7 ± 19 .5 0
3 4 .2 0 ± 1 9 .2 1
34 .2 1 ± 1 9 .2 6
9 1 .2 2 ± 50 .8 8
92 .6 9 ± 55 .2 8
93 .5 2 ± 54 .2 9
94 .0 3 ± 53 .6 7
9 4 .0 6 ± 53 .7 3
18 .6 6 ± 10 .2 8
1 8 .7 0 ± 11 .1 8
1 8 .9 8 ± 11 .0 5
1 9 .0 7 ± 1 0. 88
1 9 .0 7 ± 10 .9 0
2 5 .6 3 ± 1 3 .6 5
2 1 .6 3 ± 1 3. 19
19 .9 0 ± 11 .6 1
19 .4 7 ± 11 .1 3
19 .5 7 ± 11 .2 4
4 /1 9 /3 2 /4 7 /7 6
2 / 18 / 33 / 48 / 14 8
1 /1 8 /3 4 /4 8 /1 5 2
1/ 1 9/ 34 / 48 / 20 1
1 /1 9 /3 4 /4 8 /2 89
8 / 5 3/ 90 / 13 4 /2 0 9
2 /4 5 /9 2 /1 33 / 29 0
1/ 4 8 /9 3 /1 35 /2 83
1 /4 9 /9 4 /1 3 5/ 36 9
1 /4 9 /9 4 /1 35 /6 67
2 / 11 / 18 / 26 / 48
1/ 10 /1 8 /2 7 /6 8
1/ 1 0/ 1 9/ 2 7/ 9 9
1/ 10 /1 9 /2 7 /1 1 6
1 /1 0 /1 9 /2 7 /1 67
2 /1 6 /2 4 /3 4 /6 3
1/ 11 / 2 1/ 3 1 /8 6
1/ 1 0 /2 0 /2 8 /1 0 1
1 /1 1 /1 9 /2 7 /1 16
1 /1 1 /1 9 /2 8 /1 67
Z H
_p in
yi n
1 13 .9 1 ± 6 4 .4 6
1 15 .5 8 ± 6 9. 1 8
11 6 .6 2 ± 68 .1 3
11 7 .3 2 ± 67 .4 1
1 1 7 .3 7 ± 6 7 .5 0
8/ 6 6/ 1 09 /1 7 4 /2 65
2 /5 5 /1 1 5 /1 67 / 3 25
1/ 5 8 /1 1 7/ 1 69 /3 5 7
1 /6 0 /1 18 /1 6 9 / 3 9 4
1/ 6 0/ 1 18 /1 6 9 /6 80
Z H
_w ub
i 10 0 .3 5 ± 5 5. 7 0
10 1 .0 5 ± 60 .1 3
1 0 1 .9 1 ± 5 8 .9 4
1 0 2 .4 3 ± 5 8 .2 1
1 02 .4 6 ± 5 8. 2 5
8/ 59 / 9 9/ 15 0 /2 26
2 /4 8 /1 0 0/ 14 6 / 32 5
1/ 5 2/ 10 2/ 1 47 /3 1 8
1 /5 3 /1 02 / 1 47 /3 8 1
1/ 5 4/ 1 03 /1 4 6 /6 88
A R
_c p1
25 6
9 7 .9 8 ± 5 5 .4 7
10 0 .6 0 ± 59 .6 0
10 1 .9 7 ± 59 .1 0
10 2 .4 9 ± 58 .3 6
1 02 .4 8 ± 5 8 .3 9
9/ 5 3/ 94 / 14 7 /2 34
2/ 49 /1 01 / 1 47 /2 74
1 /5 1 /1 0 1/ 14 7/ 30 0
1 /5 3 /1 03 / 14 7/ 30 0
1 /5 3 /1 02 /1 47 / 3 00
R U
_c p1
25 1
13 1 .0 6 ± 7 6 .8 9
13 0 .2 9 ± 77 .8 0
13 2 .5 8 ± 77 .8 0
13 3 .5 7 ± 77 .0 9
13 3 .7 0 ± 77 .1 9
10 / 7 1/ 12 3 /1 95 /2 71
2 / 62 / 13 0/ 19 3/ 29 9
1 /6 5 /1 33 / 19 5 /3 00
1 /6 7 /1 34 / 1 94 /3 00
1 /6 7 /1 3 4/ 19 5/ 30 0
St at
is tic
s fo
rd at
as et
C
R ep
re se
nt at
io n
C H
A R
B Y
T E
W O
R D
B PE
N um
be ro
fl in
es 1 00
1, 0 0 0
10 ,0 00
10 0, 0 00
1 ,0 00 ,0 0 0
10 0
1 ,0 00
10 ,0 00
10 0, 00 0
1 ,0 0 0, 00 0
10 0
1 ,0 00
1 0, 00 0
1 00 ,0 00
1 ,0 00 ,0 00
10 0
1 ,0 0 0
10 ,0 00
10 0, 00 0
1 ,0 00 ,0 00
N um
be r
of T
Y PE S A R 97
13 6
16 2
2 6 1
4 27
92 12 3
14 4
16 0
17 6
1 ,1 6 5
6, 82 3
2 8, 2 9 6
97 ,3 80
3 1 0, 6 32
86 4
4, 5 30
1 8, 7 3 5
29 ,6 73
29 ,9 54
E N
78 98
12 6
18 6
3 1 0
81 10 3
13 1
15 9
17 8
90 6
4 ,1 73
1 3, 6 5 8
42 ,6 77
1 4 1, 1 63
80 2
3, 4 84
1 0, 8 0 0
26 ,7 66
29 ,2 15
E S
84 10 8
13 3
1 8 6
3 06
85 11 2
13 3
16 0
17 5
97 0
4 ,7 34
1 6, 8 5 0
51 ,2 81
1 5 4, 6 49
80 3
3, 6 86
1 2, 4 7 0
28 ,1 34
29 ,4 70
FR 87
11 3
13 9
1 9 5
3 30
91 11 7
13 4
15 9
17 9
99 1
4 ,6 03
1 5, 5 8 6
45 ,2 35
1 3 2, 4 93
85 3
3, 6 93
1 2, 1 7 0
27 ,7 31
29 ,3 55
R U
9 8
1 41
16 7
21 1
2 8 7
1 00
14 0
15 4
16 6
17 7
1 ,1 65
6, 49 0
2 6, 1 1 2
84 ,1 37
2 5 0, 7 78
1, 0 02
4, 8 58
1 9, 0 2 9
29 ,3 22
29 ,8 14
Z H
78 3
1, 55 0
2, 44 3
3, 47 7
4, 69 8
12 8
15 2
16 2
17 7
18 9
88 2
4, 16 0
1 4, 7 3 0
46 ,6 67
1 3 9, 8 95
1, 0 84
3, 7 16
1 1, 2 1 4
27 ,4 43
29 ,1 10
Z H
_p in
yi n
7 4
1 07
13 9
24 0
4 1 3
Z H
_w ub
i 9 5
1 29
15 4
24 2
4 0 8
A R
_c p1
25 6
97 13 6
16 2
26 1
42 7
R U
_c p1
25 1
98 14 1
16 7
21 1
28 7
N um
be r
of TO
K E
N S
A R
1 0, 21 2
1 04 ,1 44
1 ,0 2 1, 13 6
10 ,2 31 ,0 8 1
10 2 ,4 48 ,3 3 9
1 8 ,4 48
18 8, 50 7
1 ,8 4 5, 13 6
18 ,4 8 2, 68 9
18 5 ,1 05 ,4 9 8
1 ,8 8 9
1 9, 28 1
1 90 ,7 38
1 ,9 12 ,6 6 9
1 9 ,1 3 7, 2 40
3 ,5 18
2 5, 60 1
2 10 ,7 3 8
2 ,0 87 ,4 31
20 ,9 81 ,7 60
E N
12 ,3 00
1 2 3, 6 4 6
1 ,2 0 8, 8 27
1 2 ,0 8 9, 4 49
1 20 ,9 3 3, 96 2
12 ,3 05
12 3, 68 1
1 ,2 09 ,1 87
12 ,0 93 ,1 17
12 0 ,9 71 ,4 60
2 ,1 16
21 ,5 45
2 1 2, 0 3 4
2 ,1 2 3, 1 53
2 1 ,2 31 ,4 6 5
3 ,3 6 9
25 ,1 11
22 1, 26 4
2 ,1 60 ,1 62
21 ,6 66 ,4 82
E S
1 4, 1 25
13 9, 56 3
1 ,3 6 9 ,7 7 9
1 3 ,7 0 1 ,3 8 7
1 3 7 ,1 3 3 ,4 40
14 ,3 87
1 42 ,2 37
1 ,3 95 ,3 0 5
13 ,9 58 ,2 21
13 9 ,7 0 2, 85 3
2 ,4 72
24 ,6 00
24 2, 67 2
2 ,4 3 0 ,5 8 6
24 ,3 1 9, 76 0
3 ,7 84
2 8, 7 2 6
2 54 ,0 92
2 ,4 83 ,9 95
24 ,9 25 ,2 09
FR 1 3, 79 7
1 38 ,5 28
1 ,3 6 5, 36 0
13 ,6 61 ,1 5 0
13 6 ,7 54 ,3 6 0
1 4 ,2 4 3
14 3, 1 39
1 ,4 11 ,4 51
14 ,1 19 ,8 15
14 1 ,3 43 ,6 7 5
2 ,4 53
24 ,9 5 0
2 48 ,4 88
2 ,4 85 ,1 18
2 4 ,8 6 4, 4 49
3 ,7 5 5
2 8, 90 7
2 5 8, 55 0
2 ,5 27 ,9 57
25 ,3 62 ,7 24
R U
1 3, 76 3
1 36 ,6 7 4
1 ,3 3 9, 2 86
1 3 ,3 6 9, 69 0
1 33 ,6 7 1, 32 2
25 ,3 45
25 1, 23 1
2 ,4 5 7, 9 38
24 ,5 35 ,7 71
24 5 ,3 38 ,1 39
2 ,0 24
2 0, 47 4
20 1, 6 1 8
2 ,0 1 6, 4 5 1
2 0 ,1 56 ,4 6 7
3 ,8 1 3
26 ,7 72
21 9, 79 4
2 ,1 72 ,6 16
21 ,7 87 ,5 39
Z H
3 ,3 71
3 4, 42 9
3 41 ,5 36
3 ,4 19 ,6 4 8
34 ,2 00 ,5 4 3
9 ,2 35
95 ,1 00
93 8, 8 05
9 ,4 04 ,3 86
94 ,0 52 ,8 81
1 ,8 24
19 ,1 20
19 0, 48 5
1 ,9 07 ,6 4 3
19 ,0 7 3, 4 63
2 ,5 59
2 2, 06 7
1 9 9, 7 06
1 ,9 47 ,3 00
19 ,5 73 ,3 72
Z H
_p in
yi n
11 ,6 0 5
11 9, 2 58
1 ,1 71 ,6 0 5
1 1 ,7 32 ,0 10
1 1 7 ,3 5 6 ,8 8 0
Z H
_w ub
i 10 ,0 7 1
10 3, 9 44
1 ,0 22 ,8 7 0
1 0 ,2 45 ,7 16
1 0 2 ,4 5 0 ,5 8 1
A R
_c p1
25 6
10 ,2 12
1 04 ,1 44
1 ,0 21 ,1 36
10 ,2 31 ,0 81
1 02 ,4 48 ,3 39
R U
_c p1
25 1
13 ,7 63
13 6, 67 4
1 ,3 39 ,2 86
13 ,3 69 ,6 9 0
13 3 ,6 71 ,3 22
O O
V ty
pe ra
te (% ) A R 28 .4 6
5 .3 8
0 .0 0
0 .0 0
0 .0 0
26 .0 2
4 .8 8
0 .0 0
0 .0 0
0 .0 0
93 .7 2
7 1 .1 3
3 5 .7 0
1 3 .4 4
5 .0 2
6 .0 6
0 .3 4
0 .0 0
0 .0 0
0 .0 0
E N
21 .6 5
1 2 .3 7
8 .2 5
2 .0 6
0 .0 0
22 .5 5
11 .7 6
4 .9 0
0 .9 8
0 .0 0
89 .4 7
60 .5 6
26 .2 7
10 .4 3
4 .3 2
3 .5 2
0 .4 9
0 .1 8
0 .0 4
0 .0 0
E S
2 5 .2 3
1 4 .4 1
1 0 .8 1
5 .4 1
0 .9 0
2 3 .6 4
1 0 .9 1
6 .3 6
0 .9 1
0 .0 0
90 .7 1
63 .9 6
2 7 .1 8
9 .7 1
3 .8 8
4 .4 4
0 .5 3
0 .1 9
0 .0 8
0 .0 0
FR 23 .0 1
9 .7 3
7 .0 8
1 .7 7
0 .0 0
22 .8 8
9 .3 2
5 .0 8
0 .8 5
0 .0 0
89 .9 2
62 .2 7
2 5 .9 6
8 .8 9
3 .4 8
3 .9 6
0 .4 9
0 .1 5
0 .0 2
0 .0 0
R U
3 3 .5 6
7 .5 3
2 .0 5
0 .0 0
0 .0 0
3 1 .2 5
5 .5 6
1 .3 9
0 .0 0
0 .0 0
9 3 .1 1
69 .6 6
32 .1 5
1 0 .9 1
3 .8 1
4 .8 2
0 .2 9
0 .0 2
0 .0 1
0 .0 0
Z H
6 1 .2 3
26 .8 7
6 .7 3
1 .4 2
0 .3 5
1 6 .9 9
3 .9 2
0 .6 5
0 .0 0
0 .0 0
90 .3 4
6 3 .4 8
29 .8 9
10 .3 1
4 .0 9
6 7 .9 8
2 6 .2 2
5 .0 3
0 .5 5
0 .1 0
Z H
_p in
yi n
27 .5 5
8 .1 6
1 .0 2
0 .0 0
0 .0 0
Z H
_w ub
i 2 3 .3 3
4 .1 7
0 .8 3
0 .0 0
0 .0 0
A R
_c p1
25 6
28 .4 6
5 .3 8
0 .0 0
0 .0 0
0 .0 0
R U
_c p1
25 1
33 .5 6
7 .5 3
2 .0 5
0 .0 0
0 .0 0
O O
V to
ke n
ra te
(% )
A R
0. 1 3
0 .0 1
0 .0 0
0 .0 0
0 .0 0
0 .0 5
0 .0 0
0 .0 0
0 .0 0
0 .0 0
53 .4 0
2 5 .2 4
9 .3 1
3 .2 5
1 .1 8
0 .7 3
0 .1 2
0 .0 0
0 .0 0
0 .0 0
E N
0. 03
0 .0 0
0 .0 0
0 .0 0
0 .0 0
0 .0 3
0 .0 0
0 .0 0
0 .0 0
0 .0 0
34 .2 6
11 .6 3
3 .4 1
1 .2 6
0 .5 1
0 .2 0
0 .0 3
0 .0 2
0 .0 0
0 .0 0
E S
0. 0 4
0 .0 1
0 .0 1
0 .0 0
0 .0 0
0 .0 5
0 .0 1
0 .0 1
0 .0 0
0 .0 0
32 .1 7
12 .0 5
3 .5 6
1 .1 6
0 .4 6
0 .2 9
0 .0 9
0 .0 4
0 .0 2
0 .0 0
FR 0. 14
0 .0 0
0 .0 0
0 .0 0
0 .0 0
0 .1 2
0 .0 0
0 .0 0
0 .0 0
0 .0 0
31 .3 9
11 .6 6
3 .3 0
1 .0 3
0 .4 1
0 .5 1
0 .0 4
0 .0 2
0 .0 0
0 .0 0
R U
0. 15
0 .0 0
0 .0 0
0 .0 0
0 .0 0
0 .0 8
0 .0 0
0 .0 0
0 .0 0
0 .0 0
4 9 .4 8
22 .4 4
7 .5 3
2 .3 3
0 .7 9
0 .3 8
0 .0 4
0 .0 0
0 .0 0
0 .0 0
Z H
11 .1 5
1 .2 5
0 .1 8
0 .0 4
0 .0 1
0 .1 0
0 .0 0
0 .0 0
0 .0 0
0 .0 0
38 .6 5
13 .9 6
4 .5 2
1 .4 2
0 .5 6
22 .0 1
4 .7 5
0 .8 1
0 .0 9
0 .0 1
Z H
_p in
yi n
0. 0 7
0 .0 0
0 .0 0
0 .0 0
0 .0 0
Z H
_w ub
i 0 .0 9
0 .0 0
0 .0 0
0 .0 0
0 .0 0
A R
_c p1
25 6
0. 13
0 .0 1
0 .0 0
0 .0 0
0 .0 0
R U
_c p1
25 1
0. 15
0 .0 0
0 .0 0
0 .0 0
0 .0 0
T T
R (% ) A
R 0. 9 5
0 .1 3
0 .0 2
0 .0 0
0 .0 0
0 .5 0
0 .0 7
0 .0 1
0 .0 0
0 .0 0
61 .6 7
3 5 .3 9
1 4 .8 4
5 .0 9
1 .6 2
24 .5 6
1 7 .6 9
8 .8 9
1 .4 2
0 .1 4
E N
0. 63
0 .0 8
0 .0 1
0 .0 0
0 .0 0
0 .6 6
0 .0 8
0 .0 1
0 .0 0
0 .0 0
42 .8 2
19 .3 7
6 .4 4
2 .0 1
0 .6 6
2 3 .8 1
1 3 .8 7
4 .8 8
1 .2 4
0 .1 3
E S
0. 5 9
0 .0 8
0 .0 1
0 .0 0
0 .0 0
0 .5 9
0 .0 8
0 .0 1
0 .0 0
0 .0 0
39 .2 4
19 .2 4
6 .9 4
2 .1 1
0 .6 4
21 .2 2
12 .8 3
4 .9 1
1 .1 3
0 .1 2
FR 0. 63
0 .0 8
0 .0 1
0 .0 0
0 .0 0
0 .6 4
0 .0 8
0 .0 1
0 .0 0
0 .0 0
40 .4 0
18 .4 5
6 .2 7
1 .8 2
0 .5 3
2 2 .7 2
1 2 .7 8
4 .7 1
1 .1 0
0 .1 2
R U
0. 71
0 .1 0
0 .0 1
0 .0 0
0 .0 0
0 .3 9
0 .0 6
0 .0 1
0 .0 0
0 .0 0
5 7 .5 6
31 .7 0
12 .9 5
4 .1 7
1 .2 4
2 6 .2 8
1 8 .1 5
8 .6 6
1 .3 5
0 .1 4
Z H
23 .2 3
4 .5 0
0 .7 2
0 .1 0
0 .0 1
1 .3 9
0 .1 6
0 .0 2
0 .0 0
0 .0 0
48 .3 6
21 .7 6
7 .7 3
2 .4 5
0 .7 3
42 .3 6
16 .8 4
5 .6 2
1 .4 1
0 .1 5
Z H
_p in
yi n
0 .6 4
0 .0 9
0 .0 1
0 .0 0
0 .0 0
Z H
_w ub
i 0 .9 4
0 .1 2
0 .0 2
0 .0 0
0 .0 0
A R
_c p1
25 6
0. 95
0 .1 3
0 .0 2
0 .0 0
0 .0 0
R U
_c p1
25 1
0. 71
0 .1 0
0 .0 1
0 .0 0
0 .0 0
M ea
n lin
e le
ng th ±
st d
0/ 25
/5 0/
75 /1
00 -t
h
A R
10 2 .1 2 ± 57 .4 0
1 0 4 .1 4 ± 5 7 .8 3
10 2 .1 1 ± 58 .0 6
10 2 .3 1 ± 58 .3 3
1 0 2 .4 5 ± 58 .4 6
1 8 4 .4 8 ± 10 5. 32
18 8 .5 1 ± 10 5. 63
18 4 .5 1 ± 10 5. 7 8
18 4 .8 3 ± 10 6. 15
1 85 .1 1 ± 10 6 .4 0
18 .8 9 ± 10 .2 7
19 .2 8 ± 10 .5 9
19 .0 7 ± 10 .7 2
1 9 .1 3 ± 1 0. 82
19 .1 4 ± 10 .8 4
3 5 .1 8 ± 1 8 .9 2
2 5 .6 0 ± 1 4. 4 2
2 1 .0 7 ± 12 .0 1
20 .8 7 ± 12 .0 0
20 .9 8 ± 12 .1 0
5/ 5 7/ 9 6/ 15 2 /2 1 3
4 /5 4 /1 0 6 / 14 9 /2 64
3/ 53 / 10 2 /1 4 7/ 29 3
1 /5 3 /1 0 2/ 1 4 7 /2 9 8
1 /5 3 /1 0 2 /1 4 7 / 3 0 0
9/ 1 01 / 17 3 /2 80 /3 8 3
6 / 9 8/ 1 91 /2 70 /4 87
3 /9 4 /1 84 / 26 6 /5 33
1 /9 5 /1 84 / 2 66 /5 51
1 /9 5 /1 8 5/ 26 6 /5 59
2/ 11 / 18 / 27 / 4 3
1 /1 0 /2 0 /2 7 /5 0
1 / 10 / 1 9/ 27 / 8 2
1 /1 0 /1 9 /2 7 /1 20
1 /1 0 /1 9 /2 7 /1 43
4 /1 8 /3 4 /5 0 /7 3
1/ 1 4/ 26 / 3 6/ 79
1/ 11 /2 1 /3 0 /8 6
1 /1 1 /2 1 /2 9 /1 23
1/ 11 / 21 / 29 /1 47
E N
12 3 .0 0 ± 72 .3 0
1 2 3 .6 5 ± 7 1. 1 2
12 0 .8 8 ± 69 .6 2
12 0 .8 9 ± 69 .5 8
1 2 0 .9 3 ± 6 9 .6 0
12 3 .0 5 ± 72 .3 5
12 3 .6 8 ± 71 .1 5
12 0 .9 2 ± 69 .6 4
12 0 .9 3 ± 69 .6 0
12 0 .9 7 ± 69 .6 2
21 .1 6 ± 1 2 .2 4
2 1 .5 5 ± 12 .3 1
2 1 .2 0 ± 1 2 .1 5
21 .2 3 ± 12 .1 7
2 1 .2 3 ± 1 2 .1 7
3 3 .6 9 ± 19 .3 2
25 .1 1 ± 1 4 .3 2
2 2 .1 3 ± 1 2 .6 7
21 .6 0 ± 12 .3 6
21 .6 7 ± 12 .4 2
9/ 6 3/ 1 16 /1 87 /2 6 8
3 /6 0 /1 28 /1 7 8 / 3 0 0
1/ 6 1/ 1 22 /1 7 5 /3 00
1 /6 2 /1 22 /1 75 / 3 00
1/ 61 / 12 2 /1 7 5/ 30 0
9 / 63 / 1 16 /1 87 /2 68
3 /6 0 /1 2 8/ 17 8/ 30 0
1 /6 1 /1 22 / 1 75 /3 00
1 /6 2 /1 2 2/ 17 5/ 30 0
1 /6 1 /1 22 /1 75 / 30 4
2/ 10 /2 1 /3 1 /4 8
1 /1 1 /2 2 /3 1 /5 5
1 /1 1 /2 1 /3 0 /8 3
1 /1 1 /2 1 /3 0 /1 18
1 /1 1 /2 1 /3 0 /1 36
3 /1 5 /3 3 /4 9 /7 8
1/ 1 3/ 26 / 3 6/ 86
1/ 12 /2 2 /3 2 /8 8
1/ 12 / 22 / 31 / 12 0
1/ 12 / 22 / 31 / 13 8
E S
1 41 .2 5 ± 8 2 .8 3
13 9 .5 6 ± 79 .5 9
13 6 .9 8 ± 78 .3 5
13 7 .0 1 ± 78 .4 5
1 3 7 .1 3 ± 7 8 .4 7
1 43 .8 7 ± 84 .3 7
14 2 .2 4 ± 81 .0 5
1 39 .5 3 ± 7 9. 72
13 9 .5 8 ± 7 9 .8 4
1 39 .7 0 ± 79 .8 7
24 .7 2 ± 14 .3 9
24 .6 0 ± 13 .9 1
24 .2 7 ± 1 3 .8 0
2 4 .3 1 ± 1 3 .8 7
2 4 .3 2 ± 1 3 .8 7
37 .8 4 ± 2 1. 74
2 8 .7 3 ± 1 6 .2 7
2 5 .4 1 ± 14 .4 6
24 .8 4 ± 14 .1 7
24 .9 3 ± 14 .2 2
11 /5 9 /1 3 4 /2 1 5/ 2 92
3/ 67 / 1 45 /2 0 1 /3 00
1 /7 0 /1 3 8 / 2 0 0/ 30 0
1/ 70 / 13 8 /1 99 / 30 0
1/ 7 0 /1 39 / 1 99 /3 0 0
1 1 /6 0 /1 36 /2 1 8/ 29 8
3 /6 9 /1 49 /2 0 6/ 30 6
1 /7 1 /1 40 /2 04 / 30 8
1/ 7 1/ 14 1/ 20 3/ 31 2
1 / 7 1/ 1 41 /2 03 /3 16
2 /1 2 /2 4 /3 7 /5 6
1 / 12 / 25 / 36 / 60
1/ 13 /2 4 /3 5 /8 4
1 / 13 / 2 4/ 35 / 1 19
1/ 1 3/ 24 / 3 5/ 13 9
4/ 17 / 3 5/ 56 / 8 6
1 /1 4 /3 0 /4 1 /9 0
1 / 1 3/ 25 / 3 6 /9 0
1/ 13 /2 5 /3 6 /1 21
1 /1 3 /2 5 /3 6 /1 40
FR 13 7 .9 7 ± 80 .1 2
13 8 .5 3 ± 79 .4 9
13 6 .5 4 ± 78 .8 0
13 6 .6 1 ± 7 8 .9 2
1 36 .7 5 ± 7 8. 96
1 42 .4 3 ± 8 2 .9 7
14 3 .1 4 ± 82 .1 8
14 1 .1 5 ± 81 .4 7
14 1 .2 0 ± 81 .5 6
14 1 .3 4 ± 81 .6 1
24 .5 3 ± 13 .7 9
24 .9 5 ± 14 .1 9
2 4 .8 5 ± 1 4. 28
2 4 .8 5 ± 14 .3 1
2 4 .8 6 ± 1 4. 31
37 .5 5 ± 20 .9 7
28 .9 1 ± 16 .4 1
25 .8 6 ± 1 4 .8 5
25 .2 8 ± 14 .5 3
25 .3 6 ± 14 .5 8
6 /6 2 /1 33 / 21 5 /2 9 3
3 /6 8 /1 4 1/ 2 0 3 /3 0 0
1 /6 8 /1 3 7/ 20 0 / 30 0
1/ 6 9/ 1 3 8/ 19 9 /3 0 0
1 /6 9 /1 38 /1 9 9/ 3 00
6 /6 4 /1 37 /2 19 / 30 3
3/ 70 / 14 5 /2 09 /3 15
1 / 71 / 14 2/ 20 6/ 31 9
1 /7 1 /1 4 2/ 20 6/ 32 3
1 /7 1 /1 43 / 20 6/ 33 0
2/ 13 / 24 / 37 / 50
1/ 1 2 /2 6 /3 6 /6 2
1/ 1 3 /2 5 /3 6 /8 4
1/ 13 /2 5 /3 6 /1 1 8
1 /1 3 /2 5 /3 6 /1 38
3 /2 0 /3 7 /5 6 /8 0
1 /1 4 /3 0 /4 2 /8 6
1 /1 3 /2 6 /3 7 /8 8
1 /1 3 /2 5 /3 6 /1 20
1 /1 3 /2 6 /3 6 /1 38
R U
13 7 .6 3 ± 8 0. 8 0
13 6 .6 7 ± 78 .7 7
1 3 3 .9 3 ± 7 7 .2 5
1 33 .7 0 ± 7 7 .2 6
13 3 .6 7 ± 77 .2 5
25 3 .4 5 ± 15 0 .9 0
2 51 .2 3 ± 14 6. 2 1
24 5 .7 9 ± 1 43 .3 1
2 45 .3 6 ± 14 3 .1 8
24 5 .3 4 ± 1 43 .1 7
20 .2 4 ± 11 .2 7
20 .4 7 ± 11 .6 1
20 .1 6 ± 1 1 .4 4
2 0 .1 6 ± 1 1. 53
20 .1 6 ± 1 1 .5 3
3 8 .1 3 ± 2 1 .1 0
2 6 .7 7 ± 15 .2 6
21 .9 8 ± 1 2 .6 1
21 .7 3 ± 12 .5 9
21 .7 9 ± 12 .6 4
11 /7 1 /1 3 0 / 21 2 /2 96
3 /6 3 /1 3 9 /2 0 0 / 3 00
1/ 67 / 13 5 /1 9 6/ 30 0
1 /6 7 /1 3 4/ 19 5 / 30 0
1/ 6 7/ 1 3 4/ 1 95 /3 0 0
21 / 1 2 6/ 24 2 /3 92 / 55 0
4/ 11 8 /2 58 /3 66 / 56 1
1/ 12 1/ 2 47 /3 60 / 5 62
1/ 12 2/ 24 7/ 35 8/ 56 6
1 /1 22 / 2 47 /3 58 /5 69
2 /1 1 /2 0 /2 9 /4 7
1 /1 0 /2 1 /2 9 /5 5
1 /1 1 /2 0 /2 9 /8 3
1 /1 1 /2 0 /2 9 /1 17
1 /1 1 /2 0 /2 9 /1 36
3 /1 8 /3 8 /5 6 /8 1
1/ 14 / 2 7/ 39 / 7 8
1 /1 2 /2 2 /3 1 /8 7
1/ 11 / 22 / 31 / 12 1
1/ 11 / 22 / 31 / 13 8
Z H
3 3 .7 1 ± 1 8. 0 3
34 .4 3 ± 19 .4 0
3 4 .1 5 ± 19 .0 6
3 4 .2 0 ± 1 9 .2 7
34 .2 0 ± 1 9 .2 8
92 .3 5 ± 52 .4 2
95 .1 0 ± 54 .2 9
93 .8 8 ± 53 .4 2
94 .0 4 ± 5 3. 75
94 .0 5 ± 53 .7 9
18 .2 4 ± 9. 97
19 .1 2 ± 10 .8 7
19 .0 5 ± 1 0 .8 6
1 9 .0 8 ± 1 0 .9 1
1 9 .0 7 ± 1 0 .9 2
25 .5 9 ± 1 3. 84
2 2 .0 7 ± 12 .6 8
19 .9 7 ± 11 .4 3
19 .4 7 ± 11 .1 7
19 .5 7 ± 11 .2 6
4/ 19 / 33 / 48 / 7 0
2/ 18 /3 5 /4 9 /1 2 7
1 / 19 / 34 / 48 / 1 33
1/ 19 /3 4 /4 8 /2 2 0
1 / 19 / 34 / 48 /2 7 2
1 2 /4 7 /9 3 /1 3 2/ 1 98
3/ 50 /9 6 /1 38 /2 48
3/ 4 9/ 94 / 13 5/ 29 1
1 / 49 / 94 / 13 5 /3 78
1/ 48 / 94 / 13 5/ 59 4
2 /1 0 /1 7 /2 6 /3 9
1 /1 0 /2 0 /2 7 /5 5
1/ 1 0 /1 9 /2 7 /8 7
1 /1 0 /1 9 /2 7 /1 1 3
1 /1 0 /1 9 /2 7 /2 4 8
2 /1 4 /2 6 /3 7 /5 2
1/ 12 / 2 2/ 31 / 9 0
1 /1 1 /2 0 /2 8 /9 2
1/ 11 / 19 / 27 / 11 5
1/ 11 / 19 / 28 / 24 9
Z H
_p in
yi n
1 16 .0 5 ± 6 7 .5 4
11 9 .2 6 ± 68 .5 4
11 7 .1 6 ± 67 .2 5
1 1 7 .3 2 ± 6 7. 49
1 1 7 .3 6 ± 6 7 .5 5
1 1 /5 8 /1 17 /1 67 / 26 3
3/ 61 / 12 2 /1 73 /3 2 0
3 /6 1 /1 1 7/ 1 69 /3 3 5
1/ 6 0/ 1 1 8/ 16 9 /3 76
1 /6 0 /1 18 / 16 9 /5 84
Z H
_w ub
i 10 0 .7 1 ± 57 .0 5
10 3 .9 4 ± 59 .4 8
10 2 .2 9 ± 5 7 .9 2
1 02 .4 6 ± 5 8. 29
1 02 .4 5 ± 5 8 .3 1
13 /5 4 /1 0 1/ 1 39 /2 1 7
3/ 5 4 /1 0 5/ 15 0 / 29 6
3/ 5 4 /1 02 / 14 7 /2 97
1 /5 3 /1 02 /1 46 / 3 98
1/ 53 / 10 3 /1 4 6/ 62 7
A R
_c p1
25 6
1 02 .1 2 ± 57 .4 0
10 4 .1 4 ± 57 .8 3
10 2 .1 1 ± 58 .0 6
10 2 .3 1 ± 58 .3 3
1 02 .4 5 ± 5 8. 4 6
5/ 57 /9 6 /1 52 / 21 3
4/ 54 /1 06 / 14 9 /2 64
3 /5 3 /1 0 2/ 14 7/ 29 3
1 /5 3 /1 02 /1 47 / 29 8
1 /5 3 /1 02 /1 47 / 3 00
R U
_c p1
25 1
13 7 .6 3 ± 8 0. 8 0
13 6 .6 7 ± 78 .7 7
13 3 .9 3 ± 77 .2 5
13 3 .7 0 ± 77 .2 6
13 3 .6 7 ± 77 .2 5
11 / 7 1/ 13 0 /2 12 /2 96
3 /6 3 /1 3 9/ 20 0 /3 00
1 /6 7 /1 35 / 19 6/ 30 0
1 /6 7 /1 34 / 19 5 /3 00
1 /6 7 /1 34 /1 95 / 3 00
St at
is tic
s fo
rd ev
el op
m en
t( de
v) se
t
A s
a di
ff er
en ts
et of
vo ca
bu la
ry is
le ar
ne d
fr om
ea ch
tr ai
ni ng
da ta
se ta
nd da
ta si
ze ,B
PE ha
s a
di st
in ct
de v
se tf
or ea
ch .
R ep
re se
nt at
io n
C H
A R
B Y
T E
W O
R D
B PE
_A B
PE _B
B PE _C N um be ro fl in es in tr ai n se t 1 00 1, 0 0 0 10 ,0 0 0 1 00 ,0 00 1 ,0 0 0, 00 0 10 0 1 ,0 00 10 ,0 00 10 0, 00 0 1 ,0 0 0 ,0 0 0 10 0 1 ,0 00 10 ,0 00
10 0, 00 0
1 ,0 00 ,0 0 0
N um
be r
of T
Y PE S A R 13 0
12 3
1 3, 83 6
7 0 8
3, 23 2
8, 9 94
11 ,4 7 3
12 ,4 30
8 6 5
3, 9 9 1
1 0, 7 3 5
12 ,9 54
1 3, 0 90
9 0 8
4, 1 1 9
1 0, 6 8 1
12 ,9 34
1 3, 09 3
E N
9 7
1 0 2
7, 19 9
6 5 6
2, 5 6 7
5, 9 9 8
7, 4 61
7, 5 56
8 01
3, 1 49
6, 5 1 8
7, 5 57
7, 5 7 8
82 3
3, 24 5
6, 5 51
7, 52 4
7, 5 73
E S
1 11
11 0
8, 55 1
6 8 0
2, 8 32
6, 9 1 9
8, 75 2
8, 8 7 1
8 3 3
3, 4 2 6
7, 52 8
8, 8 6 9
8, 9 5 6
8 3 4
3, 4 2 4
7, 52 7
8, 8 7 1
8, 93 9
FR 1 1 3
1 1 8
8, 31 2
7 4 4
2, 8 21
6, 9 2 5
8, 5 26
8, 66 6
82 7
3, 40 7
7, 4 89
8, 66 5
8, 7 0 5
88 3
3, 46 3
7, 4 31
8, 67 9
8, 7 08
R U
1 46
14 4
1 2, 81 9
8 78
3, 7 6 9
10 ,0 8 5
1 2, 5 05
1 2, 7 88
1, 02 4
4, 4 38
11 ,0 5 2
12 ,8 83
1 2, 9 5 4
1, 03 8
4, 5 09
11 ,0 12
1 2, 8 82
1 2, 9 5 8
Z H
1 ,9 7 6
15 3
7, 4 13
3, 22 4
4, 2 15
6, 3 8 6
7, 5 41
7, 65 4
3, 2 6 1
4, 48 1
6, 7 35
7, 71 9
7, 7 0 2
3, 2 6 0
4, 52 4
6, 7 85
7, 65 4
7, 7 21
Z H
_p in
yi n 98 Z H _w ub i 1 20
A R
_c p1
25 6
13 0
R U
_c p1
25 1
14 6
N um
be r
of TO
K E
N S
A R
3 34 ,3 5 8
60 5, 5 1 6
61 ,3 71
1 67 ,5 74
1 15 ,6 9 3
83 ,0 01
76 ,2 8 4
7 0, 5 2 7
1 4 9, 6 89
9 7, 8 4 3
73 ,3 1 4
6 8, 5 3 8
68 ,2 7 0
1 4 9, 62 3
9 7, 2 3 1
7 3, 54 1
6 8, 5 7 9
68 ,2 78
E N
39 1 ,2 2 2
39 1, 2 60
67 ,6 2 9
1 5 5, 82 6
1 0 1, 7 82
7 7, 0 8 9
71 ,2 76
7 0, 3 3 9
1 4 0, 2 56
9 0, 8 7 1
73 ,5 3 1
6 9, 6 3 3
69 ,3 4 8
1 4 0, 3 77
9 0, 3 6 0
73 ,4 6 8
6 9, 6 3 3
69 ,3 41
E S
4 4 3, 9 58
4 5 2, 19 0
7 8, 0 8 7
1 70 ,4 33
1 13 ,9 8 3
88 ,6 34
8 2, 28 1
81 ,3 41
1 55 ,6 8 7
1 03 ,7 48
8 4, 91 4
80 ,5 69
8 0, 3 37
1 54 ,7 4 6
1 03 ,1 72
8 4, 8 7 0
80 ,5 79
8 0, 37 1
FR 4 3 8, 0 83
4 5 2, 55 6
7 8, 7 4 5
1 66 ,2 80
1 14 ,6 9 4
88 ,7 26
8 2, 44 8
81 ,5 59
1 56 ,2 5 6
1 04 ,0 71
8 5, 11 5
80 ,8 44
80 ,6 71
1 53 ,7 4 5
1 04 ,0 91
8 5, 12 5
80 ,9 12
8 0, 65 4
R U
4 31 ,5 3 8
7 93 ,2 1 4
6 4, 1 80
17 7, 8 18
11 3, 6 2 8
79 ,7 6 3
7 2, 4 8 0
7 1, 08 1
16 3, 3 1 9
10 0, 29 4
7 5, 0 51
7 0, 20 0
6 9, 9 9 1
16 3, 8 0 6
9 9, 97 8
7 5, 0 96
7 0, 19 6
6 9, 9 8 2
Z H
1 07 ,9 90
3 01 ,0 8 5
6 0, 0 13
9 6, 74 5
80 ,2 31
6 8, 12 9
6 3, 6 1 4
6 2, 81 0
93 ,7 7 5
7 5, 63 6
6 5, 2 12
6 1, 86 7
6 1, 83 2
94 ,1 2 7
7 5, 71 8
6 5, 2 03
6 1, 91 6
6 1, 8 2 3
Z H
_p in
yi n
37 6 ,9 7 9
Z H
_w ub
i 33 0 ,7 3 4
A R
_c p1
25 6
3 3 4, 3 58
R U
_c p1
25 1
43 1 ,5 38
T T
R (% ) A
R 0. 04
0 .0 2
22 .5 4
0 .4 2
2 .7 9
10 .8 4
1 5 .0 4
17 .6 2
0 .5 8
4 .0 8
1 4 .6 4
1 8 .9 0
1 9 .1 7
0 .6 1
4 .2 4
1 4 .5 2
1 8 .8 6
19 .1 8
E N
0. 02
0 .0 3
10 .6 4
0 .4 2
2 .5 2
7 .7 8
1 0 .4 7
1 0 .7 4
0 .5 7
3 .4 7
8 .8 6
1 0 .8 5
1 0 .9 3
0 .5 9
3 .5 9
8 .9 2
10 .8 1
1 0 .9 2
E S
0. 0 3
0 .0 2
10 .9 5
0 .4 0
2 .4 8
7 .8 1
10 .6 4
1 0 .9 1
0 .5 4
3 .3 0
8 .8 7
1 1 .0 1
11 .1 5
0 .5 4
3 .3 2
8 .8 7
1 1 .0 1
1 1 .1 2
FR 0. 0 3
0 .0 3
10 .5 6
0 .4 5
2 .4 6
7 .8 0
1 0 .3 4
10 .6 3
0 .5 3
3 .2 7
8 .8 0
10 .7 2
1 0 .7 9
0 .5 7
3 .3 3
8 .7 3
1 0 .7 3
10 .8 0
R U
0. 0 3
0 .0 2
1 9 .9 7
0 .4 9
3 .3 2
1 2 .6 4
1 7 .2 5
1 7 .9 9
0 .6 3
4 .4 2
14 .7 3
18 .3 5
1 8 .5 1
0 .6 3
4 .5 1
14 .6 6
1 8 .3 5
18 .5 2
Z H
1. 83
0 .0 5
1 2 .3 5
3 .3 3
5 .2 5
9 .3 7
1 1 .8 5
1 2 .1 9
3 .4 8
5 .9 2
1 0 .3 3
12 .4 8
1 2 .4 6
3 .4 6
5 .9 7
1 0 .4 1
12 .3 6
1 2 .4 9
Z H
_p in
yi n
0. 03
Z H
_w ub
i 0. 0 4
A R
_c p1
25 6
0. 0 4
R U
_c p1
25 1
0. 0 3
M ea
n lin
e le
ng th ±
st d
0/ 25
/5 0/
75 /1
00 -t
h
A R
1 08 .6 6 ± 5 8 .0 1
19 6 .7 9 ± 1 05 .8 5
19 .9 5 ± 1 0 .5 8
54 .4 6 ± 2 9 .5 1
37 .6 0 ± 20 .5 1
26 .9 7 ± 1 4 .8 0
2 4 .7 9 ± 1 3 .5 9
22 .9 2 ± 12 .5 6
4 8 .6 5 ± 26 .3 5
3 1 .8 0 ± 17 .7 6
2 3 .8 3 ± 1 3 .1 5
22 .2 7 ± 12 .1 2
22 .1 9 ± 1 2 .0 7
4 8 .6 3 ± 26 .2 1
3 1 .6 0 ± 1 7 .5 3
23 .9 0 ± 1 3 .2 0
2 2 .2 9 ± 1 2 .1 4
2 2 .1 9 ± 12 .0 6
3/ 6 0 /1 1 0/ 1 5 3/ 27 7
6 /1 07 /1 99 / 27 7 /5 0 3
1 /1 2 /2 0 /2 7 /5 8
1/ 30 / 5 4/ 7 6/ 1 52
1/ 22 / 37 / 5 2/ 1 2 5
1 /1 6 /2 7 /3 7 /9 5
1 /1 4 /2 4 /3 4 /8 6
1 /1 4 /2 2 /3 2 /7 5
1 /2 7 /4 9 /6 8 /1 5 6
1 /1 8 /3 2 /4 4 /1 10
1/ 14 / 2 4/ 3 3/ 8 0
1/ 1 3/ 22 / 3 1/ 71
1/ 1 3 /2 2 /3 1 /7 1
1 /2 8 /4 9 /6 7 /1 45
1 /1 8 /3 1 /4 4 /1 10
1/ 14 / 2 4/ 33 / 8 7
1/ 1 3/ 22 / 3 1/ 73
1/ 1 3 /2 2 /3 1 /7 2
E N
1 2 7. 1 4 ± 6 8 .6 4
1 27 .1 6 ± 6 8 .6 5
2 1 .9 8 ± 11 .8 1
50 .6 4 ± 27 .4 4
33 .0 8 ± 1 8 .0 7
25 .0 5 ± 1 3 .5 6
2 3 .1 6 ± 1 2. 4 2
2 2 .8 6 ± 1 2 .2 7
4 5 .5 8 ± 24 .8 6
2 9 .5 3 ± 1 6 .3 0
23 .9 0 ± 1 2 .9 5
2 2 .6 3 ± 1 2 .1 3
22 .5 4 ± 1 2. 0 6
4 5 .6 2 ± 24 .6 7
2 9 .3 7 ± 1 6 .1 3
23 .8 8 ± 1 2 .9 1
2 2 .6 3 ± 1 2 .1 2
22 .5 4 ± 12 .0 5
6/ 6 8 /1 3 0/ 1 8 1/ 29 9
6/ 68 /1 30 / 1 81 /2 9 9
1 / 1 3/ 2 2/ 31 / 6 1
1/ 2 7 /5 1 /7 2 /1 3 6
1 /1 9 /3 3 /4 6 /1 10
1/ 1 5/ 2 5 /3 5 /7 8
1/ 1 4/ 23 / 3 2/ 71
1 /1 3 /2 3 /3 2 /7 1
1/ 2 6/ 4 6/ 6 5/ 1 2 9
1/ 1 7 /2 9 /4 1 /9 4
1 /1 4 /2 4 /3 3 /7 4
1 /1 3 /2 3 /3 1 /6 5
1 /1 3 /2 3 /3 1 /6 5
1/ 2 6/ 46 / 6 4/ 12 2
1/ 17 /2 9 /4 1 /9 2
1 /1 4 /2 4 /3 3 /7 3
1 /1 3 /2 3 /3 1 /6 5
1 /1 3 /2 3 /3 1 /6 6
E S
1 4 4. 2 8 ± 77 .7 8
1 4 6 .9 6 ± 7 9 .2 1
25 .3 8 ± 13 .5 6
5 5 .3 9 ± 3 0 .1 3
3 7 .0 4 ± 20 .1 3
2 8 .8 1 ± 1 5. 53
2 6 .7 4 ± 1 4 .2 9
2 6 .4 4 ± 1 4. 14
50 .6 0 ± 27 .6 6
3 3 .7 2 ± 1 8 .4 8
27 .6 0 ± 14 .8 8
2 6 .1 8 ± 1 3 .9 8
2 6 .1 1 ± 1 3. 94
50 .2 9 ± 27 .2 7
3 3 .5 3 ± 1 8. 38
27 .5 8 ± 14 .8 6
2 6 .1 9 ± 1 3 .9 9
2 6 .1 2 ± 13 .9 4
5 /7 7 /1 4 5/ 2 0 7/ 3 00
5/ 78 /1 4 8/ 2 1 1 /3 0 7
1/ 1 5 /2 5 /3 6 /6 3
1 /3 0 /5 6 /7 9 /1 41
1 /2 1 /3 7 /5 2 /1 11
1/ 17 / 29 / 4 1/ 8 5
1/ 1 5 /2 7 /3 8 /7 6
1 / 1 5/ 2 6/ 3 7/ 73
1/ 2 7 /5 1 /7 2 /1 3 3
1 /1 9 /3 4 /4 7 /1 03
1/ 1 5/ 28 / 3 9/ 75
1 /1 5 /2 6 /3 7 /7 1
1 / 15 / 2 6/ 3 7/ 7 0
1/ 28 /5 1 /7 1 /1 3 3
1 /1 9 /3 4 /4 7 /9 5
1/ 1 5/ 28 /3 9 /7 5
1 /1 5 /2 6 /3 7 /7 1
1 / 1 5/ 26 / 3 7/ 71
FR 1 42 .3 7 ± 7 7 .8 1
1 4 7 .0 8 ± 8 0. 30
2 5 .5 9 ± 13 .8 6
5 4 .0 4 ± 2 9. 5 5
37 .2 7 ± 2 0 .6 5
2 8 .8 4 ± 1 5 .7 6
26 .7 9 ± 14 .4 7
2 6 .5 1 ± 1 4 .3 5
50 .7 8 ± 2 7. 79
33 .8 2 ± 18 .7 4
2 7 .6 6 ± 15 .1 1
2 6 .2 7 ± 1 4. 20
2 6 .2 2 ± 1 4 .1 6
49 .9 7 ± 2 7. 2 5
33 .8 3 ± 1 8 .8 0
27 .6 6 ± 15 .0 9
2 6 .3 0 ± 1 4 .2 1
2 6 .2 1 ± 1 4 .1 6
4/ 74 / 14 5/ 20 5 /3 0 0
4/ 7 7/ 1 50 /2 1 2 / 3 1 0
1/ 14 /2 6 /3 6 /6 6
1/ 2 9/ 5 5/ 76 / 13 9
1/ 2 0/ 3 8/ 5 2/ 11 9
1/ 1 6 /2 9 /4 0 /8 9
1 /1 5 /2 7 /3 7 /7 4
1 /1 5 /2 7 /3 7 /7 0
1 /2 7 /5 2 /7 2 /1 3 5
1 /1 8 /3 4 /4 7 /1 0 8
1/ 1 5/ 28 / 3 9/ 8 0
1/ 14 / 2 7/ 37 / 6 9
1 /1 4 /2 7 /3 7 /6 9
1 /2 7 /5 1 /7 0 /1 3 1
1 /1 8 /3 4 /4 7 /1 0 7
1/ 1 5/ 28 / 3 9/ 84
1/ 14 / 2 7/ 37 / 6 9
1 /1 4 /2 7 /3 7 /6 9
R U
1 40 .2 5 ± 76 .2 1
2 57 .7 9 ± 1 41 .5 3
20 .8 6 ± 1 1 .2 5
5 7 .7 9 ± 32 .1 2
36 .9 3 ± 20 .7 3
25 .9 2 ± 1 4 .4 8
23 .5 6 ± 12 .9 5
2 3 .1 0 ± 1 2 .7 1
5 3 .0 8 ± 29 .0 0
3 2 .5 9 ± 1 8 .4 2
24 .3 9 ± 13 .5 9
2 2 .8 1 ± 1 2 .5 0
2 2 .7 5 ± 1 2. 46
5 3 .2 4 ± 29 .1 8
3 2 .4 9 ± 1 8 .4 9
24 .4 1 ± 13 .5 7
2 2 .8 1 ± 1 2 .5 0
2 2 .7 4 ± 12 .4 5
5/ 7 5 /1 4 1/ 20 0 /3 0 0
7/ 1 36 /2 59 /3 70 / 56 9
1/ 1 2/ 21 / 29 / 69
1/ 3 1 /5 8 /8 2 /1 85
1 /2 1 /3 6 /5 2 /1 85
1 /1 5 /2 6 /3 6 /1 28
1 /1 4 /2 3 /3 3 /1 01
1 /1 3 /2 3 /3 2 /9 5
1/ 2 9/ 53 / 7 5/ 18 5
1/ 1 8/ 3 2/ 46 / 1 66
1/ 1 4 /2 4 /3 4 /1 1 2
1 /1 3 /2 3 /3 2 /8 5
1 /1 3 /2 3 /3 2 /9 3
2/ 3 0/ 53 / 7 6/ 18 5
1/ 1 8/ 3 2/ 4 5/ 1 61
1/ 1 4 /2 4 /3 4 /1 0 5
1 /1 3 /2 3 /3 2 /9 0
1 / 1 3/ 2 3 /3 2 /9 2
Z H
3 5. 10 ± 1 8 .4 8
9 7 .8 5 ± 52 .1 0
1 9 .5 0 ± 10 .4 2
3 1 .4 4 ± 1 6. 96
26 .0 7 ± 1 4. 1 9
22 .1 4 ± 1 2 .0 2
20 .6 7 ± 11 .1 6
2 0 .4 1 ± 1 1. 05
30 .4 8 ± 1 6 .4 7
24 .5 8 ± 1 3. 42
2 1 .1 9 ± 11 .4 9
2 0 .1 1 ± 1 0 .7 9
2 0 .0 9 ± 1 0 .7 9
3 0 .5 9 ± 1 6. 4 5
24 .6 1 ± 1 3. 49
2 1 .1 9 ± 11 .4 9
2 0 .1 2 ± 1 0. 81
2 0 .0 9 ± 10 .7 9
2 /2 1 /3 5 /4 9 /1 2 5
4/ 5 3/ 9 9/ 1 38 /2 68
1 /1 1 /2 0 /2 7 /6 4
1 /1 8 /3 1 /4 4 /1 0 9
1/ 1 5/ 2 6/ 36 / 93
1/ 13 /2 2 /3 1 /8 0
1 /1 2 /2 1 /2 9 /7 4
1 / 12 / 2 0/ 28 / 7 4
1/ 17 /3 0 /4 3 /1 0 4
1/ 1 4/ 24 /3 4 /9 2
1/ 1 2/ 21 / 2 9/ 71
1 /1 2 /2 0 /2 8 /6 4
1/ 12 / 2 0/ 2 8/ 66
1/ 1 8 /3 0 /4 3 /1 0 1
1 /1 4 /2 4 /3 4 /9 3
1/ 1 2/ 21 / 2 9 /7 6
1 /1 2 /2 0 /2 8 /6 4
1/ 1 2/ 20 / 2 8/ 65
Z H
_p in
yi n
1 2 2. 52 ± 65 .5 9 6/ 67 /1 2 5 / 17 3 /3 53
Z H
_w ub
i 1 0 7. 4 9 ± 5 6 .7 3 4/ 6 0/ 1 08 /1 5 1 /2 94
A R
_c p1
25 6
1 08 .6 6 ± 5 8. 01 3/ 6 0/ 1 1 0/ 1 53 / 27 7
R U
_c p1
25 1
1 40 .2 5 ± 7 6. 21 5 /7 5 /1 4 1 /2 0 0 / 3 00
E S
C O
R E
TA B
L E
S
N um
be ro
fb its
to en
co de
th e
de v
da ta
fo re
ac h
of th
e 30
la ng
ua ge
di re
ct io
ns .S
ho w
n is
m ea
n± st
d ov
er :
• 12
ru ns
fo rC
H A
R ,B
Y T
E ,a
nd W
O R
D fr
om 10
0 to
10 0,
00 0
lin es , • 5 ru ns fo r1 ,0 00 ,0 00 lin es ,a nd • 3 ru ns fo ra ll si ze s in vo lv in g al te rn at e re pr es en ta tio ns (B PE ,P in
yi n,
W ub
i, cp
12 56
an d
cp 12
51 ).
C H
A R
B Y
T E
W O
R D
B PE
L G
D IR
10 0
1 ,0 0 0
10 ,0 0 0
10 0 ,0 00
1 ,0 0 0 ,0 0 0
10 0
1, 0 00
10 ,0 00
1 00 ,0 00
1 ,0 00 ,0 00
10 0
1 ,0 00
10 ,0 0 0
10 0, 0 00
1 ,0 00 ,0 0 0
1 00
1 ,0 00
1 0, 0 00
1 0 0, 00 0
1 ,0 0 0, 0 00
A R
-E N
1 ,5 4 4 ,7 36 .2 3
1 ,1 2 1, 01 5 .0 3
7 60 ,7 3 2. 5 0
76 5 ,0 2 8 .7 2
77 0 ,9 24 .5 2
1 ,5 2 6, 2 55 .5 8
1, 12 9 ,9 6 1. 6 4
74 3 ,5 67 .3 6
71 1 ,3 5 3 .6 5
68 9 ,6 39 .7 9
82 4 ,0 21 .6 6
91 9 ,9 47 .5 0
74 9 ,9 70 .5 2
71 0, 25 1. 48
70 0, 34 1. 00
1, 3 01 ,6 65 .5 1
99 6 ,0 4 7. 6 3
81 7 ,1 7 0. 91
73 4, 44 3 .6 1
72 4, 41 3 .8 3
± 33 ,3 45 .4 6
± 33 ,5 8 6 .5 1
± 51 ,8 8 6 .3 5
± 6 5, 50 2 .6 2
± 5 6 ,6 22 .9 5
± 2 0 ,0 3 5. 5 4
± 28 ,2 6 8 .8 2
± 51 ,3 2 1 .6 2
± 57 ,2 2 0. 79
± 2 1 ,8 42 .7 8
± 16 ,6 64 .2 9
± 57 ,4 5 2. 0 7
± 27 ,1 8 4. 31
± 2 0 ,1 4 8. 97
± 8, 8 53 .3 0
± 82 ,8 57 .8 6
± 7 4 ,1 75 .0 8
± 7 0, 7 05 .5 1 ± 1 8 ,6 26 .3 7 ± 1 1 ,6 71 .4 9
A R
-E S
1, 66 9 ,2 30 .6 7
1 ,1 82 ,1 22 .1 4
7 90 ,2 9 6. 6 3
81 2 ,5 41 .5 9
80 1 ,7 97 .3 1
1 ,6 8 2, 3 68 .2 1
1, 21 4 ,7 1 2. 8 0
7 6 8 ,3 29 .5 5
7 73 ,0 77 .6 0
74 3 ,1 87 .1 2
89 8 ,4 67 .6 3
1, 0 39 ,4 23 .5 3
8 31 ,1 31 .8 5
79 2, 19 9. 6 9
78 8, 77 0. 52
1, 41 5, 20 4. 23
1, 16 9, 08 6. 0 6
8 8 9, 2 0 3. 72
82 2, 28 6 .9 5
81 8, 45 0 .3 4
± 33 ,8 27 .0 5
± 38 ,9 1 8 .2 3
± 30 ,5 3 6. 00
± 52 ,7 0 5. 76
± 3 2 ,0 8 9. 03
± 49 ,0 5 7. 8 7
± 31 ,3 4 1. 49
± 58 ,9 3 5. 67
± 65 ,3 76 .9 2
± 44 ,3 15 .6 7
± 24 ,9 59 .6 7
± 84 ,9 56 .0 4
± 2 7, 01 3 .2 7 ± 1 0 ,4 68 .3 1 ± 9 ,8 21 .5 2
± 8 1 ,5 44 .7 5
± 34 ,7 9 8. 6 5
± 49 ,7 2 2. 1 0 ± 22 ,3 9 1. 5 4 ± 11 ,9 7 6. 63
A R
-F R
1, 67 4 ,6 0 3 .4 4
1, 1 82 ,5 89 .3 0
79 1 ,6 60 .5 1
7 87 ,1 10 .4 3
7 99 ,1 2 4 .8 8
1 ,6 7 7 ,2 0 1. 0 7
1 ,1 95 ,3 7 8. 25
74 9 ,3 5 8. 4 5
72 9 ,8 8 1 .0 5
7 05 ,3 75 .6 6
9 26 ,2 13 .0 5
1, 02 3, 04 8. 10
85 9, 5 52 .5 2
81 9, 66 9 .8 0
81 2, 02 7 .1 1
1, 42 5 ,8 34 .1 1
1, 17 3, 95 6 .4 0
92 5, 8 54 .4 8
8 44 ,7 51 .7 7
8 35 ,8 02 .1 1
± 38 ,2 29 .9 2
± 3 6, 91 3 .5 3
± 5 1 ,7 82 .4 5
± 30 ,3 0 6 .4 3
± 3 3 ,6 96 .7 6
± 2 7, 9 8 5. 3 5
± 29 ,5 1 8. 16
± 17 ,8 6 0 .4 0
± 61 ,8 47 .1 2
± 1 8, 36 4 .5 7
± 3 1 ,6 20 .3 2
± 7 0 ,0 43 .6 9
± 33 ,9 15 .7 2 ± 15 ,2 39 .7 1 ± 9 ,8 23 .4 8
± 76 ,6 7 4. 6 2
± 10 8, 44 8. 13
± 66 ,0 0 8. 74
± 24 ,4 13 .2 3 ± 12 ,8 15 .2 0
A R
-R U
1, 83 9 ,6 54 .0 3
1 ,3 5 4 ,4 0 1 .8 4
84 8 ,0 31 .2 5
8 69 ,5 51 .0 1
8 69 ,6 1 2 .9 3
2 ,1 9 7 ,5 4 1. 9 8
2, 2 2 8, 31 9 .1 7
2, 43 1 ,8 5 3. 8 3
1, 94 7, 40 4. 65
1, 82 9, 83 9. 51
91 8, 1 72 .2 9
1, 1 10 ,8 84 .6 2
8 31 ,1 1 2. 9 7
78 8, 60 8. 2 0
77 7, 41 8. 25
1, 58 7, 52 1. 54
1, 32 7, 48 3. 0 8
92 9, 7 90 .5 0
8 60 ,7 89 .4 6
85 2, 52 0. 24
± 77 ,8 43 .2 0
± 93 ,5 25 .8 1
± 4 5 ,3 1 1 .4 1
± 5 0 ,9 29 .8 5
± 1 12 ,9 6 9. 06
± 11 8 ,1 7 2. 4 3 ± 3 15 ,1 9 0 .2 9 ± 73 4 ,5 3 1 .4 8 ± 50 1 ,3 80 .3 4 ± 57 5 ,0 69 .7 4
± 38 ,4 38 .6 3
± 79 ,9 72 .0 5
± 35 ,3 7 3. 49
± 14 ,0 59 .9 6 ± 8, 1 80 .3 8
± 76 ,5 64 .1 2
± 24 7, 18 7. 6 3 ± 5 4 ,9 54 .7 8 ± 27 ,3 2 4. 96
± 10 ,9 0 9. 30
A R
-Z H
1 ,2 80 ,8 17 .0 3
1 ,2 81 ,1 9 7 .2 6
1, 13 2 ,3 98 .0 0
1, 12 0 ,6 8 1. 62
1, 1 21 ,6 4 5 .9 9
1 ,5 68 ,7 4 3. 1 3
1, 2 0 1, 5 66 .3 7
7 69 ,1 8 3 .3 0
75 2 ,9 91 .2 0
74 5 ,2 6 4. 8 5
7 89 ,1 40 .0 1
94 2 ,4 41 .6 8
72 9 ,6 12 .4 2
67 6, 40 9 .8 9
67 3, 01 2. 11
1, 21 5 ,9 00 .3 4
1 ,0 90 ,6 17 .7 4
78 4, 57 9 .9 4
6 9 7, 06 6. 73
69 7, 86 6 .0 7
± 8 3 ,6 8 3 .9 1
± 58 ,5 74 .8 7
± 33 ,1 88 .8 9
± 3 8, 49 5 .7 7
± 3 0, 84 0 .4 7
± 5 4 ,8 45 .3 3
± 1 1 6, 2 03 .8 7
± 2 9, 2 22 .5 8
± 3 1 ,7 5 9. 1 2
± 1 1 ,9 16 .2 5
± 41 ,1 01 .5 3
± 67 ,2 55 .2 0
± 39 ,3 47 .5 8 ± 1 1, 96 6 .2 2 ± 1 0 ,2 76 .1 4
± 93 ,9 70 .6 0
± 16 4, 49 9 .4 6 ± 63 ,1 1 2 .6 8 ± 2 4 ,0 73 .7 4 ± 2 1 ,9 32 .0 7
E N
-A R
1, 51 0 ,7 40 .0 1
1 ,2 1 9 ,9 1 4 .7 1
8 4 0 ,0 90 .4 9
85 1 ,2 69 .3 4
83 5 ,2 92 .9 0
1 ,6 1 2 ,8 8 7. 0 2
1, 4 11 ,0 4 7 .8 4
1 ,3 76 ,2 1 1 .9 8
1, 10 0, 95 8. 9 9
9 05 ,2 75 .8 2
9 24 ,8 98 .3 1
1, 19 2 ,6 84 .9 0
86 8, 14 0. 02
8 13 ,8 74 .2 5
7 88 ,4 14 .2 8
1, 41 9, 27 5. 8 8
1 ,3 6 1, 39 8. 11
94 4, 55 4 .1 5
90 3, 94 1 .6 9
86 2, 16 2 .9 2
± 6 5 ,3 75 .8 9
± 12 0 ,4 33 .8 4
± 5 5 ,0 48 .7 1
± 5 1 ,8 7 4. 4 4
± 47 ,7 1 8 .6 8
± 3 6, 8 58 .6 3
± 9 3 ,4 68 .2 8
± 36 0, 8 10 .3 4 ± 27 2 ,3 9 3. 5 0
± 52 ,5 91 .2 2
± 42 ,7 4 5. 8 0 ± 11 0, 70 0. 20
± 5 5, 33 1. 86
± 3 4 ,4 72 .4 9 ± 11 ,4 28 .2 6
± 12 4, 34 1. 4 3 ± 2 52 ,3 43 .7 4 ± 9 8 ,0 8 9 .1 9 ± 6 3 ,7 10 .3 7 ± 24 ,8 82 .5 8
E N
-E S
1, 68 1 ,1 6 5 .4 5
1 ,1 83 ,3 88 .6 5
81 0 ,0 07 .6 2
8 44 ,1 8 6. 0 6
9 6 5, 9 4 2. 2 7
1 ,6 98 ,5 84 .2 2
1, 17 2 ,7 36 .5 8
8 1 2 ,0 42 .4 2
8 36 ,0 78 .2 1
8 62 ,3 62 .7 8
88 7 ,0 4 5. 1 5
1, 05 1, 45 1. 41
82 9, 47 0 .6 1
79 0, 23 1 .8 7
78 6, 3 06 .0 7
1, 40 2 ,3 11 .2 9
1 ,2 16 ,6 99 .1 4
87 4, 8 02 .0 0
8 21 ,1 71 .7 5
8 16 ,4 03 .0 5
± 4 8, 3 33 .3 3
± 3 2 ,3 16 .4 4
± 7 1 ,1 6 2. 4 4
± 8 8 ,9 4 6. 7 4
± 10 6 ,2 6 4. 4 2
± 63 ,9 4 2 .7 3
± 2 6 ,5 4 4. 6 1
± 4 9 ,3 7 5. 3 4
± 9 1, 25 7 .6 8
± 41 ,8 34 .9 9
± 2 1 ,4 62 .7 5
± 80 ,3 81 .7 3
± 21 ,1 2 1. 79
± 10 ,8 28 .7 7 ± 7, 2 41 .9 2
± 72 ,6 07 .5 6
± 10 9, 80 7. 2 5 ± 37 ,2 2 6 .6 3 ± 1 9, 08 8 .5 9 ± 1 1 ,0 16 .6 5
E N
-F R
1 ,6 8 6 ,6 6 4 .4 1
1, 17 8 ,1 68 .8 3
8 1 9 ,6 2 8. 0 2
8 34 ,5 3 7 .8 4
86 3 ,8 6 4 .6 2
1 ,6 8 3 ,9 71 .8 9
1, 1 67 ,3 2 4 .3 9
79 1 ,4 37 .9 2
84 9 ,8 88 .5 0
89 7 ,9 8 3. 7 6
9 34 ,0 50 .8 7
1, 03 5, 71 4. 9 9
85 1, 17 1 .4 1
81 4, 97 5 .8 9
80 8, 88 6. 69
1, 43 5 ,8 57 .0 4
1 ,1 94 ,7 82 .8 2
9 23 ,2 40 .0 9
8 40 ,3 83 .9 4
8 30 ,7 88 .8 1
± 4 5 ,7 80 .1 1
± 3 6 ,6 7 2. 3 4
± 8 2 ,0 5 5. 4 2
± 71 ,5 2 9. 5 1
± 91 ,1 2 4. 2 7
± 31 ,3 27 .5 5
± 4 4 ,2 1 0. 7 5
± 56 ,9 7 7. 4 2
± 8 0, 9 81 .3 7
± 10 8 ,4 32 .8 1
± 1 7 ,0 22 .6 3
± 84 ,8 47 .5 7
± 27 ,4 42 .3 4 ± 1 5, 51 3 .7 1 ± 8, 76 3. 55
± 8 4, 87 2 .4 4
± 20 9 ,6 76 .1 7 ± 77 ,0 36 .4 3 ± 2 2, 77 6 .1 2 ± 1 9 ,2 27 .1 3
E N
-R U
1 ,8 0 0 ,2 85 .2 1
1 ,3 2 2 ,6 98 .3 6
9 0 5 ,4 0 4 .6 6
87 7 ,3 5 6 .9 2
87 7 ,6 11 .0 1
2 ,1 45 ,9 2 9. 3 8
2, 05 6 ,9 6 2 .2 6
2, 4 3 3, 40 5 .4 1
2 ,0 82 ,1 68 .2 5
2, 05 7 ,3 26 .4 7
88 5, 40 3. 3 0
1, 10 9, 22 0. 75
82 5, 7 85 .7 6
78 8, 32 5. 99
77 6, 04 1. 11
1, 5 88 ,0 98 .7 1
1 ,2 94 ,0 95 .3 6
92 1, 0 79 .5 4
85 9, 6 48 .1 4
84 5, 65 5 .4 5
± 2 9 ,9 2 5 .0 5
± 3 5 ,2 69 .3 2
± 8 5 ,6 69 .6 0
± 6 5, 4 07 .0 2
± 6 4, 6 09 .2 2
± 1 03 ,0 2 1. 89
± 3 1 2, 12 6 .1 9 ± 4 0 3, 38 5 .2 8 ± 5 07 ,7 89 .3 8 ± 78 6, 35 1 .5 0
± 27 ,2 23 .8 4
± 77 ,9 56 .9 9
± 26 ,4 6 4. 92
± 1 6, 71 7. 11
± 1 0 ,2 51 .1 2
± 74 ,6 70 .8 8
± 23 9, 51 2. 03
± 5 2 ,4 1 4. 5 5 ± 24 ,9 07 .3 8 ± 5, 37 6 .9 6
E N
-Z H
1 ,2 26 ,6 60 .6 8
1, 2 94 ,7 3 7 .7 3
1, 12 9, 16 7 .1 4
1, 15 7 ,0 1 9. 4 5
1 ,1 3 1 ,3 3 2. 8 6
1, 69 4 ,3 05 .7 8
1, 24 6 ,0 2 7. 0 7
82 1 ,5 92 .7 4
80 8 ,8 48 .9 5
81 7 ,7 37 .1 5
78 5 ,1 38 .7 4
9 54 ,3 62 .8 2
72 9 ,7 39 .6 4
68 1, 29 1 .8 2
67 2, 10 0 .1 2
1, 2 03 ,8 01 .6 2
1 ,1 00 ,7 4 7. 41
8 02 ,5 4 3. 68
7 0 0, 99 1. 91
6 95 ,4 38 .3 3
± 94 ,0 88 .7 6
± 39 ,3 4 4 .1 7
± 3 0, 67 6 .1 3
± 2 8, 96 5 .7 9
± 1 7 ,9 9 2 .0 5
± 8 9 ,6 1 2. 6 2
± 14 6 ,9 8 8. 7 7
± 48 ,3 9 2 .4 6
± 2 9 ,2 0 6. 9 1
± 2 0 ,4 01 .2 9
± 37 ,1 69 .4 1
± 68 ,0 65 .9 0
± 41 ,6 40 .7 1 ± 2 0 ,2 30 .3 9 ± 1 0 ,9 46 .8 1
± 65 ,2 61 .4 0
± 13 6, 36 6 .7 1 ± 4 5, 92 7 .7 4 ± 2 2 ,8 5 0. 33
± 1 1, 29 1 .5 1
E S-
A R
1, 5 02 ,1 18 .2 6
1, 2 25 ,7 6 1 .4 3
85 5 ,6 96 .3 7
8 4 8 ,4 4 7 .6 1
7 8 0 ,3 7 5 .1 6
1 ,6 05 ,9 5 5 .7 8
1, 4 9 0, 4 11 .3 7
1 ,1 6 1 ,6 01 .7 0
1, 01 4, 99 4. 2 4
9 70 ,0 76 .3 5
91 6 ,5 26 .6 9
1, 19 7 ,6 24 .0 1
85 7, 48 9. 43
8 14 ,2 08 .1 0
7 87 ,7 50 .6 1
1, 40 1, 58 3. 2 9
1 ,2 8 8, 01 3. 56
94 2, 43 7 .0 9
89 0, 5 64 .9 0
86 2, 2 40 .6 0
± 59 ,5 31 .4 2
± 1 18 ,9 4 7 .7 7
± 5 3 ,1 7 9 .4 4
± 5 4 ,3 5 5. 00
± 6, 6 22 .9 4
± 62 ,0 9 8. 79
± 1 20 ,3 1 6. 5 0 ± 1 18 ,8 16 .2 7 ± 2 51 ,4 91 .5 5 ± 21 1 ,4 9 5. 9 0
± 43 ,9 61 .4 8 ± 1 05 ,7 78 .6 6 ± 47 ,5 66 .3 8 ± 32 ,4 71 .6 0 ± 13 ,9 80 .2 3
± 1 09 ,9 16 .8 4 ± 21 8 ,3 10 .6 0 ± 9 3 ,2 54 .7 0 ± 7 4 ,4 17 .8 4 ± 24 ,4 04 .8 5
E S-
E N
1, 52 8 ,8 79 .4 7
1 ,1 2 5 ,9 2 9 .7 2
79 4 ,6 13 .9 1
8 14 ,3 2 5 .6 3
8 22 ,4 9 5 .3 0
1 ,5 3 6 ,4 7 9. 43
1, 1 2 3, 31 1 .0 2
7 96 ,2 0 7 .8 1
7 86 ,4 42 .2 6
79 9 ,4 9 0. 21
80 5 ,5 78 .6 0
89 2 ,3 68 .7 2
73 8 ,8 70 .4 2
70 4, 02 5 .5 4
69 9, 4 48 .8 0
1, 29 0 ,9 21 .2 2
1 ,0 59 ,7 25 .2 5
82 4, 1 22 .7 1
7 29 ,2 24 .3 7
72 3, 24 1. 13
± 17 ,3 80 .0 8
± 3 3 ,0 1 2 .1 1
± 7 5 ,5 58 .2 0
± 8 2 ,4 52 .9 3
± 9 0, 3 57 .6 9
± 19 ,8 56 .0 1
± 2 8 ,4 0 8. 3 1
± 63 ,7 5 6 .3 7
± 69 ,6 96 .4 7
± 3 6, 82 9. 85
± 21 ,8 17 .9 3
± 49 ,2 90 .5 9
± 28 ,7 74 .8 0 ± 9, 88 9 .0 0
± 7, 2 76 .7 7
± 76 ,0 27 .6 6
± 44 ,1 81 .1 9
± 6 3 ,6 0 9. 75
± 20 ,3 54 .8 2 ± 12 ,0 7 6. 16
E S-
FR 1 ,6 7 1 ,9 31 .0 4
1, 1 85 ,2 3 7 .7 7
79 2 ,0 16 .6 2
8 01 ,6 25 .4 7
8 2 7 ,4 0 6 .5 5
1 ,6 77 ,6 9 9. 91
1, 1 7 7, 3 74 .2 2
7 81 ,2 5 3. 4 5
81 5 ,4 25 .7 7
78 1 ,3 9 9. 8 5
9 30 ,1 15 .3 5
1, 00 4, 96 0. 2 0
85 0, 75 3 .2 8
82 1, 77 1 .7 6
80 7, 95 0. 92
1, 43 6 ,0 26 .9 5
1 ,2 12 ,9 57 .0 4
9 43 ,3 07 .7 4
8 39 ,9 85 .4 7
83 9, 76 0. 81
± 27 ,7 30 .3 5
± 3 3 ,3 38 .3 2
± 7 3 ,0 58 .0 8
± 3 8, 0 60 .7 3
± 58 ,3 43 .1 7
± 23 ,9 8 2 .3 6
± 40 ,7 21 .1 3
± 4 9, 92 5 .2 7
± 6 3, 8 15 .5 4
± 2 2 ,5 42 .7 4
± 22 ,1 16 .8 2
± 59 ,8 88 .0 8
± 28 ,5 85 .5 8 ± 2 6, 79 7 .4 3 ± 9, 11 7. 7 0
± 79 ,8 89 .5 4
± 20 6, 01 1 .4 1 ± 7 4 ,0 3 6. 7 2 ± 2 2, 65 0 .1 3 ± 1 9 ,3 34 .3 8
E S-
R U
1 ,8 0 2, 9 53 .0 2
1, 3 16 ,2 80 .0 8
1, 08 3 ,0 50 .5 4
9 61 ,4 9 7. 3 3
93 4 ,2 28 .9 5
2 ,1 8 2, 1 42 .7 3
2, 30 2 ,6 0 8. 5 3
2, 6 15 ,5 0 5 .9 7
2 ,4 08 ,3 7 9. 2 9
1, 71 9, 14 4. 46
91 3, 3 99 .9 4
1, 09 5 ,1 13 .5 9
82 6, 91 9. 25
7 86 ,9 55 .7 5
7 76 ,3 62 .3 7
1, 58 9, 95 1. 8 5
1 ,2 8 7, 24 1. 22
9 25 ,2 82 .4 1
8 6 3, 85 6. 53
85 2, 10 6. 52
± 3 6 ,9 05 .6 0
± 47 ,9 34 .4 4
± 58 2 ,6 27 .7 2 ± 11 8 ,5 56 .0 2
± 5 3 ,2 02 .7 5
± 1 3 5, 7 19 .7 5 ± 33 0, 8 63 .0 7 ± 60 7 ,0 01 .2 6 ± 43 6, 1 57 .8 6 ± 58 8 ,8 39 .5 7
± 4 1, 65 0. 78
± 8 0 ,2 09 .2 5
± 3 2 ,6 66 .6 8 ± 15 ,3 61 .2 3 ± 9, 47 5. 6 1
± 82 ,9 13 .6 5
± 2 35 ,0 0 2. 06
± 57 ,1 5 2. 5 5 ± 27 ,7 97 .3 3 ± 9 ,4 33 .1 5
E S-
Z H
1, 2 32 ,6 11 .0 5
1, 31 2 ,0 46 .0 7
1 ,1 1 9 ,0 2 3. 4 6
1 ,1 24 ,8 9 6. 5 8
1, 1 2 7, 9 69 .4 7
1, 6 64 ,8 3 3 .8 3
1, 2 2 4, 8 59 .9 4
8 08 ,7 6 5 .4 0
80 1 ,3 1 7. 28
81 2 ,9 27 .3 8
79 0 ,3 1 3. 0 4
9 54 ,6 65 .2 3
73 0 ,0 68 .5 3
67 9, 04 9. 7 7
67 3, 43 4. 94
1, 21 1, 61 0. 91
1, 10 5, 85 1. 1 4
79 4, 3 27 .2 1
7 00 ,1 22 .2 5
6 92 ,5 39 .6 5
± 8 2 ,2 7 0. 75
± 88 ,3 61 .9 1
± 4 5, 89 8 .6 7
± 3 1 ,8 2 4 .1 6
± 2 3 ,4 14 .9 6
± 77 ,4 1 2 .0 9
± 1 31 ,8 3 3 .2 8
± 2 9 ,2 1 1 .1 2
± 24 ,0 22 .2 8
± 26 ,4 10 .0 4
± 28 ,0 23 .6 3
± 73 ,4 1 1. 42
± 3 4, 56 8 .0 2 ± 1 2 ,1 24 .2 6 ± 9 ,4 15 .9 9
± 7 8 ,1 54 .9 7
± 1 47 ,2 69 .9 8 ± 54 ,8 4 9. 25
± 31 ,8 01 .7 0 ± 1 3, 10 2 .5 3
FR -A
R 1, 4 93 ,9 98 .5 4
1, 2 13 ,2 57 .6 9
8 58 ,9 8 0 .2 2
8 5 3 ,5 5 6 .6 7
8 27 ,4 4 6 .9 7
1 ,6 1 0, 0 76 .6 2
1 ,3 8 1, 5 24 .2 1
1, 1 72 ,4 2 8. 64
9 93 ,9 4 4. 78
79 9 ,3 19 .4 8
92 9 ,0 13 .5 1
1, 20 0, 77 9. 58
86 3, 1 54 .8 5
81 2, 9 18 .9 9
79 4, 82 5 .6 2
1, 4 00 ,8 57 .4 5
1, 35 2 ,5 02 .4 1
9 46 ,3 0 6. 6 4
8 94 ,2 09 .9 6
8 62 ,8 1 5. 27
± 73 ,4 8 7. 0 6
± 12 9 ,4 50 .7 0
± 27 ,4 0 6. 2 8
± 52 ,8 0 3 .5 1
± 7 4 ,9 95 .8 9
± 5 8, 76 3. 7 4
± 63 ,9 8 9. 0 6
± 1 49 ,0 6 6. 8 9 ± 1 49 ,9 70 .8 7
± 46 ,3 6 7. 05
± 48 ,0 67 .9 4 ± 1 08 ,9 25 .0 7 ± 50 ,0 40 .0 2 ± 32 ,0 30 .2 9 ± 12 ,3 41 .0 0
± 1 09 ,3 42 .8 9 ± 21 5 ,3 35 .1 9 ± 9 3 ,5 90 .1 0 ± 73 ,2 4 3. 54
± 22 ,8 1 8. 24
FR -E
N 1 ,5 39 ,3 3 1. 8 2
1 ,1 1 2 ,2 35 .9 5
7 70 ,1 30 .6 3
7 9 8, 4 4 3. 6 0
8 14 ,7 1 1. 4 0
1 ,5 2 8, 7 59 .7 9
1, 11 6 ,2 7 8. 2 7
7 6 5 ,8 71 .8 6
75 8 ,8 13 .7 6
7 81 ,5 2 0. 62
81 4 ,1 2 4. 76
91 5 ,3 92 .2 7
75 1 ,1 16 .4 3
70 4, 00 0 .9 7
69 8, 3 60 .2 7
1, 29 5 ,0 95 .2 4
1 ,1 32 ,3 24 .9 1
8 18 ,0 04 .3 3
7 31 ,4 59 .6 4
7 21 ,7 42 .6 1
± 3 0 ,6 45 .0 0
± 3 9 ,7 0 3. 27
± 4 5 ,6 1 9. 4 6
± 77 ,4 3 2. 7 3
± 73 ,6 31 .1 9
± 25 ,5 7 4. 7 7
± 3 1 ,3 7 3. 5 3
± 63 ,8 2 1. 2 7
± 5 6, 82 2 .3 3
± 89 ,9 58 .5 7
± 28 ,9 93 .1 6
± 46 ,7 43 .3 3
± 38 ,8 48 .5 8 ± 10 ,8 60 .9 5 ± 7, 40 4. 34
± 77 ,1 10 .8 0
± 1 30 ,6 07 .5 0 ± 6 4 ,4 78 .3 4 ± 2 5, 7 11 .8 3 ± 11 ,0 5 6. 08
FR -E
S 1 ,6 60 ,5 0 3 .4 6
1, 2 02 ,2 6 3 .3 7
80 9 ,0 42 .3 6
8 4 8 ,6 6 6 .8 5
9 5 5 ,3 3 4 .1 1
1 ,6 6 0, 2 08 .4 7
1, 16 3 ,3 4 6. 8 0
7 9 6 ,5 85 .1 7
81 8 ,9 2 1. 73
91 2 ,7 07 .8 1
88 9 ,0 5 8. 3 6
1, 03 8, 67 9 .6 0
82 6, 5 99 .8 3
78 9, 41 3 .2 5
78 4, 65 8 .8 9
1, 4 04 ,1 35 .7 4
1, 2 47 ,8 27 .6 3
88 2, 77 9 .2 4
8 21 ,9 25 .1 7
81 5, 22 0 .8 6
± 2 8 ,3 32 .3 2
± 32 ,9 25 .1 8
± 6 0, 41 2. 8 2
± 10 5 ,9 3 4. 4 5 ± 1 28 ,2 1 0 .2 4
± 29 ,3 5 4 .3 3
± 43 ,4 3 2 .1 4
± 6 2 ,7 5 6 .7 9
± 88 ,1 47 .4 5
± 67 ,6 43 .7 8
± 2 6 ,4 51 .4 7
± 6 4 ,1 67 .3 8
± 29 ,0 86 .1 5 ± 10 ,4 53 .6 6 ± 8, 16 8. 8 9
± 75 ,5 80 .9 7
± 17 1, 05 2. 39
± 58 ,4 6 3. 4 2 ± 18 ,1 5 1. 49
± 10 ,2 6 1. 57
FR -R
U 1, 8 01 ,7 8 7 .8 1
1, 33 8 ,3 0 2 .4 7
8 83 ,2 7 7. 92
8 7 5 ,5 4 6 .3 7
8 9 6 ,2 9 6 .7 0
2 ,2 28 ,5 37 .8 8
2 ,1 2 1, 93 1 .7 1
2, 1 80 ,1 80 .7 7
2, 29 6 ,5 74 .4 3
2, 3 72 ,2 14 .0 2
90 4, 74 3. 86
1, 09 3, 30 9. 9 5
83 5, 42 8 .6 9
78 6, 9 84 .3 1
77 4, 8 83 .5 6
1, 5 97 ,3 46 .9 0
1, 27 8 ,3 50 .9 1
9 2 7, 3 93 .7 4
86 0, 6 79 .7 4
85 1, 83 4 .0 7
± 3 5, 24 8 .2 7
± 4 2, 60 9 .7 6
± 7 0 ,7 9 1 .8 4
± 5 6 ,5 24 .2 1
± 6 4 ,7 51 .3 7
± 16 0, 4 3 4. 9 9 ± 3 36 ,9 80 .3 5 ± 65 6 ,3 45 .5 8 ± 43 6 ,7 72 .4 5 ± 20 5 ,8 78 .2 6
± 64 ,8 81 .3 0
± 72 ,9 82 .6 2
± 31 ,2 6 0. 71
± 15 ,9 09 .2 4 ± 7 ,0 98 .4 5
± 84 ,4 3 0. 89
± 24 7, 3 42 .9 5 ± 6 0 ,7 2 7 .5 1 ± 2 6 ,9 41 .2 2 ± 1 1 ,5 82 .4 1
FR -Z
H 1, 2 76 ,3 5 0 .9 9
1 ,2 8 3 ,5 8 3 .7 0
1 ,1 2 8 ,3 6 1. 7 4
1, 1 26 ,4 7 3 .2 8
1, 1 1 0, 9 46 .6 5
1 ,6 82 ,1 6 7. 79
1, 23 2, 59 9 .0 6
7 95 ,2 1 9 .4 6
78 9 ,0 61 .6 7
81 9 ,5 23 .7 7
79 7 ,1 70 .1 4
95 3 ,2 02 .6 9
7 27 ,2 08 .9 7
6 80 ,3 61 .4 4
67 3, 97 8. 7 2
1, 18 8, 32 0. 74
9 96 ,7 17 .4 4
7 9 8 ,0 48 .5 8
69 8, 0 49 .5 3
69 2, 64 2 .5 2
± 67 ,0 68 .6 4
± 5 2 ,9 6 2 .7 6
± 3 3 ,7 35 .9 6
± 5 5 ,6 10 .4 5
± 4 8, 4 88 .0 7
± 1 20 ,9 9 9. 47
± 1 4 0, 8 3 3. 43
± 2 7 ,7 23 .0 8
± 31 ,8 81 .8 1
± 11 ,4 93 .7 6
± 27 ,5 6 7. 8 1
± 64 ,7 2 5. 30
± 3 8 ,1 76 .4 7 ± 20 ,5 63 .3 6 ± 13 ,3 6 5. 69
± 71 ,0 9 7. 38
± 11 8, 26 0. 78
± 4 7 ,6 30 .6 1 ± 2 2, 47 8 .4 1 ± 1 3 ,7 09 .2 1
R U
-A R
1 ,5 1 4, 66 0 .4 9
1 ,2 38 ,1 5 4 .7 6
8 5 4 ,6 0 5 .6 1
8 48 ,8 16 .0 2
7 82 ,2 1 8 .3 2
1 ,6 5 9 ,4 0 3. 1 9
1, 6 34 ,2 98 .5 8
1, 38 9, 9 21 .8 6
1 ,2 09 ,2 65 .0 5
1, 03 3 ,7 69 .4 0
92 4, 30 3. 4 5
1, 19 3, 23 3. 65
86 0, 1 03 .4 0
81 3, 81 6. 48
78 8, 96 9. 01
1, 4 14 ,1 05 .5 7
1 ,3 24 ,3 15 .2 0
9 4 6, 3 4 5. 1 9
8 93 ,7 2 5. 53
86 0, 82 2 .7 3
± 80 ,2 09 .4 3
± 11 6 ,1 46 .8 3
± 5 6 ,7 6 0 .1 9
± 6 8, 3 3 3 .2 9
± 15 ,1 7 1. 3 8
± 9 6 ,8 66 .4 8
± 3 7 0, 6 34 .4 7 ± 38 5 ,0 05 .3 5 ± 4 97 ,3 97 .1 2 ± 15 9, 22 0 .2 4
± 47 ,5 92 .0 8 ± 10 6, 07 5. 39
± 52 ,0 3 7. 99
± 3 4, 05 0. 28
± 1 5 ,5 02 .4 8
± 10 3, 23 8. 28
± 28 1, 89 7. 9 5 ± 93 ,7 3 1 .5 4 ± 7 6, 92 3. 49
± 24 ,1 95 .8 0
R U
-E N
1 ,5 41 ,2 8 4. 1 9
1 ,0 9 9 ,1 2 4 .5 6
7 86 ,1 71 .9 8
7 9 6 ,8 2 5 .0 8
8 3 8 ,2 9 9 .5 1
1 ,5 38 ,8 6 3 .2 5
1, 1 5 8, 0 53 .1 2
7 64 ,1 7 5. 7 7
78 2 ,6 66 .9 0
75 7 ,0 0 5. 6 2
7 94 ,1 9 6. 11
92 4 ,3 49 .0 4
74 9 ,9 55 .3 5
70 7, 04 3. 65
70 1, 15 4. 52
1, 29 9 ,4 44 .1 0
1, 01 8, 14 8 .8 1
8 11 ,6 14 .4 2
7 31 ,6 8 7. 21
72 3, 71 6. 51
± 30 ,9 75 .3 5
± 31 ,7 2 0 .9 2
± 5 4, 77 7 .8 3
± 6 8, 2 9 5 .5 4
± 97 ,2 98 .9 3
± 2 7 ,2 29 .7 1
± 4 2, 7 67 .5 5
± 6 3, 2 9 8 .6 4
± 75 ,3 48 .2 9
± 82 ,5 5 1. 42
± 23 ,4 2 5. 16
± 51 ,0 03 .3 8
± 3 3 ,2 21 .4 5 ± 12 ,4 23 .9 7 ± 7, 64 5 .5 0
± 7 6 ,5 72 .1 2
± 97 ,5 67 .1 1
± 70 ,6 85 .8 0 ± 1 9 ,9 13 .1 2 ± 10 ,2 10 .8 5
R U
-E S
1, 6 53 ,0 35 .5 3
1, 1 86 ,6 0 9 .0 0
83 6 ,9 04 .9 9
84 4 ,1 07 .6 4
8 7 0 ,9 93 .1 7
1 ,6 60 ,0 6 6 .4 5
1, 2 3 5, 8 09 .7 4
7 84 ,4 14 .7 1
84 2 ,1 04 .2 7
85 5 ,6 56 .7 9
8 96 ,0 72 .5 2
1, 06 5 ,3 27 .2 7
82 9, 51 4. 31
7 93 ,4 61 .6 1
7 86 ,1 02 .5 6
1, 40 4, 52 1. 6 3
1 ,1 8 1, 84 0. 49
9 05 ,8 06 .8 9
8 2 4, 18 7. 74
81 6, 91 9. 61
± 21 ,7 99 .0 4
± 33 ,2 65 .1 2
± 9 2, 1 54 .8 8
± 6 9 ,9 17 .6 3
± 9 0 ,7 5 6. 2 4
± 35 ,1 96 .8 9
± 3 3, 7 13 .1 1
± 4 8 ,8 71 .4 5
± 11 7 ,5 98 .9 5
± 81 ,8 89 .1 1
± 2 3 ,0 48 .9 8
± 7 6 ,3 75 .0 4
± 29 ,9 79 .0 1 ± 10 ,2 24 .6 6 ± 7 ,0 27 .4 6
± 73 ,6 96 .4 9
± 22 0 ,2 98 .1 7 ± 83 ,4 2 8 .8 7 ± 18 ,8 36 .4 1 ± 13 ,5 36 .2 5
R U
-F R
1, 67 1 ,9 1 1. 2 4
1 ,1 48 ,2 37 .2 1
8 13 ,6 3 8. 0 2
82 6 ,7 7 0. 8 3
85 4, 3 81 .9 0
1 ,6 74 ,9 7 0 .5 4
1, 18 7 ,4 57 .1 7
7 6 4 ,8 64 .4 9
78 7, 98 3 .4 7
75 8 ,3 3 3. 45
91 4 ,5 93 .9 8
1, 02 4, 36 9. 0 2
85 9, 69 2. 20
81 9, 75 1. 33
81 3, 33 7. 85
1, 42 8, 27 8 .9 2
1, 20 9, 0 74 .6 2
93 6, 8 67 .2 6
84 0, 76 5 .9 9
8 37 ,6 47 .0 5
± 3 1, 5 14 .5 3
± 30 ,3 2 3 .2 0
± 8 1 ,0 37 .7 3
± 77 ,2 7 2 .1 1
± 47 ,1 6 6 .3 8
± 3 1 ,5 7 7 .2 9
± 2 6 ,9 23 .7 3
± 2 3 ,0 61 .6 4
± 6 0, 11 6 .1 5
± 56 ,6 54 .0 8
± 28 ,9 44 .4 6
± 72 ,8 55 .3 7
± 27 ,8 1 7. 90
± 14 ,1 98 .5 4 ± 9, 2 44 .5 3
± 64 ,9 57 .7 7
± 41 ,1 32 .7 6
± 5 6 ,6 28 .7 6 ± 1 7, 0 96 .9 7 ± 14 ,7 3 2. 39
R U
-Z H
1 ,2 4 8 ,2 8 7 .6 1
1, 33 7 ,5 9 2. 9 0
1 ,1 3 7 ,3 8 0 .3 2
1, 1 3 9, 9 40 .1 2
1, 12 7, 3 0 6. 9 5
1 ,5 7 1 ,1 41 .8 4
1, 1 94 ,3 4 4 .9 8
79 2 ,9 07 .7 0
79 5 ,9 99 .2 6
80 2 ,6 00 .3 3
79 1 ,7 37 .8 0
9 38 ,4 18 .2 8
72 5 ,7 15 .6 5
67 6, 9 71 .7 7
67 1, 00 4 .6 4
1, 1 70 ,3 10 .6 1
1 ,0 83 ,2 9 5. 36
7 92 ,1 7 0. 5 4
6 98 ,5 38 .3 5
69 2, 61 0. 20
± 81 ,8 3 5. 0 9
± 89 ,8 4 9 .9 4
± 44 ,2 3 1 .2 3
± 4 4, 10 6 .7 5
± 2 6, 3 05 .4 7
± 77 ,1 4 5 .4 0
± 1 13 ,4 3 0 .9 7
± 2 4, 98 2 .7 1
± 37 ,6 62 .5 8
± 34 ,0 68 .5 3
± 2 7, 00 3 .0 1
± 71 ,3 92 .0 1
± 29 ,5 8 4. 8 8 ± 12 ,4 3 5. 61
± 10 ,2 50 .3 6
± 2 9 ,2 90 .2 4
± 13 6 ,6 02 .3 0 ± 5 2 ,2 3 8. 92
± 18 ,7 0 9. 40
± 11 ,8 36 .8 6
Z H
-A R
1, 52 0 ,1 3 3 .5 5
1 ,2 5 1, 84 4 .5 4
9 01 ,0 0 3. 6 5
8 7 4 ,4 1 9 .3 6
8 49 ,6 6 7 .8 6
1 ,6 2 4, 2 09 .8 5
1, 45 7 ,7 4 4. 8 0
1 ,2 38 ,0 7 5. 32
1, 0 17 ,9 71 .8 5
89 2 ,8 07 .0 5
91 5 ,2 09 .0 6
1, 1 93 ,4 26 .5 0
86 7, 6 44 .6 9
81 4, 59 9. 04
78 8, 13 3. 05
1, 42 0, 11 8 .8 3
1, 38 7, 88 3 .5 1
9 4 7, 5 9 5. 38
89 1, 41 1. 12
85 8, 11 0. 42
± 83 ,3 0 7 .0 6
± 11 9 ,3 3 1 .9 1
± 1 6 ,8 2 6 .0 4
± 4 9 ,2 41 .5 3
± 5 5 ,5 3 7 .7 2
± 42 ,1 59 .9 8
± 1 41 ,3 0 3 .1 0 ± 2 0 4, 1 95 .1 2 ± 13 7 ,5 3 3. 7 6 ± 10 0 ,5 70 .1 0
± 32 ,3 8 0. 9 6 ± 10 0, 93 3. 92
± 6 1, 38 5. 13
± 3 3 ,9 01 .6 6 ± 14 ,2 47 .7 9
± 12 4, 89 6. 7 3 ± 2 46 ,9 16 .7 7 ± 9 5 ,2 0 7 .4 9 ± 7 5 ,3 78 .1 4 ± 20 ,9 57 .9 7
Z H
-E N
1, 56 2 ,2 1 0 .2 5
1 ,1 68 ,1 66 .6 5
81 4 ,2 23 .1 7
7 70 ,7 0 5. 1 6
7 7 9, 5 4 0. 8 2
1 ,5 51 ,5 13 .4 8
1, 14 1 ,6 88 .2 9
7 9 8 ,0 52 .3 1
7 62 ,0 11 .9 2
8 09 ,9 86 .0 5
82 1 ,9 4 4. 5 8
8 98 ,7 8 2. 12
73 9 ,5 9 5. 7 0
70 5, 83 7. 56
6 99 ,2 72 .8 6
1, 30 7, 17 5. 00
1, 00 9, 10 6. 8 8
8 1 0, 54 2 .1 2
73 2, 93 0. 41
72 0, 82 7 .3 2
± 1 5, 27 2 .7 9
± 4 2 ,4 53 .6 9
± 5 0 ,8 75 .3 9
± 3 0 ,9 58 .0 9
± 5 4, 17 3 .2 9
± 28 ,7 2 6. 7 5
± 43 ,5 8 3 .8 3
± 75 ,5 3 0 .1 7
± 54 ,9 89 .0 5
± 54 ,0 07 .8 6
± 25 ,3 7 8. 46
± 3 5, 48 1 .9 2
± 2 6 ,9 88 .7 4 ± 1 0 ,6 92 .0 2 ± 9, 41 7. 54
± 91 ,6 59 .8 1
± 64 ,1 0 0. 34
± 53 ,3 0 9 .7 5 ± 2 3, 10 7 .2 3 ± 1 0 ,2 43 .0 6
Z H
-E S
1 ,6 69 ,6 28 .6 9
1, 25 7 ,7 03 .2 2
8 7 3 ,5 7 9. 22
8 0 5, 2 16 .8 8
7 67 ,1 72 .7 7
1 ,6 71 ,7 1 7. 6 0
1, 2 0 7, 19 4 .9 8
8 27 ,0 3 7. 5 9
8 15 ,6 60 .8 5
84 4 ,4 27 .4 0
89 7 ,3 03 .5 2
1, 06 4 ,0 57 .7 8
8 35 ,4 22 .1 5
7 92 ,7 67 .5 1
79 0, 34 4. 6 6
1, 41 3, 77 1. 04
1 ,2 1 9, 64 4. 7 7
8 7 3, 8 5 5. 62
8 2 3, 3 66 .5 0
81 7, 53 6. 03
± 32 ,9 9 0 .2 3
± 45 ,7 2 0 .3 3
± 50 ,8 3 6 .7 3
± 5 5, 92 7 .9 1
± 2 9, 21 1 .8 5
± 4 4 ,9 63 .4 4
± 30 ,3 0 9 .2 8
± 5 0, 52 9 .7 6
± 52 ,7 44 .7 3
± 75 ,2 01 .0 8
± 36 ,8 6 0. 2 9
± 71 ,6 3 1. 03
± 3 1 ,1 04 .3 5 ± 10 ,7 98 .3 2 ± 9, 00 3 .4 9
± 89 ,1 7 3. 36
± 14 4, 55 2. 08
± 38 ,1 7 5. 84
± 18 ,5 7 7. 96
± 11 ,5 50 .0 0
Z H
-F R
1 ,6 95 ,4 8 4 .3 4
1 ,2 4 8 ,5 9 5 .7 8
8 47 ,4 61 .9 1
7 6 6 ,0 4 7 .7 6
7 2 2 ,9 3 8 .1 0
1 ,6 9 7, 71 4 .4 9
1, 19 1 ,4 18 .1 3
8 1 5 ,4 63 .3 0
80 8 ,3 8 8 .7 8
82 7 ,6 21 .8 0
92 8 ,0 38 .1 5
1, 02 8, 00 4. 46
85 4, 6 56 .5 5
81 8, 51 3 .5 3
81 4, 32 0 .5 4
1, 4 38 ,4 93 .6 8
1, 20 1, 8 53 .7 3
91 5, 60 3 .5 3
8 43 ,5 13 .4 5
83 4, 85 7 .8 7
± 27 ,1 0 7 .0 5
± 4 8 ,3 2 1 .7 9
± 41 ,0 7 7. 1 7
± 41 ,1 6 2. 8 5
± 32 ,1 8 2 .3 7
± 2 3 ,2 05 .9 4
± 46 ,5 2 9. 3 5
± 69 ,1 39 .0 2
± 45 ,4 59 .6 7
± 39 ,3 7 0. 8 9
± 30 ,1 93 .2 1
± 65 ,0 07 .3 7
± 26 ,5 72 .3 9 ± 14 ,2 0 1. 0 3 ± 13 ,2 7 7. 1 6
± 77 ,0 39 .6 1
± 13 7 ,3 43 .0 7 ± 54 ,1 0 4 .6 8 ± 21 ,7 07 .5 1 ± 1 4, 23 4 .1 3
Z H
-R U
1, 81 3 ,8 30 .2 7
1 ,3 81 ,6 36 .9 3
9 22 ,3 2 8 .2 7
8 2 5 ,8 7 8 .0 6
7 9 3 ,5 0 0 .1 1
2 ,2 63 ,1 12 .0 4
2 ,3 3 2, 00 8 .3 5
2, 0 41 ,3 71 .9 1
2, 19 0 ,2 63 .9 8
1, 5 31 ,6 60 .2 9
89 8, 11 6 .3 1
1, 09 0, 95 7. 6 8
83 1, 15 4. 56
78 5, 88 4. 85
77 7, 64 2. 70
1, 59 8, 14 7 .9 5
1, 27 0, 7 65 .1 8
92 5, 8 64 .5 3
86 0, 6 78 .5 2
84 9, 35 9 .5 8
± 2 5, 06 2 .5 2
± 4 6, 71 1 .3 5
± 4 1 ,9 0 1 .7 2
± 4 7 ,6 65 .7 5
± 4 4 ,1 28 .6 1
± 16 7, 3 5 6. 2 3 ± 2 98 ,7 47 .5 4 ± 52 4, 8 29 .5 9 ± 46 7 ,4 25 .1 2 ± 52 6 ,2 43 .8 4
± 4 3 ,4 71 .2 5
± 73 ,7 82 .6 3
± 32 ,6 2 7. 39
± 14 ,8 83 .9 2 ± 8 ,0 04 .7 7
± 94 ,0 2 3. 22
± 26 2, 5 27 .0 8 ± 5 0 ,8 4 5 .8 0 ± 2 7 ,5 16 .2 6 ± 8, 8 82 .6 0
10 0
1 ,0 00
10 ,0 00
10 0 ,0 00
1 ,0 00 ,0 00
A R
-Z H
_p in
yi n
1, 24 4, 71 9. 00
9 64 ,2 0 6. 32
84 4 ,1 87 .8 5
84 7 ,8 90 .6 9
84 3 ,6 79 .5 2
± 19 ,4 0 4. 8 9
± 62 ,4 4 7. 97
± 33 ,7 7 7. 37
± 37 ,1 72 .7 5
± 46 ,6 88 .2 8
E N
-Z H
_p in
yi n
1, 27 4 ,3 2 6. 3 8
93 5 ,6 34 .7 0
8 97 ,9 91 .3 1
84 8 ,4 01 .4 7
84 4 ,4 40 .4 3
± 6, 44 6. 7 3
± 63 ,1 39 .6 7
± 89 ,8 66 .1 1
± 34 ,8 86 .1 2
± 31 ,0 96 .2 0
E S-
Z H
_p in
yi n
1, 2 23 ,8 92 .6 7
94 7 ,0 71 .2 3
84 4 ,4 16 .8 8
90 2 ,1 42 .5 1
84 2 ,9 15 .1 0
± 2 4 ,2 86 .3 7
± 71 ,6 69 .7 8
± 31 ,4 7 9. 07
± 61 ,2 95 .2 7
± 32 ,9 26 .8 2
FR -Z
H _p
in yi
n 1, 23 7, 6 45 .5 1
9 40 ,6 9 6. 08
86 9 ,3 4 5. 88
88 0 ,9 28 .8 5
82 2 ,5 83 .4 8
± 4 0, 66 8 .8 3
± 6 4, 68 6 .9 3
± 15 ,2 72 .3 9
± 47 ,1 30 .0 9
± 54 ,5 68 .1 8
R U
-Z H
_p in
yi n
1, 22 8, 5 49 .6 7
9 57 ,2 08 .3 4
87 4 ,6 4 9. 15
85 5 ,2 46 .7 8
82 7, 62 0 .6 5
± 3 9, 35 5 .5 3
± 9 1, 71 5 .8 1
± 46 ,1 76 .2 2
± 26 ,9 53 .5 5
± 35 ,3 29 .2 5
A R
-Z H
_w ub
i 1, 40 5, 26 5. 49
1, 57 3 ,5 2 3. 54
1, 4 78 ,0 60 .7 0
1 ,5 34 ,5 23 .8 5
1 ,5 66 ,8 62 .1 4
± 24 ,1 7 7. 9 3
± 1 59 ,5 19 .2 4 ± 20 0, 1 25 .3 6 ± 10 5 ,8 07 .5 2
± 77 ,3 96 .4 0
E N
-Z H
_w ub
i 1, 43 5 ,3 0 5. 5 5
1, 5 70 ,8 71 .9 0
1 ,5 4 2, 5 64 .6 2
1 ,6 21 ,8 05 .8 9
1, 54 1 ,4 17 .8 2
± 52 ,1 71 .9 1
± 10 0, 3 92 .4 5 ± 15 5 ,5 3 4. 95
± 11 0 ,0 98 .1 0 ± 13 5 ,4 53 .1 7
E S-
Z H
_w ub
i 1, 41 8, 6 76 .3 1
1, 69 0 ,0 4 0. 92
1, 3 68 ,2 51 .2 2
1 ,6 01 ,9 82 .5 1
1 ,5 75 ,4 31 .3 6
± 10 ,0 9 4. 8 2
± 4 52 ,3 06 .1 4
± 15 ,4 57 .4 4
± 56 ,5 11 .5 4
± 17 7 ,7 31 .2 7
FR -Z
H _w
ub i
1, 43 9 ,9 4 5. 68
1, 4 99 ,2 77 .0 3
1 ,4 6 6, 5 36 .1 8
1 ,5 28 ,8 45 .7 9
1, 50 0 ,8 04 .9 4
± 41 ,6 47 .3 8
± 14 7, 2 49 .1 0
± 73 ,6 5 5. 57
± 16 4 ,4 14 .4 7 ± 16 4 ,5 99 .2 1
R U
-Z H
_w ub
i 1, 4 30 ,6 59 .3 7
1 ,5 5 4, 0 48 .8 8
1 ,4 52 ,2 4 9. 13
1 ,4 84 ,5 55 .9 6
1 ,4 73 ,1 14 .5 8
± 56 ,2 90 .0 4
± 14 4 ,2 0 0. 65
± 5 0 ,5 14 .3 8
± 19 1 ,4 29 .1 8 ± 18 3 ,7 23 .1 0
E N
-A R
_c p1
25 6
1, 46 5 ,4 8 0. 7 3
1, 1 26 ,4 23 .7 8
81 9 ,1 98 .8 3
89 5 ,1 39 .9 0
84 7 ,4 25 .2 6
± 50 ,4 9 2. 4 6
± 1 37 ,5 98 .5 8
± 39 ,1 91 .9 1
± 47 ,5 55 .7 8
± 54 ,3 55 .6 0
E S-
A R
_c p1
25 6
1, 4 67 ,0 64 .4 8
1 ,1 0 3, 8 60 .6 5
8 22 ,5 23 .1 9
86 5 ,0 80 .0 6
80 7 ,2 04 .2 5
± 68 ,7 19 .7 3
± 15 7, 0 00 .7 0
± 48 ,1 0 8. 48
± 85 ,9 01 .5 8
± 13 ,6 69 .7 3
FR -A
R _c
p1 25
6 1, 45 3 ,8 5 0. 3 3
1, 1 07 ,3 06 .5 0
81 1 ,4 12 .7 8
83 5 ,1 93 .5 9
81 8 ,6 08 .8 4
± 71 ,9 78 .4 5
± 16 4, 3 97 .0 1
± 50 ,2 9 6. 08
± 35 ,4 89 .1 1
± 23 ,6 76 .9 4
R U
-A R
_c p1
25 6
1, 44 3, 1 81 .7 9
1, 16 6 ,9 1 5. 22
78 9 ,2 71 .0 3
77 4 ,2 84 .6 6
79 6 ,7 88 .1 7
± 5 9 ,3 66 .2 4
± 11 8 ,8 6 2. 54
± 8 8 ,8 02 .2 5
± 80 ,7 21 .5 8
± 70 ,3 99 .4 6
Z H
-A R
_c p1
25 6
1, 4 49 ,0 43 .7 8
1 ,1 4 2, 3 24 .0 9
8 57 ,4 47 .9 4
80 4 ,9 67 .7 0
77 8 ,6 55 .5 0
± 6 0 ,4 12 .5 9
± 15 4 ,6 1 8. 66
± 4 9 ,9 44 .5 9
± 49 ,6 61 .8 3
± 6, 40 6 .7 3
A R
-R U
_c p1
25 1
2, 03 3 ,8 4 8. 3 5
1, 4 33 ,3 60 .2 5
87 0 ,3 50 .5 6
78 9 ,4 82 .9 1
81 4 ,3 19 .1 3
± 1 66 ,6 96 .0 8 ± 10 3, 7 44 .5 3 ± 10 4 ,2 4 1. 98
± 3, 27 2 .5 9
± 59 ,5 19 .6 6
E N
-R U
_c p1
25 1
1, 80 5, 6 22 .9 0
1, 30 3 ,1 5 8. 16
86 6 ,8 7 8. 02
91 6 ,4 41 .1 9
1 ,0 08 ,6 44 .1 3
± 29 ,4 1 2. 4 8
± 40 ,2 2 0. 95
± 5 0 ,4 82 .7 9
± 57 ,2 77 .4 6
± 12 1 ,6 22 .3 4
E S-
R U
_c p1
25 1
1, 79 0, 4 25 .6 5
1, 38 6 ,7 0 0. 30
1 ,0 18 ,9 09 .5 5
86 5 ,5 20 .6 1
1 ,2 70 ,1 42 .1 4
± 3 3, 81 8 .4 0
± 14 5, 6 29 .1 5 ± 18 9 ,9 3 4. 38
± 43 ,6 94 .6 6
± 63 5 ,6 45 .0 1
FR -R
U _c
p1 25
1 1, 78 6, 5 97 .2 9
1, 37 0 ,5 2 2. 14
89 1 ,5 3 7. 51
90 3 ,3 89 .3 8
95 5 ,5 77 .8 0
± 31 ,5 5 1. 71
± 68 ,2 4 8. 46
± 7 6 ,4 92 .2 8
± 84 ,8 56 .4 8
± 11 6 ,1 58 .0 1
Z H
-R U
_c p1
25 1
1, 7 86 ,6 34 .0 7
1 ,3 4 3, 0 79 .4 6
8 94 ,8 79 .7 9
90 5 ,8 25 .0 7
85 8 ,4 40 .4 1
± 21 ,3 2 6. 49
± 42 ,1 2 8. 54
± 6 6 ,5 48 .0 0
± 52 ,2 82 .9 1
± 21 ,3 68 .0 0
A R
_c p1
25 6-
R U
_c p1
25 1
1, 82 4, 62 3. 51
1, 37 2 ,5 4 6. 79
88 2 ,3 42 .4 3
88 3 ,4 93 .7 0
93 5 ,9 69 .3 1
± 56 ,8 5 9. 7 7
± 1 25 ,1 15 .3 1
± 54 ,3 41 .1 3
± 95 ,5 77 .2 4
± 98 ,7 65 .6 5
R U
_c p1
25 1-
A R
_c p1
25 6
1, 4 57 ,0 56 .2 4
1 ,1 5 0, 9 43 .3 0
8 56 ,6 51 .6 7
80 0 ,1 29 .5 2
86 0 ,4 62 .6 6
± 61 ,3 87 .3 2
± 12 4, 7 07 .9 9
± 24 ,1 5 9. 92
± 48 ,9 24 .1 4
± 80 ,1 05 .8 3

heading: F CORRELATION STATISTICS
text: Best correlating metrics, i.e. the union of top 3 metrics for all representations. For each representation, the top 3 metrics are boldfaced. All correlations are highly significant (p < 10−30), except for min source length for WORD (p ≈ 0.0001) and min target length for WORD (p ≈ 0.3861).
Metric CHAR Pinyin Wubi BYTE ARRUt ARRUs,t WORD BPE
minimum length (target) 0.84 0.85 0.86 0.60 0.84 0.84 −0.02 0.65 minimum length (source) 0.82 0.84 0.85 0.57 0.84 0.84 0.10 0.64
number of tokens (source) −0.78 −0.81 −0.82 −0.60 −0.81 −0.81 −0.59 −0.83 TTR (target) 0.83 0.83 0.84 0.48 0.81 0.81 0.61 0.83
|V | (source) −0.54 −0.51 −0.51 −0.50 −0.67 −0.68 −0.63 −0.86 data size in lines −0.80 −0.83 −0.83 −0.59 −0.81 −0.81 −0.62 −0.86 OOV token rate (target) 0.69 0.66 0.66 0.47 0.67 0.68 0.66 0.62
OOV type rate (target) 0.70 0.71 0.72 0.47 0.69 0.70 0.65 0.62
TTR (source) 0.67 0.71 0.71 0.60 0.81 0.81 0.56 0.82
The full list of metrics used for the correlation analysis is:
1. minimum length (source), 2. minimum length (target), 3. maximum length (source), 4. maximum length (target), 5. median length (source), 6. median length (target), 7. mean length (source), 8. mean length (target), 9. length std (source),
10. length std (target), 11. data size in lines, 12. number of parameters, 13. number of types (|V |) (source), 14. number of types (|V |) (target), 15. number of tokens (source), 16. number of tokens (target), 17. type-token-ratio (TTR) (source), 18. type-token-ratio (TTR) (target), 19. OOV type rate (source), 20. OOV type rate (target), 21. OOV token rate (source), 22. OOV token rate (target), 23. token ratio, 24. target type-to-parameter ratio, 25. target token-to-parameter ratio, 26. distance between the TTRs of source and target = (1 - TTRsrc/TTRtrg )2, 27. token-to-parameter ratio (i) = (median length source * median length target * num_lines) / num_parameters, 28. token-to-parameter ratio (ii) = (num_source_tokens * num_target_tokens) / num_parameters.

heading: G ENLARGED FIGURES FOR ALL 30 LANGUAGE DIRECTIONS (AGGREGATE RESULTS
text: FROM ALL RUNS)
H SAMPLE FIGURES FROM RUN A0, ALSO SORTED BY SOURCE LANGUAGE FOR CONTRAST

heading: I LANGUAGE PAIRS WITH SIGNIFICANT DIFFERENCES
text: 15 (non-directional) language pairs total possible from 30 language directions, p=0.001.
LANG PAIR CHAR Pinyin Wubi BYTE ARRUt ARRUs,t WORD BPE
AR-EN X X X
AR-ES EN-ES X
AR-FR X EN-FR X X ES-FR
AR-RU X EN-RU X X X X ES-RU X FR-RU X
AR-ZH X X X X X EN-ZH X X ES-ZH X X X FR-ZH X X X X RU-ZH X X X X X
Language pairs with significant differences indicate that the 2 languages are not equally/similarly good or equally/similarly bad.
• Character models with ZH behave differently but the disparity can be eliminated with Pinyin. • Byte models with AR and RU exhibit unstable performance due to length but this can be rectified with
compression on the target side only (ARRUt).
• Word-based models, including BPE, however, consistently favor EN and ZH (though it is more of a “mis-segmentation” for the latter, see § 3 and Appendix J) and disfavor AR and RU (as morphologically complex languages with higher OOV rates).

heading: J LANGUAGE COMPLEXITY
text: In the words of Bentz et al. (2016):
Languages are often compared with regard to their complexity from a computational, theoretical and learning perspective. In computational linguistics, it is generally known that methods mainly developed for the English language do not necessarily transfer well to other languages. The cross-linguistic variation in the amount of information encoded at the level of a word is, for instance, recognized as one of the main challenges for multilingual syntactic parsing (formulated as The Architectural Challenge (Tsarfaty et al., 2013)). Complexity of this kind is also found to influence machine translation: translating from morphologically rich languages into English is easier than the other way around (Koehn, 2005).
*****
Morphology is “the study of the formation and internal structure of words”. Morphemes are “the smallest meaningful units of language”. (Bender, 2013)
*****
AR and RU are traditionally considered morphologically complex (see e.g. Minkov et al. (2007), Seddah et al. (2010) and proceedings of related workshops in subsequent years), and ZH lacking morphological richness (Koehn, 2005). But this definition of morphology is predicated on the notion of word, defined primarily from an alphabetic perspective. As pointed out by Zhang & Komachi (2018), “the important differences between logographic and alphabetic writing systems have long been overlooked”. In logographic languages (i.e. languages with logographic scripts), there can be units within a character that carry semantic and phonetic information that have never been accounted for in the traditional practice of morphology or in the computation of morphological complexity. For example, in the comparison of different morphological complexity measures by Bentz et al. (2016), all measures studied are defined with the notion of word.8 Yet, there is no universally valid definition of a “word” — the form/idea (as in, the philosophical concept) of a “word” may be there for most languages/cultures (though that is certainly also debatable), but its instantiations are different in different languages/cultures, as well as in different genres/settings within one language. The variability in the definition of word is evident in the variation in language-specific word tokenization algorithms, along with the “indeterminacy of word segmentation” or a work-in-progress status for the definition of “word” advocated by Haspelmath (2011), as well as the contested nature of wordhood, esp. for logographic languages such as ZH (see Duanmu (2017) and Li et al. (2019b) for how some ZH speakers do indeed consider a ZH character to be a word or how “word”, as conventionally used in NLP, is not a native term or does not correspond with speakers’ judgement).
Our results with the Transformer indicate that a notion of morphological complexity can be modeled given our word tokenization scheme, confirming that morphological complexity is only predicated on the notion of word and bounded within the word level, and orthogonal to the performance of character or byte models. That is, unless word-based segmentation has been applied, there is no reason to attribute crosslinguistic performance disparity to differences in morphological complexity. In fact, on the character and byte level, we were able to achieve performance without disparity. Hence disparity is not a necessary condition but an expectation that has been in mutual reinforcement with our practice of word segmentation, while the definitions of “morphological complexity” and “word” are in a circular dependency with each other.
In this paper, we resolve language complexity, more specifically that of morphological complexity, in the context of computing through CLMing with the Transformer, in that we explain away the representation granularities and criteria relevant for such calculation.
TLDR: Up to the point of our taking up the subject of language complexity in this paper, there has been not a rigorous definition of “language complexity”. Conventionally, “language complexity” is synonymous to “linguistic complexity” (with the tradition of “linguistics” being primarily word-
8An exception could be that of the type/token ratio (TTR). One could imagine applying TTR on the character level for ZH, and that would be indicative of its morphological richness on the character level. However, that has thus far never been practiced or recognized in NLP.
based), and people just assume linguistic complexity, e.g. morphological/syntactic complexity, to be intrinsic and necessary in languages (across representation levels). Our findings show that linguistic complexity is relative to the representation granularity, i.e. since morphology is based on words, it is bounded to the word level.
*****
An alternative perspective, with finer prints:
We have also developed a more rigorous interpretation. We take on the definition of “language complexity” as one that is related to the statistical attributes of languages. We assume and define solving as the elimination of statistically significant performance disparity.
In larger (6-layer) models, and according to the conventional definition of “language” — i.e. language as a whole, we solved language complexity with compression of AR and RU in byte representations. In smaller (1-layer) models, one can think of the situation as: i) no complexity has been modeled by the Transformer hence there is nothing to solve, or ii) there is no complexity between these languages to begin with, or iii) the Transformer solved the complexity.
With respect to each representation level/granularity in the larger models:
• BYTE: one can think of us as having solved complexity with byte representations or with 1-layer models — for these 6 languages empirically. Theoretically, there could be languages with longer sequence lengths than RU and AR, in those cases, we don’t claim to have solved the matter empirically but only resolved it conceptually. But this is the most that anyone could do at the moment, as there is no relevant parallel data available. • CHARACTER: one can think of us as having solved it via bytes or 1-layer models. Whether
we can be considered to have solved it via Pinyin for ZH depends on whether the evaluator accepts decomposition into a phonetic representation only qualifies as a solution for the ZH language. • WORD: one can think of us as having solved it via bytes or 1-layer models. It is not possible
to solve it strictly within the word level without creating word segmentation criteria that would be unrelatable to native speakers. And since “word” is exclusively a human concept, we must either claim that a universal solution is undefined or undefinable for computing, or retreat to a unit that is the greatest common factor crosslinguistically. Since some ZH speakers consider ZH characters as words, we return to the character-level solution.
It is beyond the scope of our paper to solve the qualitative disparity on the word level. However, we do advocate a more inclusive evaluation and critical reflection on the possibility of discontinuing the usage of “word” as such a non-technical term biases against both “morphologically complex” and “morphologically simple” languages. The world of languages in written form can be divided into those with logographic scripts and those with (phonetic) alphabetic ones, with the unit of character being the greatest common factor of them all, from the human perspective. For technical processing, esp. for fair multilingual sequence-to-sequence modeling with the Transformer, we recommend measures that are more standardized, such as those based on bytes or characters. There is room for improvement in the design of character encoding that complements the statistical profiles, e.g. with relative rank in sequence length, of different languages. We believe there is crosslinguistic systematicity on the character level to be leveraged.
One’s readiness to accept this as a solution to language complexity can be a subjective matter. One may insist that language complexity be solved exclusively with monolingual LMing (which lies outside the scope of the present work), instead of being confounded with the logic of one language being conditional on another. One may also object to the idea of (re-)solving morphological complexity being equivalent to or leading to solving language complexity as a whole, for there could also be e.g. syntactic complexity (although as substantial “information concerning syntactic units and relations is expressed at word level” in morphologically rich languages (Tsarfaty et al., 2010), the boundary between morphology and syntax is less distinct for some languages than others (Haspelmath, 2011)). If, however, our results could be extended, we wonder if syntactic complexity could be due to our sentence segmentation or a combination of word and sentence segmentation practice. That we leave for future work for those who are interested in the topic.

heading: K SAMPLE-WISE DOUBLE DESCENT (DD)
text: K.1 OUR EXPERIMENTAL FRAMEWORK ON DD DATASETS FROM (NAKKIRAN ET AL., 2020)
Text experiments from previous work reporting sample-wise DD involved words (Belkin et al., 2019) and BPEs (Nakkiran et al., 2020).
We applied our experimental framework — by testing data points with 10n lines — on the datasets reported in (Nakkiran et al., 2020) to exhibit DD. WMT’149 EN-FR was reported to demonstrate model-wise DD and IWSLT’14 (Cettolo et al., 2012) DE-EN model-wise and sample-wise DD. We downloaded and prepared the data with scripts10 from the FAIRSEQ Toolkit (Ott et al., 2019). The WMT data was preprocessed with 40,000 BPE operations and IWSLT 10,000. Our focus is on sample-wise DD and hence our goal was to see if the spike at 103 we observed with the UN data would apply also to these datasets. We used the same training regime11 with the Transformer and Adam on SOCKEYE as before and tested both language directions on the entirety of both datasets, with no subsampling. For the IWSLT dataset, we tested data sizes with 102 − 105 lines, then at 160, 239 as that is the total number of lines available. For the WMT dataset, we tested from 102 to 107, then at 35, 762, 532.
This shows that the effect we reported in § 5 also holds on these datasets: “the ratio of target training token count to number of parameters falls into O(10−4) for 102 lines, O(10−3) at 103, O(10−2) at 104, and O(10−1) for 105 lines and so on”.
9http://www.statmt.org/wmt14/translation-task.html 10https://github.com/pytorch/fairseq/blob/master/examples/translation/
prepare-wmt14en2fr.sh and https://github.com/pytorch/fairseq/blob/master/ examples/translation/prepare-iwslt14.sh
11max-seq-len 300; checkpoint-frequency 4000 except for cases where 50 epochs would be reached before the first checkpoint: 400 for 102 lines and 3450 for 103 lines.
K.2 TOKEN-TO-PARAMETER RATIO FOR NON-NEURAL MONOLINGUAL LMS
We experimented also on KenLM (Heafield, 2011; Heafield et al., 2013), a non-neural LM with modified Kneser-Ney smoothing (Kneser & Ney, 1995; Chen & Goodman, 1999), on our dataset A and found that on the word level, such a spike (or a hump) is common across all languages, see Figure 17. The target-token-to-parameter ratio is under 1 for most of these smaller data sizes. This seems related to the analytical findings in Opper et al. (1990) where the pseudo-inverse solution to a simple learning problem was shown to exhibit non-monotonicity, with the peak exactly as the ratio of data to parameters (α) approaches 1.
The number of parameters of a k-gram model is the number of unique n-grams, 1 ≤ n ≤ k. Table 4 shows the ratios for our trigram model (all n-gram models of higher order exhibit the same effect).
On word level, where the function of number of bits to data size is not always monotonic, we observe less of a monotonic development whenever the token-to-parameter ratio is smaller than 1. This is more notably shown in the first 4 sizes in AR with a hump-like curve before the performance improves at 106. This is different from the sharper descent for ES and FR, where only the first two data sizes have a non-monotonic relationship and a token-to-parameter ratio less than 1. Taking the token-to-parameter ratio as a rough proxy for over- (< 1) and under-parameterization (> 1), this can be seen as an instance of non-monotonicity with respect to data size in the “critical regime”, i.e. when the model transitions from being (heavily) over- to under-parameterized (Belkin et al., 2019; Nakkiran, 2019).
A remark on modeling with finer granularity Our KenLM results show the performance of bytes and characters is not on par with that of words with non-neural algorithms. NNs/DL has enabled much progress in this regard.
L N
U M
B E
R O
F M
O D
E L
PA R
A M
E T
E R
S
N um
be ro
fm od
el pa
ra m
et er
s fo
rd at
as et A R ep re se nt at io n C H A R B Y T E W
O R
D B PE N um be ro fl in es 10 0 1, 00 0 10 ,0 0 0 10 0 ,0 0 0 1 ,0 00 ,0 00 10 0 1 ,0 00 10 ,0 00 10 0, 00 0 1 ,0 00 ,0 00 1 00 1 ,0 00 10 ,0 00 10 0 ,0 00 1 ,0 0 0, 00 0 10 0 1 ,0 00 10 ,0 0 0
10 0 ,0 0 0
1 ,0 00 ,0 00
N um
be r
of PA
R A
M S
A R
-E N
44 ,2 2 6 ,6 39
44 ,2 4 5, 5 89
44 ,3 0 9, 11
8 44 ,3 69 ,0 67
44 ,4 8 0 ,2 4 8
4 4 ,2 23 ,0 56
44 ,2 40 ,4 70
44 ,3 04 ,5 15
44 ,3 3 6, 79
5 44 ,3 60 ,8 74
45 ,2 4 7, 14
7 50 ,4 81 ,8 8 5
6 9, 78
4, 81
5 13
2, 4 73 ,2 3 3
3 25 ,7 70 ,3 30
45 ,1 27 ,3 05
49 ,1 70 ,7 3 2
6 3 ,9 0 7, 82
9 86 ,1 55 ,8 52
89 ,2 42 ,5 1 2
A R
-E S
44 ,2 35 ,8 64
44 ,2 5 4 ,8 1 4
44 ,3 00 ,9 18
4 4 ,3 75 ,2 17
44 ,4 90 ,4 98
44 ,2 32 ,2 8 1
44 ,2 49 ,6 95
4 4 ,2 95 ,2 9 0
44 ,3 36 ,7 95
4 4 ,3 60 ,8 74
45 ,2 75 ,8 47
51 ,0 42 ,5 60
72 ,9 6 4, 3 65
14 5 ,0 14 ,1 08
34 6, 63
1, 13
0 45 ,1 43 ,7 0 5
4 9 ,5 56 ,1 32
65 ,8 12 ,2 79
87 ,9 22 ,9 5 2
8 9 ,6 28 ,9 37
A R
-F R
44 ,2 37 ,9 14
44 ,2 58 ,9 1 4
44 ,3 17 ,3 18
44 ,3 7 7 ,2 6 7
44 ,4 92 ,5 48
44 ,2 34 ,3 31
44 ,2 54 ,8 20
44 ,3 0 7, 59
0 44 ,3 38 ,8 45
4 4 ,3 67 ,0 2 4
45 ,3 11 ,7 2 2
51 ,0 8 5, 61
0 71 ,8 18 ,4 15
13 8, 21
9, 38
3 32
1 ,4 11 ,0 05
4 5 ,2 07 ,2 55
49 ,5 1 6, 15
7 65 ,4 51 ,4 7 9
8 7 ,3 95 ,0 7 7
8 9 ,5 1 4, 13 7 A R -R U 44 ,2 47 ,1 39 44 ,2 73 ,2 64 44 ,3 48 ,0 68 44 ,3 8 9, 56 7 44 ,4 96 ,6 48 44 ,2 4 4, 58 1 4 4 ,2 6 9, 17 0 44 ,3 26 ,0 40 44 ,3 42 ,9 45 44 ,3 60 ,8 7 4 45 ,4 56 ,2 4 7 52 ,6 7 6, 4 10 81 ,4 58 ,5 4 0 1 77 ,6 53 ,1 83 44 2 ,2 4 2, 10 5 4 5 ,3 29 ,2 30 50 ,6 7 0, 3 07 71 ,8 72 ,0 7 9 8 9 ,2 87 ,2 27 89 ,9 9 9, 9 87 A R -Z H 44 ,7 66 ,8 14 45 ,4 2 9, 46 4 46 ,5 0 7 ,7 4 3 47 ,6 82 ,8 92 49 ,2 37 ,2 73 4 4 ,2 8 5, 5 81 4 4 ,3 0 2, 99 5 44 ,3 31 ,1 65 4 4 ,3 50 ,1 2 0 44 ,3 88 ,5 49 4 5 ,1 93 ,8 47 50 ,3 68 ,1 10 70 ,9 35 ,8 90 14 2, 39 2 ,1 5 8 3 38 ,1 0 6, 2 05 45 ,2 8 6, 1 80 49 ,1 63 ,5 57 64 ,3 49 ,6 04 87 ,2 8 3, 35 2 89 ,3 24 ,5 1 2 E N -A R 44 ,2 30 ,2 30 44 ,2 5 8, 9 27 44 ,3 2 2, 96 9 44 ,3 73 ,6 84 4 4 ,4 7 7 ,6 8 3 4 4 ,2 21 ,5 17 44 ,2 47 ,1 39 44 ,3 06 ,0 54 4 4 ,3 3 3, 71 7 44 ,3 58 ,8 22 4 5 ,3 43 ,0 78 51 ,8 03 ,3 7 3 7 7 ,0 1 5, 03 7 16 3, 6 29 ,2 6 2 4 19 ,4 03 ,6 03 45 ,1 5 5, 5 20 49 ,8 45 ,3 2 7 6 8 ,0 00 ,0 30 87 ,9 62 ,6 38 89 ,7 00 ,6 2 1 E N -E S 44 ,2 32 ,2 80 44 ,2 41 ,5 0 2 44 ,2 87 ,0 94 4 4 ,3 70 ,6 09 44 ,4 93 ,0 58 44 ,2 33 ,8 1 7 44 ,2 43 ,0 39 4 4 ,2 93 ,7 5 4 44 ,3 39 ,8 67 4 4 ,3 62 ,9 22 45 ,1 8 0, 1 03 49 ,7 23 ,6 48 65 ,7 4 8, 2 37 11 3 ,9 18 ,8 12 25 3, 18 0, 37 8 45 ,1 15 ,5 4 5 4 8 ,8 82 ,8 52 61 ,7 2 8, 0 55 86 ,1 19 ,6 8 8 8 9 ,1 71 ,7 21 E N -F R 44 ,2 34 ,3 30 44 ,2 4 5, 60 2 44 ,3 03 ,4 94 44 ,3 7 2 ,6 5 9 44 ,4 95 ,1 08 44 ,2 35 ,8 67 44 ,2 48 ,1 64 44 ,3 0 6, 05 4 44 ,3 41 ,9 17 4 4 ,3 69 ,0 7 2 45 ,2 15 ,9 7 8 49 ,7 6 6, 69 8 64 ,6 02 ,2 87 10 7, 12 4, 08 7 22 7 ,9 60 ,2 53 4 5 ,1 79 ,0 95 48 ,8 4 2, 87 7 61 ,3 67 ,2 5 5 8 5 ,5 91 ,8 1 3 8 9 ,0 56 ,9 21 E N -R U 44 ,2 43 ,5 55 44 ,2 5 9, 95 2 44 ,3 34 ,2 44 44 ,3 8 4, 95 9 44 ,4 99 ,2 08 44 ,2 4 6, 11 7 4 4 ,2 6 2, 51 4 44 ,3 24 ,5 04 44 ,3 46 ,0 17 44 ,3 62 ,9 2 2 45 ,3 60 ,5 0 3 51 ,3 5 7, 4 98 74 ,2 42 ,4 1 2 1 46 ,5 57 ,8 87 34 8 ,7 9 1, 35 3 4 5 ,3 01 ,0 70 49 ,9 9 7, 0 27 67 ,7 87 ,8 5 5 8 7 ,4 83 ,9 63 89 ,5 4 2, 7 71 E N -Z H 44 ,7 63 ,2 30 45 ,4 1 6, 1 52 4 6 ,4 9 3, 91 9 47 ,6 78 ,2 84 4 9 ,2 39 ,8 33 4 4 ,2 87 ,1 17 44 ,2 9 6, 33 9 44 ,3 29 ,6 29 4 4 ,3 5 3, 19 2 44 ,3 90 ,5 97 4 5 ,0 98 ,1 03 49 ,0 49 ,1 98 63 ,7 19 ,7 62 11 1, 29 6 ,8 6 2 2 44 ,6 5 5, 4 53 45 ,2 5 8, 0 20 48 ,4 90 ,2 77 60 ,2 65 ,3 80 85 ,4 8 0, 08 8 88 ,8 67 ,2 9 6 E SA R 44 ,2 34 ,8 38 44 ,2 63 ,5 35 44 ,3 18 ,8 73 44 ,3 76 ,7 56 4 4 ,4 8 2, 80 3 44 ,2 26 ,1 2 5 44 ,2 51 ,7 47 4 4 ,3 01 ,4 46 44 ,3 3 3, 71 7 44 ,3 58 ,8 22 45 ,3 57 ,4 14 52 ,0 83 ,4 3 7 7 8 ,6 0 3, 26 1 16 9, 8 93 ,5 8 2 4 29 ,8 23 ,8 27 45 ,1 6 3, 7 12 50 ,0 37 ,8 3 9 6 8 ,9 51 ,3 26 88 ,8 45 ,3 26 89 ,8 93 ,6 4 5 E SE N 44 ,2 27 ,6 63 44 ,2 36 ,8 8 5 44 ,2 91 ,1 98 4 4 ,3 67 ,5 31 44 ,4 87 ,9 28 44 ,2 29 ,2 0 0 44 ,2 38 ,4 22 4 4 ,2 98 ,3 7 1 44 ,3 39 ,8 67 4 4 ,3 62 ,9 22 45 ,1 6 5, 7 39 49 ,4 43 ,0 37 64 ,1 5 6, 9 11 10 7 ,6 42 ,2 57 24 2, 73 9, 80 2 45 ,1 07 ,3 3 7 4 8 ,6 89 ,9 64 60 ,7 7 4, 9 01 85 ,2 35 ,2 7 6 8 8 ,9 78 ,3 20 E SFR 44 ,2 38 ,9 3 8 4 4 ,2 50 ,2 1 0 44 ,2 99 ,3 98 44 ,3 7 5 ,7 3 1 44 ,5 00 ,2 28 44 ,2 40 ,4 75 44 ,2 52 ,7 72 44 ,3 0 1, 44 6 44 ,3 41 ,9 17 4 4 ,3 69 ,0 7 2 45 ,2 30 ,3 1 4 50 ,0 4 6, 76 2 66 ,1 90 ,5 11 11 3, 38 8, 40 7 23 8 ,3 80 ,4 77 4 5 ,1 87 ,2 87 49 ,0 3 5, 38 9 62 ,3 18 ,5 5 1 8 6 ,4 74 ,5 0 1 8 9 ,2 49 ,9 45 E SR U 44 ,2 48 ,1 63 44 ,2 64 ,5 6 0 4 4 ,3 30 ,1 48 44 ,3 8 8, 03 1 44 ,5 04 ,3 28 44 ,2 5 0, 72 5 4 4 ,2 67 ,1 2 2 44 ,3 1 9, 89 6 44 ,3 46 ,0 17 44 ,3 62 ,9 2 2 45 ,3 74 ,8 3 9 51 ,6 3 7, 5 62 75 ,8 30 ,6 3 6 1 52 ,8 22 ,2 07 35 9 ,2 1 1, 57 7 4 5 ,3 09 ,2 62 50 ,1 8 9, 5 39 68 ,7 39 ,1 5 1 8 8 ,3 66 ,6 51 89 ,7 3 5, 7 95 E SZ H 44 ,7 67 ,8 38 45 ,4 2 0, 7 60 4 6 ,4 8 9, 82 3 47 ,6 81 ,3 56 4 9 ,2 44 ,9 53 4 4 ,2 91 ,7 25 44 ,3 0 0, 94 7 44 ,3 25 ,0 21 4 4 ,3 5 3, 19 2 44 ,3 90 ,5 97 4 5 ,1 12 ,4 39 49 ,3 29 ,2 62 65 ,3 07 ,9 86 11 7, 56 1 ,1 8 2 2 55 ,0 7 5, 6 77 45 ,2 6 6, 2 12 48 ,6 82 ,7 89 61 ,2 16 ,6 76 86 ,3 6 2, 77 6 89 ,0 60 ,3 2 0 FR -A R 44 ,2 35 ,8 62 44 ,2 65 ,5 83 44 ,3 27 ,0 65 44 ,3 77 ,7 80 4 4 ,4 8 3, 82 7 44 ,2 27 ,1 4 9 44 ,2 54 ,3 07 4 4 ,3 07 ,5 90 44 ,3 3 4, 74 1 44 ,3 61 ,8 94 45 ,3 75 ,3 34 52 ,1 04 ,9 4 1 7 8 ,0 3 0, 84 5 16 6, 4 99 ,5 3 4 4 17 ,2 26 ,0 67 45 ,1 9 5, 4 56 50 ,0 17 ,8 7 1 6 8 ,7 71 ,1 02 88 ,5 81 ,6 46 89 ,8 36 ,3 0 1 FR -E N 44 ,2 28 ,6 87 44 ,2 3 8 ,9 3 3 44 ,2 99 ,3 90 4 4 ,3 68 ,5 55 44 ,4 88 ,9 52 44 ,2 30 ,2 2 4 44 ,2 40 ,9 82 4 4 ,3 04 ,5 1 5 44 ,3 40 ,8 91 4 4 ,3 65 ,9 94 45 ,1 8 3, 6 59 49 ,4 64 ,5 41 63 ,5 8 4, 4 95 10 4 ,2 48 ,2 09 23 0, 14 2, 04 2 45 ,1 39 ,0 8 1 4 8 ,6 69 ,9 96 60 ,5 9 4, 6 77 84 ,9 71 ,5 9 6 8 8 ,9 20 ,9 76 FR -E S 44 ,2 37 ,9 1 2 4 4 ,2 48 ,1 5 8 44 ,2 91 ,1 90 44 ,3 7 4 ,7 0 5 44 ,4 99 ,2 02 44 ,2 39 ,4 49 44 ,2 50 ,2 07 44 ,2 9 5, 29 0 44 ,3 40 ,8 91 4 4 ,3 65 ,9 9 4 45 ,2 12 ,3 5 9 50 ,0 2 5, 21 6 66 ,7 64 ,0 45 11 6, 78 9, 08 4 25 1 ,0 02 ,8 42 4 5 ,1 55 ,4 81 49 ,0 5 5, 39 6 62 ,4 99 ,1 2 7 8 6 ,7 38 ,6 9 6 8 9 ,3 07 ,4 01 FR -R U 44 ,2 49 ,1 87 44 ,2 6 6, 60 8 44 ,3 38 ,3 40 44 ,3 8 9, 05 5 44 ,5 05 ,3 52 44 ,2 5 1, 74 9 4 4 ,2 6 9, 68 2 44 ,3 26 ,0 40 44 ,3 47 ,0 41 44 ,3 65 ,9 9 4 45 ,3 92 ,7 5 9 51 ,6 5 9, 0 66 75 ,2 58 ,2 2 0 1 49 ,4 28 ,1 59 34 6 ,6 1 3, 81 7 4 5 ,3 41 ,0 06 50 ,1 6 9, 5 71 68 ,5 58 ,9 2 7 8 8 ,1 02 ,9 71 89 ,6 7 8, 4 51 FR -Z H 44 ,7 68 ,8 62 45 ,4 22 ,8 08 4 6 ,4 9 8, 01 5 47 ,6 82 ,3 80 4 9 ,2 45 ,9 77 4 4 ,2 92 ,7 49 44 ,3 0 3, 50 7 44 ,3 31 ,1 65 4 4 ,3 5 4, 21 6 44 ,3 93 ,6 69 4 5 ,1 30 ,3 59 49 ,3 50 ,7 66 64 ,7 35 ,5 70 11 4, 16 7 ,1 3 4 2 42 ,4 7 7, 9 17 45 ,2 9 7, 9 56 48 ,6 62 ,8 21 61 ,0 36 ,4 52 86 ,0 9 9, 09 6 89 ,0 02 ,9 7 6 R U -A R 44 ,2 40 ,4 70 44 ,2 72 ,7 51 44 ,3 42 ,4 25 44 ,3 83 ,9 24 4 4 ,4 8 5, 87 5 44 ,2 32 ,2 6 9 44 ,2 61 ,4 75 4 4 ,3 16 ,8 06 44 ,3 3 6, 78 9 44 ,3 58 ,8 22 45 ,4 47 ,5 26 52 ,8 99 ,5 6 5 8 2 ,8 4 6, 20 5 18 6, 1 97 ,1 9 8 4 77 ,5 82 ,6 75 45 ,2 5 6, 3 84 50 ,5 94 ,3 8 3 7 1 ,9 78 ,2 70 89 ,5 26 ,7 98 90 ,0 78 ,9 8 9 R U -E N 44 ,2 33 ,2 95 44 ,2 46 ,1 0 1 44 ,3 14 ,7 50 4 4 ,3 74 ,6 99 44 ,4 91 ,0 00 44 ,2 35 ,3 4 4 44 ,2 48 ,1 50 4 4 ,3 13 ,7 3 1 44 ,3 42 ,9 39 4 4 ,3 62 ,9 22 45 ,2 5 5, 8 51 50 ,2 59 ,1 65 68 ,3 9 9, 8 55 12 3 ,9 45 ,8 73 29 0, 49 8, 65 0 45 ,2 00 ,0 0 9 4 9 ,2 46 ,5 08 63 ,8 0 1, 8 45 85 ,9 16 ,7 4 8 8 9 ,1 63 ,6 64 R U -E S 44 ,2 42 ,5 20 44 ,2 55 ,3 2 6 44 ,3 06 ,5 50 4 4 ,3 80 ,8 49 44 ,5 01 ,2 50 44 ,2 44 ,5 69 44 ,2 57 ,3 75 44 ,3 0 4, 50 6 44 ,3 42 ,9 39 4 4 ,3 62 ,9 22 45 ,2 8 4, 5 51 50 ,8 1 9, 84 0 71 ,5 79 ,4 05 13 6, 48 6, 74 8 31 1 ,3 59 ,4 50 4 5 ,2 16 ,4 09 49 ,6 3 1, 90 8 65 ,7 06 ,2 9 5 8 7 ,6 83 ,8 4 8 8 9 ,5 50 ,0 89 R U -F R 44 ,2 44 ,5 70 44 ,2 5 9, 42 6 44 ,3 22 ,9 50 44 ,3 8 2, 89 9 44 ,5 03 ,3 00 44 ,2 4 6, 61 9 4 4 ,2 6 2, 50 0 44 ,3 16 ,8 06 44 ,3 44 ,9 89 44 ,3 69 ,0 7 2 45 ,3 20 ,4 2 6 50 ,8 6 2, 8 90 70 ,4 33 ,4 5 5 1 29 ,6 92 ,0 23 28 6 ,1 3 9, 32 5 4 5 ,2 79 ,9 59 49 ,5 9 1, 9 33 65 ,3 45 ,4 9 5 8 7 ,1 55 ,9 73 89 ,4 3 5, 2 89 R U -Z H 44 ,7 73 ,4 70 45 ,4 2 9, 9 76 4 6 ,5 1 3, 37 5 47 ,6 88 ,5 24 4 9 ,2 48 ,0 25 4 4 ,2 97 ,8 69 44 ,3 1 0, 67 5 44 ,3 40 ,3 81 4 4 ,3 5 6, 26 4 44 ,3 90 ,5 97 4 5 ,2 02 ,5 51 50 ,1 45 ,3 90 69 ,5 50 ,9 30 13 3, 86 4 ,7 9 8 3 02 ,8 3 4, 5 25 45 ,3 5 8, 8 84 49 ,2 39 ,3 33 64 ,2 43 ,6 20 87 ,0 4 4, 24 8 89 ,2 45 ,6 6 4 Z H -A R 44 ,5 00 ,0 54 44 ,8 5 0, 2 87 45 ,4 2 1, 20 9 46 ,0 28 ,9 80 4 6 ,8 5 3 ,8 7 5 4 4 ,2 52 ,7 49 44 ,2 78 ,3 71 44 ,3 19 ,3 66 4 4 ,3 4 0, 37 3 44 ,3 72 ,6 46 4 5 ,3 16 ,4 54 51 ,7 46 ,5 4 1 7 7 ,5 9 0, 01 3 16 8, 5 83 ,8 8 6 4 25 ,5 65 ,5 23 45 ,2 3 4, 8 80 49 ,8 41 ,7 4 3 6 8 ,2 20 ,7 02 88 ,5 25 ,8 38 89 ,7 41 ,5 8 1 Z H -E N 44 ,4 92 ,8 79 44 ,8 23 ,6 3 7 45 ,3 93 ,5 34 4 6 ,0 19 ,7 55 46 ,8 59 ,0 00 44 ,2 55 ,8 2 4 44 ,2 65 ,0 46 4 4 ,3 16 ,2 9 1 44 ,3 46 ,5 23 4 4 ,3 76 ,7 46 45 ,1 2 4, 7 79 49 ,1 06 ,1 41 63 ,1 4 3, 6 63 10 6 ,3 32 ,5 61 23 8, 48 1, 49 8 45 ,1 78 ,5 0 5 4 8 ,4 93 ,8 68 60 ,0 4 4, 2 77 84 ,9 15 ,7 8 8 8 8 ,8 26 ,2 56 Z H -E S 44 ,5 02 ,1 04 44 ,8 32 ,8 6 2 45 ,3 85 ,3 34 46 ,0 2 5 ,9 0 5 46 ,8 69 ,2 50 44 ,2 65 ,0 49 44 ,2 74 ,2 71 44 ,3 0 7, 06 6 44 ,3 46 ,5 23 4 4 ,3 76 ,7 4 6 45 ,1 53 ,4 7 9 49 ,6 6 6, 81 6 66 ,3 23 ,2 13 11 8, 87 3, 43 6 25 9 ,3 42 ,2 98 4 5 ,1 94 ,9 05 48 ,8 7 9, 26 8 61 ,9 48 ,7 2 7 8 6 ,6 82 ,8 8 8 8 9 ,2 12 ,6 81 Z H -F R 44 ,5 0 4 ,1 54 44 ,8 36 ,9 62 45 ,4 01 ,7 34 46 ,0 2 7, 95 5 46 ,8 71 ,3 00 44 ,2 6 7, 09 9 4 4 ,2 7 9, 39 6 44 ,3 19 ,3 66 44 ,3 48 ,5 73 44 ,3 82 ,8 9 6 45 ,1 89 ,3 5 4 49 ,7 0 9, 8 66 65 ,1 77 ,2 6 3 1 12 ,0 78 ,7 11 23 4 ,1 2 2, 17 3 4 5 ,2 58 ,4 55 48 ,8 3 9, 2 93 61 ,5 87 ,9 2 7 8 6 ,1 55 ,0 13 89 ,0 9 7, 8 81 Z H -R U 44 ,5 13 ,3 79 44 ,8 5 1, 3 12 4 5 ,4 3 2, 48 4 46 ,0 40 ,2 55 4 6 ,8 75 ,4 00 4 4 ,2 77 ,3 49 44 ,2 9 3, 74 6 44 ,3 37 ,8 16 4 4 ,3 5 2, 67 3 44 ,3 76 ,7 46 4 5 ,3 33 ,8 79 51 ,3 00 ,6 66 74 ,8 17 ,3 88 15 1, 51 2 ,5 1 1 3 54 ,9 5 3, 2 73 45 ,3 8 0, 4 30 49 ,9 93 ,4 43 68 ,0 08 ,5 27 88 ,0 4 7, 16 3 89 ,5 83 ,7 3 1
A R
-Z H
_p in
yi n
44 ,2 30 ,7 39
44 ,2 54 ,8 14
44 ,2 90 ,6 68
44 ,3 55 ,7 42
4 4 ,8 0 8, 24 8 E N -Z H _p in yi n 44 ,2 27 ,1 55 44 ,2 41 ,5 02 44 ,2 76 ,8 44 44 ,3 51 ,1 34 4 4 ,8 1 0, 80 8 E SZ H _p in yi n 44 ,2 31 ,7 63 44 ,2 46 ,1 10 44 ,2 72 ,7 48 44 ,3 54 ,2 06 4 4 ,8 1 5, 92 8 FR -Z H _p in yi n 44 ,2 32 ,7 87 44 ,2 48 ,1 58 44 ,2 8 0, 94 0 44 ,3 55 ,2 30 4 4 ,8 1 6, 95 2 R U -Z H _p in yi n 44 ,2 37 ,3 95 44 ,2 55 ,3 26 44 ,2 9 6, 30 0 44 ,3 61 ,3 74 4 4 ,8 1 9, 00 0 A R -Z H _w ub i 44 ,2 52 ,2 64 44 ,2 71 ,2 14 44 ,3 1 0, 14 3 44 ,3 72 ,1 42 4 4 ,7 8 5, 69 8 E N -Z H _w ub i 44 ,2 48 ,6 80 44 ,2 57 ,9 02 44 ,2 9 6, 31 9 44 ,3 67 ,5 34 4 4 ,7 88 ,2 5 8 E SZ H _w ub i 44 ,2 53 ,2 88 44 ,2 62 ,5 10 44 ,2 9 2, 22 3 44 ,3 70 ,6 06 4 4 ,7 93 ,3 7 8 FR -Z H _w ub i 44 ,2 54 ,3 12 44 ,2 64 ,5 58 44 ,3 0 0, 41 5 44 ,3 71 ,6 30 4 4 ,7 94 ,4 0 2 R U -Z H _w ub i 44 ,2 58 ,9 20 44 ,2 71 ,7 26 44 ,3 1 5, 77 5 44 ,3 77 ,7 74 4 4 ,7 96 ,4 5 0 E N -A R _c p1 25 6
44 ,2 30 ,7 4 2
44 ,2 5 9, 43
9 44 ,3 25 ,5 29
44 ,3 6 5, 49
2 44 ,4 37 ,7 47
E S-
A R
_c p1
25 6
44 ,2 35 ,3 5 0
44 ,2 6 4, 04
7 44 ,3 20 ,9 21
44 ,3 6 5, 49
2 44 ,4 37 ,7 47
FR -A
R _c
p1 25
6 44 ,2 36 ,3 7 4
44 ,2 6 6, 60
7 44 ,3 27 ,0 65
44 ,3 6 6, 51
6 44 ,4 40 ,8 19
R U
-A R
_c p1
25 6
44 ,2 41 ,4 9 4
44 ,2 7 3, 77
5 44 ,3 36 ,2 81
44 ,3 6 8, 56
4 44 ,4 37 ,7 47
Z H
-A R
_c p1
25 6
44 ,2 61 ,9 7 4
44 ,2 9 0, 67
1 44 ,3 38 ,8 41
44 ,3 7 2, 14
8 44 ,4 51 ,5 71
A R
-R U
_c p1
25 1
44 ,2 42 ,5 3 1
44 ,2 6 7, 12
0 44 ,3 38 ,3 40
44 ,3 7 3, 69
5 44 ,4 57 ,2 24
E N
-R U
_c p1
25 1
44 ,2 44 ,0 6 7
44 ,2 6 0, 46
4 44 ,3 36 ,8 04
44 ,3 7 6, 76
7 44 ,4 59 ,2 72
E S-
R U
_c p1
25 1
44 ,2 48 ,6 7 5
44 ,2 6 5, 07
2 44 ,3 32 ,1 96
44 ,3 7 6, 76
7 44 ,4 59 ,2 72
FR -R
U _c
p1 25
1 44 ,2 49 ,6 9 9
44 ,2 6 7, 63
2 44 ,3 38 ,3 40
44 ,3 7 7, 79
1 44 ,4 62 ,3 44
Z H
-R U
_c p1
25 1
44 ,2 75 ,2 9 9
44 ,2 9 1, 69
6 44 ,3 50 ,1 16
44 ,3 8 3, 42
3 44 ,4 73 ,0 96
N um
be ro
fm od
el pa
ra m
et er
s fo
rd at
as et
B
R ep
re se
nt at
io n
C H
A R
B Y
T E
W O
R D
B PE
N um
be ro
fl in
es 10
0 1, 00
0 10 ,0 0 0
10 0 ,0 0 0
1 ,0 00 ,0 00
10 0
1 ,0 00
10 ,0 00
10 0, 00
0 1 ,0 00 ,0 00
1 00
1 ,0 00
10 ,0 00
10 0 ,0 00
1 ,0 0 0, 00
0 10
0 1 ,0 00
10 ,0 0 0
10 0 ,0 0 0
1 ,0 00 ,0 00
N um
be r
of PA
R A
M S
A R
-E N
44 ,2 3 0 ,2 24
44 ,2 7 7, 8 63
44 ,3 2 8, 07
1 44 ,4 30 ,0 17
44 ,6 8 0 ,0 2 7
4 4 ,2 33 ,8 11
44 ,2 76 ,8 43
44 ,3 21 ,4 19
44 ,3 5 6, 26
3 44 ,3 85 ,9 77
45 ,5 8 3, 72
8 51 ,7 99 ,6 0 8
7 2, 55
8, 94
4 13
7, 9 25 ,9 8 4
3 47 ,9 56 ,3 40
45 ,3 26 ,1 00
49 ,8 57 ,8 7 6
6 4 ,7 5 8, 28
0 86 ,7 94 ,4 40
89 ,3 54 ,2 3 8
A R
-E S
44 ,2 40 ,4 74
44 ,2 8 2 ,9 8 8
44 ,3 31 ,1 46
4 4 ,4 30 ,0 17
44 ,7 03 ,6 02
44 ,2 44 ,0 6 1
44 ,2 81 ,9 68
4 4 ,3 19 ,3 6 9
44 ,3 54 ,2 13
4 4 ,3 90 ,0 77
45 ,6 80 ,0 78
52 ,4 42 ,2 83
75 ,7 1 0, 8 19
14 6 ,6 61 ,0 34
36 1, 86
5, 59
0 45 ,3 56 ,8 5 0
5 0 ,1 62 ,3 01
66 ,5 75 ,6 05
88 ,0 73 ,6 4 0
8 9 ,6 54 ,5 63
A R
-F R
44 ,2 43 ,5 49
44 ,2 91 ,1 8 8
44 ,3 44 ,4 71
44 ,4 4 3 ,3 4 2
44 ,6 89 ,2 52
44 ,2 46 ,1 11
44 ,2 94 ,2 68
44 ,3 2 8, 59
4 44 ,3 55 ,2 38
4 4 ,3 90 ,0 7 7
45 ,6 64 ,7 0 3
52 ,2 9 9, 80
8 74 ,5 87 ,4 19
14 0, 49
2, 58
4 33
9 ,7 24 ,5 65
4 5 ,3 54 ,8 00
50 ,1 2 6, 42
6 66 ,2 97 ,8 3 0
8 7 ,7 41 ,5 4 0
8 9 ,5 5 1, 03 8 A R -R U 44 ,2 64 ,0 49 44 ,3 21 ,9 38 44 ,3 71 ,1 21 44 ,4 4 5, 39 2 44 ,6 56 ,4 52 44 ,2 6 7, 63 6 4 4 ,3 1 5, 79 3 44 ,3 46 ,0 19 44 ,3 54 ,2 13 44 ,3 84 ,9 5 2 45 ,8 56 ,3 7 8 54 ,2 3 0, 9 08 85 ,1 65 ,4 1 9 1 80 ,0 46 ,3 09 46 1 ,1 6 0, 41 5 4 5 ,5 40 ,3 25 51 ,3 1 4, 4 01 73 ,0 41 ,3 0 5 8 9 ,2 96 ,4 65 90 ,0 0 3, 0 63 A R -Z H 44 ,9 32 ,3 49 45 ,7 9 0, 76 3 46 ,6 5 5 ,8 4 6 47 ,7 87 ,9 17 49 ,1 51 ,0 77 4 4 ,2 7 8, 9 11 4 4 ,3 2 8, 09 3 44 ,3 52 ,1 69 4 4 ,3 68 ,5 6 3 44 ,3 93 ,1 52 4 5 ,6 05 ,2 53 51 ,8 13 ,9 58 73 ,6 39 ,2 94 14 1, 96 8 ,5 8 4 3 47 ,2 1 4, 2 40 45 ,6 1 7, 2 00 50 ,1 74 ,6 01 65 ,0 79 ,1 05 87 ,3 9 8, 16 5 89 ,2 81 ,4 6 3 E N -A R 44 ,2 35 ,8 67 44 ,2 9 5, 8 18 44 ,3 4 7, 05 2 44 ,4 61 ,8 23 4 4 ,7 2 5 ,1 7 1 4 4 ,2 38 ,4 28 44 ,2 87 ,6 16 44 ,3 27 ,5 75 4 4 ,3 5 4, 21 1 44 ,3 85 ,9 77 4 5 ,7 13 ,5 17 53 ,1 18 ,5 3 1 8 0 ,0 2 9, 25 0 16 5, 9 47 ,5 8 3 4 35 ,3 93 ,5 99 45 ,3 3 9, 4 38 50 ,3 70 ,8 7 6 6 8 ,8 84 ,8 52 88 ,2 61 ,6 20 89 ,7 54 ,8 9 1 E N -E S 44 ,2 34 ,8 42 44 ,2 65 ,0 6 8 44 ,3 12 ,2 02 4 4 ,3 98 ,2 73 44 ,6 58 ,5 46 44 ,2 39 ,4 5 3 44 ,2 71 ,2 16 4 4 ,3 13 ,2 2 5 44 ,3 56 ,2 61 4 4 ,3 90 ,0 77 45 ,5 5 0, 5 42 51 ,1 25 ,9 31 68 ,2 5 5, 0 75 11 8 ,6 94 ,0 58 27 4, 59 8, 77 4 45 ,3 43 ,5 3 8 4 9 ,6 50 ,3 01 62 ,4 5 7, 0 77 86 ,6 09 ,3 2 0 8 9 ,2 54 ,6 91 E N -F R 44 ,2 37 ,9 17 44 ,2 7 3, 26 8 44 ,3 25 ,5 27 44 ,4 1 1 ,5 9 8 44 ,6 44 ,1 96 44 ,2 41 ,5 03 44 ,2 83 ,5 16 44 ,3 2 2, 45 0 44 ,3 57 ,2 86 4 4 ,3 90 ,0 7 7 45 ,5 35 ,1 6 7 50 ,9 8 3, 45 6 67 ,1 31 ,6 75 11 2, 52 5, 60 8 25 2 ,4 57 ,7 49 4 5 ,3 41 ,4 88 49 ,6 1 4, 42 6 62 ,1 79 ,3 0 2 8 6 ,2 77 ,2 2 0 8 9 ,1 51 ,1 66 E N -R U 44 ,2 58 ,4 17 44 ,3 0 4, 01 8 44 ,3 52 ,1 77 44 ,4 1 3, 64 8 44 ,6 11 ,3 96 44 ,2 6 3, 02 8 4 4 ,3 0 5, 04 1 44 ,3 39 ,8 75 44 ,3 56 ,2 61 44 ,3 84 ,9 5 2 45 ,7 26 ,8 4 2 52 ,9 1 4, 5 56 77 ,7 09 ,6 7 5 1 52 ,0 79 ,3 33 37 3 ,8 9 3, 59 9 4 5 ,5 27 ,0 13 50 ,8 0 2, 4 01 68 ,9 22 ,7 7 7 8 7 ,8 32 ,1 45 89 ,6 0 3, 1 91 E N -Z H 44 ,9 26 ,7 17 45 ,7 7 2, 8 43 4 6 ,6 3 6, 90 2 47 ,7 56 ,1 73 4 9 ,1 06 ,0 21 4 4 ,2 74 ,3 03 44 ,3 1 7, 34 1 44 ,3 46 ,0 25 4 4 ,3 7 0, 61 1 44 ,3 93 ,1 52 4 5 ,4 75 ,7 17 50 ,4 97 ,6 06 66 ,1 83 ,5 50 11 4, 00 1 ,6 0 8 2 59 ,9 4 7, 4 24 45 ,6 0 3, 8 88 49 ,6 62 ,6 01 60 ,9 60 ,5 77 85 ,9 3 3, 84 5 88 ,8 81 ,5 9 1 E SA R 44 ,2 40 ,9 87 44 ,2 98 ,3 78 44 ,3 48 ,5 88 44 ,4 61 ,8 23 4 4 ,7 3 6, 94 7 44 ,2 43 ,5 4 8 44 ,2 90 ,1 76 4 4 ,3 26 ,5 51 44 ,3 5 3, 18 7 44 ,3 88 ,0 25 45 ,7 61 ,6 45 53 ,4 39 ,5 5 5 8 1 ,6 0 3, 65 0 17 0, 3 10 ,8 4 7 4 42 ,3 41 ,4 39 45 ,3 5 4, 7 98 50 ,5 22 ,9 4 0 6 9 ,7 92 ,6 28 88 ,9 00 ,5 96 89 ,9 04 ,9 0 7 E SE N 44 ,2 29 ,7 12 44 ,2 62 ,5 0 3 44 ,3 10 ,6 63 4 4 ,3 98 ,2 73 44 ,6 46 ,7 47 44 ,2 34 ,3 2 3 44 ,2 68 ,6 51 4 4 ,3 14 ,2 5 1 44 ,3 57 ,2 87 4 4 ,3 88 ,0 25 45 ,5 0 2, 3 20 50 ,8 04 ,2 80 66 ,6 7 7, 6 00 11 4 ,3 22 ,2 72 26 7, 63 7, 36 4 45 ,3 28 ,1 4 8 4 9 ,4 97 ,9 40 61 ,5 4 7, 5 28 85 ,9 69 ,0 9 6 8 9 ,1 04 ,3 82 E SFR 44 ,2 43 ,0 3 7 4 4 ,2 75 ,8 2 8 44 ,3 27 ,0 63 44 ,4 1 1 ,5 9 8 44 ,6 55 ,9 72 44 ,2 46 ,6 23 44 ,2 86 ,0 76 44 ,3 2 1, 42 6 44 ,3 56 ,2 62 4 4 ,3 92 ,1 2 5 45 ,5 83 ,2 9 5 51 ,3 0 4, 48 0 68 ,7 06 ,0 75 11 6, 88 8, 87 2 25 9 ,4 05 ,5 89 4 5 ,3 56 ,8 48 49 ,7 6 6, 49 0 63 ,0 87 ,0 7 8 8 6 ,9 16 ,1 9 6 8 9 ,3 01 ,1 82 E SR U 44 ,2 63 ,5 37 44 ,3 06 ,5 7 8 4 4 ,3 53 ,7 13 44 ,4 1 3, 64 8 44 ,6 23 ,1 72 44 ,2 6 8, 14 8 4 4 ,3 07 ,6 0 1 44 ,3 3 8, 85 1 44 ,3 55 ,2 37 44 ,3 87 ,0 0 0 45 ,7 74 ,9 7 0 53 ,2 3 5, 5 80 79 ,2 84 ,0 7 5 1 56 ,4 42 ,5 97 38 0 ,8 4 1, 43 9 4 5 ,5 42 ,3 73 50 ,9 5 4, 4 65 69 ,8 30 ,5 5 3 8 8 ,4 71 ,1 21 89 ,7 5 3, 2 07 E SZ H 44 ,9 31 ,8 37 45 ,7 7 5, 4 03 4 6 ,6 3 8, 43 8 47 ,7 56 ,1 73 4 9 ,1 17 ,7 97 4 4 ,2 79 ,4 23 44 ,3 1 9, 90 1 44 ,3 45 ,0 01 4 4 ,3 6 9, 58 7 44 ,3 95 ,2 00 4 5 ,5 23 ,8 45 50 ,8 18 ,6 30 67 ,7 57 ,9 50 11 8, 36 4 ,8 7 2 2 66 ,8 9 5, 2 64 45 ,6 1 9, 2 48 49 ,8 14 ,6 65 61 ,8 68 ,3 53 86 ,5 7 2, 82 1 89 ,0 31 ,6 0 7 FR -A R 44 ,2 42 ,5 23 44 ,3 02 ,4 74 44 ,3 55 ,2 44 44 ,4 68 ,4 79 4 4 ,7 2 9, 77 9 44 ,2 44 ,5 7 2 44 ,2 96 ,3 20 4 4 ,3 31 ,1 59 44 ,3 5 3, 69 9 44 ,3 88 ,0 25 45 ,7 53 ,9 65 53 ,3 68 ,3 8 7 8 1 ,0 4 2, 49 8 16 7, 2 29 ,6 3 1 4 31 ,2 81 ,7 27 45 ,3 5 3, 7 74 50 ,5 05 ,0 2 0 6 9 ,6 53 ,8 76 88 ,7 34 ,7 08 89 ,8 53 ,1 9 5 FR -E N 44 ,2 31 ,2 48 44 ,2 6 6 ,5 9 9 44 ,3 17 ,3 19 4 4 ,4 04 ,9 29 44 ,6 39 ,5 79 44 ,2 35 ,3 4 7 44 ,2 74 ,7 95 4 4 ,3 18 ,8 5 9 44 ,3 57 ,7 99 4 4 ,3 88 ,0 25 45 ,4 9 4, 6 40 50 ,7 33 ,1 12 66 ,1 1 6, 4 48 11 1 ,2 41 ,0 56 25 6, 57 7, 65 2 45 ,3 27 ,1 2 4 4 9 ,4 80 ,0 20 61 ,4 0 8, 7 76 85 ,8 03 ,2 0 8 8 9 ,0 52 ,6 70 FR -E S 44 ,2 41 ,4 9 8 4 4 ,2 71 ,7 2 4 44 ,3 20 ,3 94 44 ,4 0 4 ,9 2 9 44 ,6 63 ,1 54 44 ,2 45 ,5 97 44 ,2 79 ,9 20 44 ,3 1 6, 80 9 44 ,3 55 ,7 49 4 4 ,3 92 ,1 2 5 45 ,5 90 ,9 9 0 51 ,3 7 5, 78 7 69 ,2 68 ,3 23 11 9, 97 6, 10 6 27 0 ,4 86 ,9 02 4 5 ,3 57 ,8 74 49 ,7 8 4, 44 5 63 ,2 26 ,1 0 1 8 7 ,0 82 ,4 0 8 8 9 ,3 52 ,9 95 FR -R U 44 ,2 65 ,0 73 44 ,3 1 0, 67 4 44 ,3 60 ,3 69 44 ,4 2 0, 30 4 44 ,6 16 ,0 04 44 ,2 6 9, 17 2 4 4 ,3 1 3, 74 5 44 ,3 43 ,4 59 44 ,3 55 ,7 49 44 ,3 87 ,0 0 0 45 ,7 67 ,2 9 0 53 ,1 6 4, 4 12 78 ,7 22 ,9 2 3 1 53 ,3 61 ,3 81 36 9 ,7 8 1, 72 7 4 5 ,5 41 ,3 49 50 ,9 3 6, 5 45 69 ,6 91 ,8 0 1 8 8 ,3 05 ,2 33 89 ,7 0 1, 4 95 FR -Z H 44 ,9 33 ,3 73 45 ,7 79 ,4 99 4 6 ,6 4 5, 09 4 47 ,7 62 ,8 29 4 9 ,1 10 ,6 29 4 4 ,2 80 ,4 47 44 ,3 2 6, 04 5 44 ,3 49 ,6 09 4 4 ,3 7 0, 09 9 44 ,3 95 ,2 00 4 5 ,5 16 ,1 65 50 ,7 47 ,4 62 67 ,1 96 ,7 98 11 5, 28 3 ,6 5 6 2 55 ,8 3 5, 5 52 45 ,6 1 8, 2 24 49 ,7 96 ,7 45 61 ,7 29 ,6 01 86 ,4 0 6, 93 3 88 ,9 79 ,8 9 5 R U -A R 44 ,2 52 ,7 63 44 ,3 17 ,8 34 44 ,3 68 ,5 56 44 ,4 69 ,5 03 4 4 ,7 1 3, 39 5 44 ,2 55 ,3 2 4 44 ,3 07 ,0 72 4 4 ,3 39 ,8 63 44 ,3 5 3, 18 7 44 ,3 85 ,4 65 45 ,8 49 ,7 09 54 ,3 32 ,9 9 5 8 6 ,3 2 6, 33 8 18 6, 9 87 ,1 9 9 4 91 ,9 40 ,4 15 45 ,4 4 6, 4 46 51 ,0 98 ,4 2 8 7 3 ,0 22 ,3 24 89 ,5 11 ,4 12 90 ,0 78 ,9 8 7 R U -E N 44 ,2 41 ,4 88 44 ,2 81 ,9 5 9 44 ,3 30 ,6 31 4 4 ,4 05 ,9 53 44 ,6 23 ,1 95 44 ,2 46 ,0 9 9 44 ,2 85 ,5 47 4 4 ,3 27 ,5 6 3 44 ,3 57 ,2 87 4 4 ,3 85 ,4 65 45 ,5 9 0, 3 84 51 ,6 97 ,7 20 71 ,4 0 0, 2 88 13 0 ,9 98 ,6 24 31 7, 23 6, 34 0 45 ,4 19 ,7 9 6 5 0 ,0 73 ,4 28 64 ,7 7 7, 2 24 86 ,5 79 ,9 1 2 8 9 ,2 78 ,4 62 R U -E S 44 ,2 51 ,7 38 44 ,2 87 ,0 8 4 44 ,3 33 ,7 06 4 4 ,4 05 ,9 53 44 ,6 46 ,7 70 44 ,2 56 ,3 49 44 ,2 90 ,6 72 44 ,3 2 5, 51 3 44 ,3 55 ,2 37 4 4 ,3 89 ,5 65 45 ,6 8 6, 7 34 52 ,3 4 0, 39 5 74 ,5 52 ,1 63 13 9, 73 3, 67 4 33 1 ,1 45 ,5 90 4 5 ,4 50 ,5 46 50 ,3 7 7, 85 3 66 ,5 94 ,5 4 9 8 7 ,8 59 ,1 1 2 8 9 ,5 78 ,7 87 R U -F R 44 ,2 54 ,8 13 44 ,2 9 5, 28 4 44 ,3 47 ,0 31 44 ,4 1 9, 27 8 44 ,6 32 ,4 20 44 ,2 5 8, 39 9 4 4 ,3 0 2, 97 2 44 ,3 34 ,7 38 44 ,3 56 ,2 62 44 ,3 89 ,5 6 5 45 ,6 71 ,3 5 9 52 ,1 9 7, 9 20 73 ,4 28 ,7 6 3 1 33 ,5 65 ,2 24 30 9 ,0 0 4, 56 5 4 5 ,4 48 ,4 96 50 ,3 4 1, 9 78 66 ,3 16 ,7 7 4 8 7 ,5 27 ,0 12 89 ,4 7 5, 2 62 R U -Z H 44 ,9 43 ,6 13 45 ,7 9 4, 8 59 4 6 ,6 5 8, 40 6 47 ,7 63 ,8 53 4 9 ,0 94 ,2 45 4 4 ,2 91 ,1 99 44 ,3 3 6, 79 7 44 ,3 58 ,3 13 4 4 ,3 6 9, 58 7 44 ,3 92 ,6 40 4 5 ,6 11 ,9 09 51 ,7 12 ,0 70 72 ,4 80 ,6 38 13 5, 04 1 ,2 2 4 3 16 ,4 9 4, 2 40 45 ,7 1 0, 8 96 50 ,3 90 ,1 53 65 ,0 98 ,0 49 87 ,1 8 3, 63 7 89 ,2 05 ,6 8 7 Z H -A R 44 ,5 86 ,5 87 45 ,0 5 1, 5 30 45 ,5 0 9, 80 4 46 ,1 39 ,1 35 4 6 ,9 5 8 ,5 1 5 4 4 ,2 60 ,9 56 44 ,3 13 ,2 16 44 ,3 42 ,9 35 4 4 ,3 6 0, 35 5 44 ,3 89 ,5 61 4 5 ,7 24 ,2 69 53 ,1 25 ,6 9 9 8 0 ,5 6 8, 89 8 16 7, 9 66 ,9 1 1 4 35 ,0 22 ,9 11 45 ,4 8 4, 8 46 50 ,5 29 ,0 8 4 6 9 ,0 45 ,1 08 88 ,5 63 ,1 88 89 ,7 18 ,5 3 9 Z H -E N 44 ,5 75 ,3 12 45 ,0 15 ,6 5 5 45 ,4 71 ,8 79 4 6 ,0 75 ,5 85 46 ,8 68 ,3 15 44 ,2 51 ,7 3 1 44 ,2 91 ,6 91 4 4 ,3 30 ,6 3 5 44 ,3 64 ,4 55 4 4 ,3 89 ,5 61 45 ,4 6 4, 9 44 50 ,4 90 ,4 24 65 ,6 4 2, 8 48 11 1 ,9 78 ,3 36 26 0, 31 8, 83 6 45 ,4 58 ,1 9 6 4 9 ,5 04 ,0 84 60 ,8 0 0, 0 08 85 ,6 31 ,6 8 8 8 8 ,9 18 ,0 14 Z H -E S 44 ,5 85 ,5 62 45 ,0 20 ,7 8 0 45 ,4 74 ,9 54 46 ,0 7 5 ,5 8 5 46 ,8 91 ,8 90 44 ,2 61 ,9 81 44 ,2 96 ,8 16 44 ,3 2 8, 58 5 44 ,3 62 ,4 05 4 4 ,3 93 ,6 6 1 45 ,5 61 ,2 9 4 51 ,1 3 3, 09 9 68 ,7 94 ,7 23 12 0, 71 3, 38 6 27 4 ,2 28 ,0 86 4 5 ,4 88 ,9 46 49 ,8 0 8, 50 9 62 ,6 17 ,3 3 3 8 6 ,9 10 ,8 8 8 8 9 ,2 18 ,3 39 Z H -F R 44 ,5 8 8 ,6 37 45 ,0 28 ,9 80 45 ,4 88 ,2 79 46 ,0 8 8, 91 0 46 ,8 77 ,5 40 44 ,2 6 4, 03 1 4 4 ,3 0 9, 11 6 44 ,3 37 ,8 10 44 ,3 63 ,4 30 44 ,3 93 ,6 6 1 45 ,5 45 ,9 1 9 50 ,9 9 0, 6 24 67 ,6 71 ,3 2 3 1 14 ,5 44 ,9 36 25 2 ,0 8 7, 06 1 4 5 ,4 86 ,8 96 49 ,7 7 2, 6 34 62 ,3 39 ,5 5 8 8 6 ,5 78 ,7 88 89 ,1 1 4, 8 14 Z H -R U 44 ,6 09 ,1 37 45 ,0 5 9, 7 30 4 5 ,5 1 4, 92 9 46 ,0 90 ,9 60 4 6 ,8 44 ,7 40 4 4 ,2 85 ,5 56 44 ,3 3 0, 64 1 44 ,3 55 ,2 35 4 4 ,3 6 2, 40 5 44 ,3 88 ,5 36 4 5 ,7 37 ,5 94 52 ,9 21 ,7 24 78 ,2 49 ,3 23 15 4, 09 8 ,6 6 1 3 73 ,5 2 2, 9 11 45 ,6 7 2, 4 21 50 ,9 60 ,6 09 69 ,0 83 ,0 33 88 ,1 3 3, 71 3 89 ,5 66 ,8 3 9
A R
-Z H
_p in
yi n
44 ,2 25 ,0 99
44 ,2 82 ,9 88
44 ,3 37 ,2 96
44 ,4 83 ,3 17
4 4 ,7 6 9, 20 2 E N -Z H _p in yi n 44 ,2 19 ,4 67 44 ,2 65 ,0 68 44 ,3 18 ,3 52 44 ,4 51 ,5 73 4 4 ,7 2 4, 14 6 E SZ H _p in yi n 44 ,2 24 ,5 87 44 ,2 67 ,6 28 44 ,3 19 ,8 88 44 ,4 51 ,5 73 4 4 ,7 3 5, 92 2 FR -Z H _p in yi n 44 ,2 26 ,1 23 44 ,2 71 ,7 24 44 ,3 2 6, 54 4 44 ,4 58 ,2 29 4 4 ,7 2 8, 75 4 R U -Z H _p in yi n 44 ,2 36 ,3 63 44 ,2 87 ,0 84 44 ,3 3 9, 85 6 44 ,4 59 ,2 53 4 4 ,7 1 2, 37 0 A R -Z H _w ub i 44 ,2 41 ,4 99 44 ,3 03 ,4 88 44 ,3 5 1, 64 6 44 ,4 88 ,4 42 4 4 ,7 5 9, 97 7 E N -Z H _w ub i 44 ,2 35 ,8 67 44 ,2 85 ,5 68 44 ,3 3 2, 70 2 44 ,4 56 ,6 98 4 4 ,7 14 ,9 2 1 E SZ H _w ub i 44 ,2 40 ,9 87 44 ,2 88 ,1 28 44 ,3 3 4, 23 8 44 ,4 56 ,6 98 4 4 ,7 26 ,6 9 7 FR -Z H _w ub i 44 ,2 42 ,5 23 44 ,2 92 ,2 24 44 ,3 4 0, 89 4 44 ,4 63 ,3 54 4 4 ,7 19 ,5 2 9 R U -Z H _w ub i 44 ,2 52 ,7 63 44 ,3 07 ,5 84 44 ,3 5 4, 20 6 44 ,4 64 ,3 78 4 4 ,7 03 ,1 4 5 E N -A R _c p1 25 6
44 ,2 37 ,4 0 3
44 ,2 9 7, 86
6 44 ,3 49 ,1 00
44 ,4 4 8, 51
1 44 ,6 42 ,2 27
E S-
A R
_c p1
25 6
44 ,2 42 ,5 2 3
44 ,3 0 0, 42
6 44 ,3 48 ,0 76
44 ,4 4 7, 48
7 44 ,6 44 ,2 75
FR -A
R _c
p1 25
6 44 ,2 43 ,5 4 7
44 ,3 0 6, 57
0 44 ,3 52 ,6 84
44 ,4 4 7, 99
9 44 ,6 44 ,2 75
R U
-A R
_c p1
25 6
44 ,2 54 ,2 9 9
44 ,3 1 7, 32
2 44 ,3 61 ,3 88
44 ,4 4 7, 48
7 44 ,6 41 ,7 15
Z H
-A R
_c p1
25 6
44 ,2 59 ,9 3 1
44 ,3 2 3, 46
6 44 ,3 64 ,4 60
44 ,4 5 4, 65
5 44 ,6 45 ,8 11
A R
-R U
_c p1
25 1
44 ,2 64 ,5 6 1
44 ,3 1 6, 81
8 44 ,3 60 ,3 69
44 ,3 9 8, 28
8 44 ,5 28 ,4 52
E N
-R U
_c p1
25 1
44 ,2 59 ,9 5 3
44 ,3 0 6, 06
6 44 ,3 54 ,2 25
44 ,4 0 0, 33
6 44 ,5 28 ,4 52
E S-
R U
_c p1
25 1
44 ,2 65 ,0 7 3
44 ,3 0 8, 62
6 44 ,3 53 ,2 01
44 ,3 9 9, 31
2 44 ,5 30 ,5 00
FR -R
U _c
p1 25
1 44 ,2 66 ,0 9 7
44 ,3 1 4, 77
0 44 ,3 57 ,8 09
44 ,3 9 9, 82
4 44 ,5 30 ,5 00
Z H
-R U
_c p1
25 1
44 ,2 82 ,4 8 1
44 ,3 3 1, 66
6 44 ,3 69 ,5 85
44 ,4 0 6, 48
0 44 ,5 32 ,0 36
N um
be ro
fm od
el pa
ra m
et er
s fo
rd at
as et
C
R ep
re se
nt at
io n
C H
A R
B Y
T E
W O
R D
B PE
N um
be ro
fl in
es 10
0 1, 00
0 10 ,0 0 0
10 0 ,0 0 0
1 ,0 00 ,0 00
10 0
1 ,0 00
10 ,0 00
10 0, 00
0 1 ,0 00 ,0 00
1 00
1 ,0 00
10 ,0 00
10 0 ,0 00
1 ,0 0 0, 00
0 10
0 1 ,0 00
10 ,0 0 0
10 0 ,0 0 0
1 ,0 00 ,0 00
N um
be r
of PA
R A
M S
A R
-E N
44 ,2 3 7 ,3 94
44 ,2 7 7, 8 62
44 ,3 1 9, 87
4 44 ,4 32 ,0 62
44 ,6 4 4 ,1 5 4
4 4 ,2 37 ,9 09
44 ,2 76 ,3 31
44 ,3 15 ,7 83
44 ,3 5 2, 67
5 44 ,3 80 ,3 42
45 ,6 3 2, 91
0 51 ,8 78 ,4 8 1
7 2, 59
4, 78
2 13
7, 7 10 ,2 6 5
3 47 ,8 43 ,4 39
45 ,3 72 ,1 98
49 ,9 98 ,2 4 0
6 4 ,7 7 0, 10
0 86 ,7 35 ,5 06
89 ,3 89 ,6 0 3
A R
-E S
44 ,2 43 ,5 44
44 ,2 8 8 ,1 1 2
44 ,3 27 ,0 49
4 4 ,4 32 ,0 62
44 ,6 40 ,0 54
44 ,2 42 ,0 0 9
44 ,2 85 ,5 56
4 4 ,3 17 ,8 3 3
44 ,3 53 ,7 00
4 4 ,3 77 ,2 67
45 ,6 98 ,5 10
52 ,4 53 ,5 06
75 ,8 6 6, 5 82
14 6 ,5 29 ,3 65
36 1, 66
6, 58
9 45 ,3 73 ,2 2 3
5 0 ,2 05 ,2 90
66 ,4 81 ,8 50
88 ,1 37 ,7 0 6
8 9 ,6 50 ,9 78
A R
-F R
44 ,2 46 ,6 19
44 ,2 93 ,2 3 7
44 ,3 33 ,1 99
44 ,4 4 1 ,2 8 7
44 ,6 64 ,6 54
44 ,2 48 ,1 59
44 ,2 90 ,6 81
44 ,3 1 8, 85
8 44 ,3 52 ,6 75
4 4 ,3 81 ,3 6 7
45 ,7 20 ,0 3 5
52 ,3 1 9, 23
1 74 ,5 70 ,9 82
14 0, 33
2, 21
5 33
8 ,9 56 ,6 89
4 5 ,4 24 ,4 73
50 ,2 1 2, 46
5 66 ,1 74 ,3 5 0
8 7 ,7 24 ,6 3 1
8 9 ,5 3 3, 10 3 A R -R U 44 ,2 57 ,8 94 44 ,3 21 ,9 37 44 ,3 61 ,8 99 44 ,4 5 7, 68 7 44 ,6 20 ,5 79 44 ,2 5 7, 38 4 4 4 ,3 1 4, 25 6 44 ,3 39 ,3 58 44 ,3 59 ,8 50 44 ,3 79 ,3 1 7 45 ,8 98 ,3 8 5 54 ,2 5 3, 4 06 85 ,3 60 ,1 3 2 1 80 ,2 06 ,7 65 46 0 ,1 9 8, 81 4 4 5 ,5 77 ,1 98 51 ,4 0 6, 5 90 73 ,2 04 ,8 2 5 8 9 ,3 55 ,4 06 90 ,0 0 3, 5 78 A R -Z H 44 ,9 60 ,0 19 45 ,7 6 6, 16 2 46 ,6 9 4 ,7 9 9 47 ,8 05 ,3 37 49 ,1 41 ,8 54 4 4 ,2 8 6, 0 84 4 4 ,3 2 6, 55 6 44 ,3 47 ,5 58 4 4 ,3 71 ,1 2 5 44 ,3 91 ,6 17 4 5 ,6 08 ,3 10 51 ,8 65 ,1 56 73 ,6 93 ,5 82 14 1, 80 0 ,0 1 5 3 46 ,5 4 3, 7 39 45 ,6 6 1, 2 48 50 ,2 36 ,0 40 65 ,1 94 ,4 50 87 ,4 2 9, 43 1 89 ,2 81 ,9 7 8 E N -A R 44 ,2 47 ,1 41 44 ,2 9 7, 3 56 44 ,3 3 8, 34 2 44 ,4 70 ,5 37 4 4 ,7 0 4 ,1 7 5 4 4 ,2 43 ,5 52 44 ,2 86 ,5 91 44 ,3 22 ,4 52 4 4 ,3 5 3, 18 8 44 ,3 79 ,3 16 4 5 ,7 65 ,7 77 53 ,2 37 ,9 3 1 8 0 ,1 0 4, 07 6 16 5, 7 72 ,9 0 4 4 34 ,7 81 ,0 36 45 ,4 0 4, 0 04 50 ,5 34 ,8 3 8 6 8 ,8 40 ,7 55 88 ,2 26 ,7 97 89 ,7 68 ,7 1 0 E N -E S 44 ,2 33 ,8 16 44 ,2 68 ,6 5 6 44 ,3 08 ,6 17 4 4 ,3 93 ,6 62 44 ,5 80 ,1 50 44 ,2 36 ,3 7 7 44 ,2 75 ,3 16 4 4 ,3 11 ,1 7 7 44 ,3 53 ,1 88 4 4 ,3 78 ,2 91 45 ,5 6 5, 9 02 51 ,0 96 ,7 06 68 ,3 7 1, 9 26 11 8 ,5 21 ,4 29 27 4, 89 8, 46 1 45 ,3 41 ,4 7 9 4 9 ,6 69 ,7 38 62 ,4 1 9, 1 30 86 ,6 49 ,3 2 2 8 9 ,2 72 ,6 10 E N -F R 44 ,2 36 ,8 91 44 ,2 7 3, 78 1 44 ,3 14 ,7 67 44 ,4 0 2 ,8 8 7 44 ,6 04 ,7 50 44 ,2 42 ,5 27 44 ,2 80 ,4 41 44 ,3 1 2, 20 2 44 ,3 52 ,1 63 4 4 ,3 82 ,3 9 1 45 ,5 87 ,4 2 7 50 ,9 6 2, 43 1 67 ,0 76 ,3 26 11 2, 32 4, 27 9 25 2 ,1 88 ,5 61 4 5 ,3 92 ,7 29 49 ,6 7 6, 91 3 62 ,1 11 ,6 3 0 8 6 ,2 36 ,2 4 7 8 9 ,1 54 ,7 35 E N -R U 44 ,2 48 ,1 66 44 ,3 0 2, 48 1 44 ,3 43 ,4 67 44 ,4 1 9, 28 7 44 ,5 60 ,6 75 44 ,2 5 1, 75 2 4 4 ,3 0 4, 01 6 44 ,3 32 ,7 02 44 ,3 59 ,3 38 44 ,3 80 ,3 4 1 45 ,7 65 ,7 7 7 52 ,8 9 6, 6 06 77 ,8 65 ,4 7 6 1 52 ,1 98 ,8 29 37 3 ,4 3 0, 68 6 4 5 ,5 45 ,4 54 50 ,8 7 1, 0 38 69 ,1 42 ,1 0 5 8 7 ,8 67 ,0 22 89 ,6 2 5, 2 10 E N -Z H 44 ,9 50 ,2 91 45 ,7 4 6, 7 06 4 6 ,6 7 6, 36 7 47 ,7 66 ,9 37 4 9 ,0 81 ,9 50 4 4 ,2 80 ,4 52 44 ,3 1 6, 31 6 44 ,3 40 ,9 02 4 4 ,3 7 0, 61 3 44 ,3 92 ,6 41 4 5 ,4 75 ,7 02 50 ,5 08 ,3 56 66 ,1 98 ,9 26 11 3, 79 2 ,0 7 9 2 59 ,7 7 5, 6 11 45 ,6 2 9, 5 04 49 ,7 00 ,4 88 61 ,1 31 ,7 30 85 ,9 4 1, 04 7 88 ,9 03 ,6 1 0 E SA R 44 ,2 50 ,2 13 44 ,3 02 ,4 76 44 ,3 41 ,9 26 44 ,4 70 ,5 37 4 4 ,7 0 2, 12 7 44 ,2 45 ,6 0 0 44 ,2 91 ,1 99 4 4 ,3 23 ,4 76 44 ,3 5 3, 70 0 44 ,3 77 ,7 80 45 ,7 98 ,5 45 53 ,5 25 ,1 6 3 8 1 ,7 3 8, 38 0 17 0, 1 78 ,1 5 2 4 41 ,6 85 ,8 68 45 ,4 0 4, 5 16 50 ,6 38 ,2 6 2 6 9 ,6 95 ,7 95 88 ,9 27 ,2 13 89 ,8 99 ,2 7 0 E SE N 44 ,2 30 ,7 38 44 ,2 63 ,5 2 6 44 ,3 05 ,0 26 4 4 ,3 93 ,6 62 44 ,5 82 ,2 02 44 ,2 34 ,3 2 5 44 ,2 70 ,6 99 4 4 ,3 10 ,1 5 1 44 ,3 52 ,6 75 4 4 ,3 79 ,8 30 45 ,5 3 3, 0 70 50 ,8 08 ,9 13 66 ,7 3 4, 4 30 11 4 ,1 07 ,5 77 26 7, 98 0, 14 3 45 ,3 40 ,9 6 6 4 9 ,5 66 ,1 12 61 ,5 6 2, 4 20 85 ,9 47 ,5 3 8 8 9 ,1 41 ,7 95 E SFR 44 ,2 39 ,9 6 3 4 4 ,2 78 ,9 0 1 44 ,3 18 ,3 51 44 ,4 0 2 ,8 8 7 44 ,6 02 ,7 02 44 ,2 44 ,5 75 44 ,2 85 ,0 49 44 ,3 1 3, 22 6 44 ,3 52 ,6 75 4 4 ,3 80 ,8 5 5 45 ,6 20 ,1 9 5 51 ,2 4 9, 66 3 68 ,7 10 ,6 30 11 6, 72 9, 52 7 25 9 ,0 93 ,3 93 4 5 ,3 93 ,2 41 49 ,7 8 0, 33 7 62 ,9 66 ,6 7 0 8 6 ,9 36 ,6 6 3 8 9 ,2 85 ,2 95 E SR U 44 ,2 51 ,2 38 44 ,3 07 ,6 0 1 4 4 ,3 47 ,0 51 44 ,4 1 9, 28 7 44 ,5 58 ,6 27 44 ,2 5 3, 80 0 4 4 ,3 08 ,6 2 4 44 ,3 3 3, 72 6 44 ,3 59 ,8 50 44 ,3 78 ,8 0 5 45 ,7 98 ,5 4 5 53 ,1 8 3, 8 38 79 ,4 99 ,7 8 0 1 56 ,6 04 ,0 77 38 0 ,3 3 5, 51 8 4 5 ,5 45 ,9 66 50 ,9 7 4, 4 62 69 ,9 97 ,1 4 5 8 8 ,5 67 ,4 38 89 ,7 5 5, 7 70 E SZ H 44 ,9 53 ,3 63 45 ,7 5 1, 8 26 4 6 ,6 7 9, 95 1 47 ,7 66 ,9 37 4 9 ,0 79 ,9 02 4 4 ,2 82 ,5 00 44 ,3 2 0, 92 4 44 ,3 41 ,9 26 4 4 ,3 7 1, 12 5 44 ,3 91 ,1 05 4 5 ,5 08 ,4 70 50 ,7 95 ,5 88 67 ,8 33 ,2 30 11 8, 19 7 ,3 2 7 2 66 ,6 8 0, 4 43 45 ,6 3 0, 0 16 49 ,8 03 ,9 12 61 ,9 86 ,7 70 86 ,6 4 1, 46 3 89 ,0 34 ,1 7 0 FR -A R 44 ,2 51 ,7 49 44 ,3 05 ,0 36 44 ,3 44 ,9 98 44 ,4 75 ,1 45 4 4 ,7 1 4, 41 5 44 ,2 48 ,6 7 2 44 ,2 93 ,7 59 4 4 ,3 23 ,9 88 44 ,3 5 3, 18 8 44 ,3 79 ,8 28 45 ,8 09 ,2 97 53 ,4 58 ,0 9 1 8 1 ,0 9 1, 21 2 16 7, 0 82 ,6 0 0 4 30 ,3 41 ,9 96 45 ,4 3 0, 1 16 50 ,6 41 ,8 4 6 6 9 ,5 42 ,1 95 88 ,7 20 ,8 77 89 ,8 40 ,3 9 0 FR -E N 44 ,2 32 ,2 74 44 ,2 6 6 ,0 8 6 44 ,3 08 ,0 98 4 4 ,3 98 ,2 70 44 ,5 94 ,4 90 44 ,2 37 ,3 9 7 44 ,2 73 ,2 59 4 4 ,3 10 ,6 6 3 44 ,3 52 ,1 63 4 4 ,3 81 ,8 78 45 ,5 4 3, 8 22 50 ,7 41 ,8 41 66 ,0 8 7, 2 62 11 1 ,0 12 ,0 25 25 6, 63 6, 27 1 45 ,3 66 ,5 6 6 4 9 ,5 69 ,6 96 61 ,4 0 8, 8 20 85 ,7 41 ,2 0 2 8 9 ,0 82 ,9 15 FR -E S 44 ,2 38 ,4 2 4 4 4 ,2 76 ,3 3 6 44 ,3 15 ,2 73 44 ,3 9 8 ,2 7 0 44 ,5 90 ,3 90 44 ,2 41 ,4 97 44 ,2 82 ,4 84 44 ,3 1 2, 71 3 44 ,3 53 ,1 88 4 4 ,3 78 ,8 0 3 45 ,6 09 ,4 2 2 51 ,3 1 6, 86 6 69 ,3 59 ,0 62 11 9, 83 1, 12 5 27 0 ,4 59 ,4 21 4 5 ,3 67 ,5 91 49 ,7 7 6, 74 6 63 ,1 20 ,5 7 0 8 7 ,1 43 ,4 0 2 8 9 ,3 44 ,2 90 FR -R U 44 ,2 52 ,7 74 44 ,3 1 0, 16 1 44 ,3 50 ,1 23 44 ,4 2 3, 89 5 44 ,5 70 ,9 15 44 ,2 5 6, 87 2 4 4 ,3 1 1, 18 4 44 ,3 34 ,2 38 44 ,3 59 ,3 38 44 ,3 80 ,8 5 3 45 ,8 09 ,2 9 7 53 ,1 1 6, 7 66 78 ,8 52 ,6 1 2 1 53 ,5 08 ,5 25 36 8 ,9 9 1, 64 6 4 5 ,5 71 ,5 66 50 ,9 7 8, 0 46 69 ,8 43 ,5 4 5 8 8 ,3 61 ,1 02 89 ,6 9 6, 8 90 FR -Z H 44 ,9 54 ,8 99 45 ,7 54 ,3 86 4 6 ,6 8 3, 02 3 47 ,7 71 ,5 45 4 9 ,0 92 ,1 90 4 4 ,2 85 ,5 72 44 ,3 2 3, 48 4 44 ,3 42 ,4 38 4 4 ,3 7 0, 61 3 44 ,3 93 ,1 53 4 5 ,5 19 ,2 22 50 ,7 28 ,5 16 67 ,1 86 ,0 62 11 5, 10 1 ,7 7 5 2 55 ,3 3 6, 5 71 45 ,6 5 5, 6 16 49 ,8 07 ,4 96 61 ,8 33 ,1 70 86 ,4 3 5, 12 7 88 ,9 75 ,2 9 0 R U -A R 44 ,2 57 ,3 81 44 ,3 19 ,3 72 44 ,3 59 ,3 34 44 ,4 83 ,3 37 4 4 ,6 9 2, 39 9 44 ,2 53 ,2 8 0 44 ,3 05 ,5 35 4 4 ,3 34 ,2 28 44 ,3 5 6, 77 2 44 ,3 78 ,8 04 45 ,8 98 ,3 85 54 ,4 24 ,2 3 5 8 6 ,4 8 0, 52 4 18 7, 0 00 ,4 2 4 4 90 ,9 03 ,9 16 45 ,5 0 6, 4 04 51 ,2 38 ,3 2 6 7 3 ,0 54 ,0 03 89 ,5 35 ,4 69 90 ,0 75 ,3 9 8 R U -E N 44 ,2 37 ,9 06 44 ,2 80 ,4 2 2 44 ,3 22 ,4 34 4 4 ,4 06 ,4 62 44 ,5 72 ,4 74 44 ,2 42 ,0 0 5 44 ,2 85 ,0 35 4 4 ,3 20 ,9 0 3 44 ,3 55 ,7 47 4 4 ,3 80 ,8 54 45 ,6 3 2, 9 10 51 ,7 07 ,9 85 71 ,4 7 6, 5 74 13 0 ,9 29 ,8 49 31 7, 19 8, 19 1 45 ,4 42 ,8 5 4 5 0 ,1 66 ,1 76 64 ,9 2 0, 6 28 86 ,5 55 ,7 9 4 8 9 ,3 17 ,9 23 R U -E S 44 ,2 44 ,0 56 44 ,2 90 ,6 7 2 44 ,3 29 ,6 09 4 4 ,4 06 ,4 62 44 ,5 68 ,3 74 44 ,2 46 ,1 05 44 ,2 94 ,2 60 44 ,3 2 2, 95 3 44 ,3 56 ,7 72 4 4 ,3 77 ,7 79 45 ,6 9 8, 5 10 52 ,2 8 3, 01 0 74 ,7 48 ,3 74 13 9, 74 8, 94 9 33 1 ,0 21 ,3 41 4 5 ,4 43 ,8 79 50 ,3 7 3, 22 6 66 ,6 32 ,3 7 8 8 7 ,9 57 ,9 9 4 8 9 ,5 79 ,2 98 R U -F R 44 ,2 47 ,1 31 44 ,2 9 5, 79 7 44 ,3 35 ,7 59 44 ,4 1 5, 68 7 44 ,5 92 ,9 74 44 ,2 5 2, 25 5 4 4 ,2 9 9, 38 5 44 ,3 23 ,9 78 44 ,3 55 ,7 47 44 ,3 81 ,8 7 9 45 ,7 20 ,0 3 5 52 ,1 4 8, 7 35 73 ,4 52 ,7 7 4 1 33 ,5 51 ,7 99 30 8 ,3 1 1, 44 1 4 5 ,4 95 ,1 29 50 ,3 8 0, 4 01 66 ,3 24 ,8 7 8 8 7 ,5 44 ,9 19 89 ,4 6 1, 4 23 R U -Z H 44 ,9 60 ,5 31 45 ,7 6 8, 7 22 4 6 ,6 9 7, 35 9 47 ,7 79 ,7 37 4 9 ,0 70 ,1 74 4 4 ,2 90 ,1 80 44 ,3 3 5, 26 0 44 ,3 52 ,6 78 4 4 ,3 7 4, 19 7 44 ,3 92 ,1 29 4 5 ,6 08 ,3 10 51 ,6 94 ,6 60 72 ,5 75 ,3 74 13 5, 01 9 ,5 9 9 3 15 ,8 9 8, 4 91 45 ,7 3 1, 9 04 50 ,4 03 ,9 76 65 ,3 44 ,9 78 87 ,2 4 9, 71 9 89 ,2 10 ,2 9 8 Z H -A R 44 ,6 08 ,1 01 45 ,0 4 0, 7 80 45 ,5 2 4, 64 6 46 ,1 55 ,5 29 4 6 ,9 5 0 ,8 3 1 4 4 ,2 67 ,6 16 44 ,3 11 ,6 79 44 ,3 38 ,3 24 4 4 ,3 6 2, 40 4 44 ,3 84 ,9 48 4 5 ,7 53 ,4 89 53 ,2 31 ,2 7 5 8 0 ,6 5 2, 94 0 16 7, 8 15 ,7 8 4 4 34 ,1 31 ,8 20 45 ,5 4 8, 3 88 50 ,6 53 ,6 2 2 6 9 ,0 52 ,7 23 88 ,5 73 ,4 21 89 ,7 14 ,9 5 0 Z H -E N 44 ,5 88 ,6 26 45 ,0 01 ,8 3 0 45 ,4 87 ,7 46 4 6 ,0 78 ,6 54 46 ,8 30 ,9 06 44 ,2 56 ,3 4 1 44 ,2 91 ,1 79 4 4 ,3 24 ,9 9 9 44 ,3 61 ,3 79 4 4 ,3 86 ,9 98 45 ,4 8 8, 0 14 50 ,5 15 ,0 25 65 ,6 4 8, 9 90 11 1 ,7 45 ,2 09 26 0, 42 6, 09 5 45 ,4 84 ,8 3 8 4 9 ,5 81 ,4 72 60 ,9 1 9, 3 48 85 ,5 93 ,7 4 6 8 8 ,9 57 ,4 75 Z H -E S 44 ,5 94 ,7 76 45 ,0 12 ,0 8 0 45 ,4 94 ,9 21 46 ,0 7 8 ,6 5 4 46 ,8 26 ,8 06 44 ,2 60 ,4 41 44 ,3 00 ,4 04 44 ,3 2 7, 04 9 44 ,3 62 ,4 04 4 4 ,3 83 ,9 2 3 45 ,5 53 ,6 1 4 51 ,0 9 0, 05 0 68 ,9 20 ,7 90 12 0, 56 4, 30 9 27 4 ,2 49 ,2 45 4 5 ,4 85 ,8 63 49 ,7 8 8, 52 2 62 ,6 31 ,0 9 8 8 6 ,9 95 ,9 4 6 8 9 ,2 18 ,8 50 Z H -F R 44 ,5 9 7 ,8 51 45 ,0 17 ,2 05 45 ,5 01 ,0 71 46 ,0 8 7, 87 9 46 ,8 51 ,4 06 44 ,2 6 6, 59 1 4 4 ,3 0 5, 52 9 44 ,3 28 ,0 74 44 ,3 61 ,3 79 44 ,3 88 ,0 2 3 45 ,5 75 ,1 3 9 50 ,9 5 5, 7 75 67 ,6 25 ,1 9 0 1 14 ,3 67 ,1 59 25 1 ,5 3 9, 34 5 4 5 ,5 37 ,1 13 49 ,7 9 5, 6 97 62 ,3 23 ,5 9 8 8 6 ,5 82 ,8 71 89 ,1 0 0, 9 75 Z H -R U 44 ,6 09 ,1 26 45 ,0 4 5, 9 05 4 5 ,5 2 9, 77 1 46 ,1 04 ,2 79 4 6 ,8 07 ,3 31 4 4 ,2 75 ,8 16 44 ,3 2 9, 10 4 44 ,3 48 ,5 74 4 4 ,3 6 8, 55 4 44 ,3 85 ,9 73 4 5 ,7 53 ,4 89 52 ,8 89 ,9 50 78 ,4 14 ,3 40 15 4, 24 1 ,7 0 9 3 72 ,7 8 1, 4 70 45 ,6 8 9, 8 38 50 ,9 89 ,8 22 69 ,3 54 ,0 73 88 ,2 1 3, 64 6 89 ,5 71 ,4 5 0
A R
-Z H
_p in
yi n
44 ,2 33 ,2 94
44 ,2 87 ,0 87
44 ,3 33 ,1 99
44 ,4 87 ,4 12
4 4 ,7 4 9, 72 9 E N -Z H _p in yi n 44 ,2 23 ,5 66 44 ,2 67 ,6 31 44 ,3 14 ,7 67 44 ,4 49 ,0 12 4 4 ,6 8 9, 82 5 E SZ H _p in yi n 44 ,2 26 ,6 38 44 ,2 72 ,7 51 44 ,3 18 ,3 51 44 ,4 49 ,0 12 4 4 ,6 8 7, 77 7 FR -Z H _p in yi n 44 ,2 28 ,1 74 44 ,2 75 ,3 11 44 ,3 2 1, 42 3 44 ,4 53 ,6 20 4 4 ,7 0 0, 06 5 R U -Z H _p in yi n 44 ,2 33 ,8 06 44 ,2 89 ,6 47 44 ,3 3 5, 75 9 44 ,4 61 ,8 12 4 4 ,6 7 8, 04 9 A R -Z H _w ub i 44 ,2 54 ,8 19 44 ,3 09 ,6 37 44 ,3 4 8, 57 4 44 ,4 89 ,4 62 4 4 ,7 4 4, 60 4 E N -Z H _w ub i 44 ,2 45 ,0 91 44 ,2 90 ,1 81 44 ,3 3 0, 14 2 44 ,4 51 ,0 62 4 4 ,6 84 ,7 0 0 E SZ H _w ub i 44 ,2 48 ,1 63 44 ,2 95 ,3 01 44 ,3 3 3, 72 6 44 ,4 51 ,0 62 4 4 ,6 82 ,6 5 2 FR -Z H _w ub i 44 ,2 49 ,6 99 44 ,2 97 ,8 61 44 ,3 3 6, 79 8 44 ,4 55 ,6 70 4 4 ,6 94 ,9 4 0 R U -Z H _w ub i 44 ,2 55 ,3 31 44 ,3 12 ,1 97 44 ,3 5 1, 13 4 44 ,4 63 ,8 62 4 4 ,6 72 ,9 2 4 E N -A R _c p1 25 6
44 ,2 48 ,6 7 7
44 ,2 9 9, 91
6 44 ,3 40 ,9 02
44 ,4 5 6, 71
3 44 ,6 36 ,5 91
E S-
A R
_c p1
25 6
44 ,2 50 ,7 2 5
44 ,3 0 4, 52
4 44 ,3 41 ,9 26
44 ,4 5 7, 22
5 44 ,6 35 ,0 55
FR -A
R _c
p1 25
6 44 ,2 53 ,7 9 7
44 ,3 0 7, 08
4 44 ,3 42 ,4 38
44 ,4 5 6, 71
3 44 ,6 37 ,1 03
R U
-A R
_c p1
25 6
44 ,2 58 ,4 0 5
44 ,3 1 8, 86
0 44 ,3 52 ,6 78
44 ,4 6 0, 29
7 44 ,6 36 ,0 79
Z H
-A R
_c p1
25 6
44 ,2 72 ,7 4 1
44 ,3 2 5, 00
4 44 ,3 56 ,7 74
44 ,4 6 5, 92
9 44 ,6 42 ,2 23
A R
-R U
_c p1
25 1
44 ,2 55 ,3 3 4
44 ,3 1 5, 28
1 44 ,3 52 ,6 83
44 ,4 0 5, 97
5 44 ,4 92 ,0 67
E N
-R U
_c p1
25 1
44 ,2 49 ,7 0 2
44 ,3 0 5, 04
1 44 ,3 46 ,0 27
44 ,4 0 5, 46
3 44 ,4 93 ,0 91
E S-
R U
_c p1
25 1
44 ,2 51 ,7 5 0
44 ,3 0 9, 64
9 44 ,3 47 ,0 51
44 ,4 0 5, 97
5 44 ,4 91 ,5 55
FR -R
U _c
p1 25
1 44 ,2 54 ,8 2 2
44 ,3 1 2, 20
9 44 ,3 47 ,5 63
44 ,4 0 5, 46
3 44 ,4 93 ,6 03
Z H
-R U
_c p1
25 1
44 ,2 73 ,7 6 6
44 ,3 3 0, 12
9 44 ,3 61 ,8 99
44 ,4 1 4, 67
9 44 ,4 98 ,7 23

heading: M ERRATICITY
text: Length has been an issue since the dawn of the encoder-decoder approach for NMT (Cho et al., 2014). Most work on length bias, except for that by e.g. Sountsov & Sarawagi (2016), seems to have focused on the evaluation of generated translation output and monitored performance degradation with respect to sequence length, often arguing that beam size plays a role (Koehn & Knowles, 2017; Murray & Chiang, 2018). (Related work in Stahlberg & Byrne (2019) provides a good summary on this issue.) While there could also be confounds in search, our experiments show that a kind of length bias can surface already with CLMing, without generation taking place. To our knowledge, length bias has not been expressed as a sample-wise non-monotonicity across a large data size range as ours. While the connection between erraticity in CLMs and length bias in NMT models remains to be verified on a case-by-case basis, the knowledge of length also contributing to robustness (not just consistently poor/poorer performance) could support further experimentation/replication of any study. Failed attempts to reproduce results may be explainable by erraticity.
One may argue that erraticity may not be relevant when each model is more optimally trained (as opposed to being treated with our one-setting-for-all regime). But we do want to stress that this very stark contrast between erratic and non-erratic behavior is possible, prompting a question on fairness: is there a one-for-all setting under which the languages with non-erratic behavior shown in our study would demonstrate erraticity and vice versa?
To the best of our knowledge, the meta phenomenon of erraticity, as a sample-wise non-monotonicity measured intrinsically with cross-entropy and contributing to large variance across runs, is a novel and original discovery and contribution to research in robustness. We hope our work would inspire further evaluation on other models/architectures, reflection and theories on our assumption of unbounded computation (e.g. Xu et al. (2020)), as well as new understanding and solutions that take data statistics and realistic computational aspects into account. We defer a more comprehensive analysis of erraticity with further experiments to future work.
M.1 ERRATICITY AS LARGE VARIANCE: EVIDENCE FROM DIFFERENT RUNS OF THE SAME DATA
To confirm that erraticity is not due to data-specific reasons, e.g. when certain data segments might be “easier” to model than others, we show figures from 2 runs (Figs. 18a and 18b) on the same dataset of wildly differing performance that only differ in seed. Note that changes in the y-direction can vary much, indicating large variance across runs.
By establishing that high variance holds across sample sizes, we showcased how it’d be possible to just test on 2 or 3 data points of smaller sizes to get a gauge on the robustness in higher order. It serves as a signal of when the system is being “stress-tested” and hyperparameters need re-tuning. Spot-testing on a couple of smaller data sizes can indeed save much time and energy. Take our run B0 byte models as an example: the training of the 102-line model for EN-RU took 15 minutes, 103 40 minutes, 104 1 hour 50 minutes, and 105 3 hours 36 minutes. One can imagine how these would just be a fraction of training time for bigger models. (Likewise, for our ratio of target training token count to number of parameters — knowing when a representation might be prone to DD within a data size range could help prevent practitioners from prematurely declaring experimental results as negative or from unnecessarily rerunning an experiment because bigger data did not lead to better results.)
M.2 ADDITIONAL EXPERIMENT WITH LENGTH FILTERING TO 300 BYTES
Figure 19a and 19b show results of additional experiment with subset of data in byte (UTF-8) representation length-filtered to 300, including dev data:
Erraticity remains for AR and RU. Scores are lower, though they cannot be compared with the experiments in the main paper due to difference in dev data size (3,077 lines vs. 1,804 lines here). Number of total lines for train is 5,533,672 lines for each language, from which we took the initial 102-106. As in our main experiments, we filtered out only whole lines, i.e. not by discarding the tails of longer lines. 300 bytes aren’t long sequences, but without data transform or hyperparameter tuning, things can look unfair. The EN translation of the longest RU line in this dataset is: “47. It is
noted that there is a lack of information provided by the Government of Trinidad and Tobago with regard to the legal status of the Convention in the domestic legislation.”

heading: N EXPERIMENTS WITH ONE-LAYER TRANSFORMER
text: We performed 1 run with dataset A in 4 sizes (102-105 lines, seed=13) with the primary representations of characters, bytes, and words, on 1-layer Transformers (num-layers 1:1, all other hyperparameters remain the same as for our main experiments). We compared this against run A0 in 4 sizes with the same seed. (Based on how our null hypothesis is set up, the higher the number of runs, the more likely it is for there to be disparity. Important is that we evaluate based on an equal number of runs and on the same data for all candidates.) Results are shown in Table 5 with no statistically significant disparity observed on the models trained with 1 layer across the board.
Many are under the impression that big data is the cause to the neutralization of language instances in DL/NNs. But, as this set of experiments shows, it is possible for there to be no statistically significant differences between them, with as little as our smallest data size of 100 lines.

heading: O PAQS (PREVIOUSLY ASKED QUESTIONS)
text: O.1 ONE SETTING FOR ALL
Q: Normally, one trains a model with the objective of optimizing based on the training and evaluation data with hyperparameter tuning. The experiments here used one setting for all. Some model configurations might train better and converge close to their optima while other configurations might not reach their full potential. Can this not create a distortion in the results?
A: For conventional engineering practice, we agree that hyperparameter tuning would be a sine qua non. However, the evaluation objective is the relational distance between languages, hence we need to see it in a different light. Here is a loose analogy:
***
Assume 3 objects in 3 different locations in space.
Relative evaluation from one setting allows one to capture the distance between these objects. It does not matter whether these three objects are in their “best” states.
For example, if one were to use a camera to capture these 3 objects and one does not adjust the setting (using just one random aperture, shutter speed, and focus), i.e. no tuning to capture any of these 3 specifically, nor does one try to model these 3 to their individual bests separately, what would result could be a picture that captures one of these 3 objects more favorably than the others, or it could be that all of these would be blurred. But either way, there is a degree of blurriness to be measured, giving us an idea of the relative distance between the objects. Such relative measurement is the evaluation strategy that our paper adopts.
Now, to add to the camera analogy, say one of the objects is running water, which was extra blurry [erraticity]: we suggest freezing the water, so even from the one arbitrary angle, it could be captured better. And it worked.
Also, while one might generally like to have a “pretty” photo, one that is e.g. taken with sub-optimal lighting, say, overexposure, can have a telling effect as it can bring out details in something dark, like a black box.
***
Alternatively, one can tune hyperparameters for each model individually such that each model would be a more optimized one and then compare these models. In that case, one would be interpreting the differences between language in terms of hyperparameters, and the paper would be one that is algorithm-centric. That is of course also a possibility. Our approach, however, is a data-centric one. We would, first of all, like to understand the nature of language data, i.e. what it is about language, if there is anything at all, that makes it a different data type than other data, and what kind of structural constraints, if any, that we need to take into consideration. Then with findings from this data perspective, we try to relate back to the algorithm and make connections so to create a more holistic picture.
O.2 TRANSLATIONESE / WORD ORDER
Q: Multitexts are parallel texts or translations with the same meaning. There is little to no variation in word order, hence they are just “Translationese” (Gellerstam, 1986). That is why they turn out to be the same, with no performance disparity.
A: Our findings do show that when the semantics is properly controlled, such as in multitexts, the factors influencing performance are statistical properties related to sequence length and vocabulary, e.g. |V | or TTR, and the languages tested can be different. Semantic equivalence is also not a reason why we should expect neutralization of source language instances, as that would mean we should expect equal results across target languages.
We agree that faithfulness is often a priority in producing good translations. Whether the translations are produced by humans or machines, only a single best translation can surface as the translation of choice. There may be many other competing hypotheses, but regardless of whether it is done through an automatic ranking algorithm by a machine or through a human expert, the purpose of
translation is the same. However, styles and preferences in translations can vary. While faithfulness is generally preferred in the translations of legal texts, more freedom with skillful rearrangement of and play on words (or rather, character or sub-character sequences) or sounds being a criterion for literary texts could be appreciated by certain readers. We agree that it could be very interesting and necessary to model these variations, and we understand that languages can surface in many multimodal forms beyond the confines of texts as well. But with a data-driven perspective, to model this broader variation in language, we need corresponding datasets — we suggest contrast sets where the difference in e.g. sequential order is explicit. And for evaluation, we would require an even more systematic meta evaluation, one that spans different datasets.
But the argument that language or data could be different beyond how it appears in one dataset is irrelevant in the evaluation of experiments involving said dataset.

heading: P UNDERSTANDING THE PHENOMENA WITH ALTERNATE REPRESENTATIONS (EXTENDED VERSION)
text: [Appendix P is an extended version of § 4.]
To understand why some languages show different results than others, we carried out a secondary set of control experiments with representations targeting the problematic statistical properties of the corresponding target languages.
Character level On the character level, it is well known that ZH differs from the other languages in its high |V |, in this study it has an averaged mean±std of 2550±144912 across all 5 data sizes from all 3 datasets compared to 170±87 from all other 5 languages combined, may these be in Latin or Cyrillic alphabet or the Abjad script. But what is often not known is that the character sequence length of logographic languages such as ZH is typically short (think and compare the sequence length of the Ancient Egyptian hieroglyphs or the Demotic script with that of the Greek script on the Rosetta Stone). Here in our case, the averaged mean sequence length in characters for ZH is 35±19, compared to 129±71 from the other 5 languages. Heuristics to mitigate high |V | often involve decomposition, which automatically resolve the problem of short sequence length. We tried 2 methods to lower character |V | with representations in ASCII characters — Pinyin and Wubi. The former is a romanization of ZH characters based on their pronunciations and the latter is an input algorithm that decomposes character-internal information into stroke shape and ordering and matches these to 5 classes of radicals (Lunde, 2008). We replaced the ZH data with these formats only on the target side and reran the experiments involving ZH as a target language (ZHtrg) on the character level.
Results in Figure 2 and Table 1 show that the elimination of disparity on character level is possible if ZH is represented through Pinyin (transliteration), as in Subfigure 2c. But Wubi exhibits erraticity (Subfigure 2a). Wubi in our data has a maximum sequence length of 688 characters. As we shall also show in our byte-level analysis below, there are reasons to attribute length as cause to erraticity.
Decomposition into strokes may seem like a natural remedy analogous to decomposing an EN word into character sequences, but one needs to be mindful of not exceeding an optimal length given finite computation. Considering the ZH in the UN data is represented in simplified characters, decomposing traditional characters would surely complicate the problem. As there are also sub-character semantic and phonetic units (Zhang & Komachi, 2018) that can be exploited for information and aligned with character sequences of other alphabets, qualitative advances in this area can indeed be a new state of the art.
Byte level On the byte level, we observe irregularity for AR and RU. We find minimum sequence length of the target language to be one of the highest metrics correlating positively with the total number of bits (ρ = 0.60).13 Our data is based on 300 characters as maximum length per line. While we wanted to retain at least 75% of the UN data after length filtering, this length still renders a maximum sequence length that exceeds 100 words (the default maximum length for the word alignment model, GIZA++ (Och & Ney, 2003), in the traditional SMT pipeline). Translated into bytes with UTF-8 encoding, data with 300 characters maximum gives us, e.g. for the 106-line datasets, an averaged mean±std of 185±106 in length for AR and 246±142 for RU, considerably larger than that for ZH (94±53) and for EN/ES/FR (≈145.41±77). With UTF-8 encoding, each character in AR, RU, and ZH contains 2 or more bytes. ZH typically has shorter line length in characters, compensating for the total byte sequence in length, even when most ZH characters are 3 bytes each. However, AR and RU generally have long line length in characters, so when converted to bytes, the sequence length remains long even when most of the characters might be just 2 bytes each. Results from our pairwise comparisons indicate 8 (non-directional) language pairs to be significantly different (see Table 1 under “BYTE”): ES-RU, EN-RU, FR-RU, RU-ZH, AR-RU, AR-EN, AR-ZH, and AR-FR — all involving AR or RU. (Appendix I lists also the language pairs with significant differences for other representations.)
12Figures are rounded to whole number. Complete tables of data statistics are provided in Appendix D. 13Top-3 correlates for each representation can be found in Appendix F.
Leveraging language-specific code pages can be a useful practical trick, a reminder that there are alternatives to UTF-8 for analyses and back-end processing if data is clean and homogeneous and if success of larger-scale prediction is not a concern. But one more sustainable alternative is to design a more adaptive and flexible character encoding scheme in general, taking into account the statistical profiles such as length (wrt characters and bytes) and sub-character (atomic/elementary/compound) information of all (or as many as possible) of the world’s languages.
Word level The main difference between word and character/byte models is the absence of length as a top contributing factor correlating with performance. Instead, what matters more are metrics concerning word vocabulary, with top correlate being OOV token rate in the target language (ρ = 0.66). This is understandable as word segmentation neutralizes sequence lengths — the longer lengths in phonetic alphabetic scripts are shortened through multiple-character groupings, while the shorter lengths in logographic scripts (cf. difference in length for the 3 scripts on the Rosetta Stone, logographic scripts are typically shorter than phonetic ones) are lengthened by the insertion of whitespaces. To remedy the OOV problem, we use BPE, which learns a fixed vocabulary of variable-length character sequences (on word level, as it presupposes word segmentation) from the training data. It is more fine-grained than word segmentation and is known for its capability to model subword units for morphologically complex languages (e.g. AR and RU). We use the same vocabulary of 30,000 as specified in Junczys-Dowmunt et al. (2016). This reduced our averaged OOV token rate by 89-100% across the 5 sizes. The number of language pairs with significant differences (p ≤ 0.001) reduced to 7 from 8 for word models, showing how finer-grained modeling has a positive effect on closing the disparity gap.
Version 1.1 (graphs to be updated, score tables added)

Review summaries:
The paper investigates whether languages are equally hard to Conditional-Language-Model (CLM). To do this, the authors perform controlled experiments by modeling text from parallel data from 6 typologically diverse languages. They pair the languages and perform experiments in 30 directions with Transformers, and compare 3 different unit representations: characters, bytes, and word-level (BPE).