DOI: 10.35111/9bhh-2s82
title: Tagged Chinese Gigaword Version 2.0

description: <h3>Introduction</h3><br>
<p>Tagged Chinese Gigaword Version 2.0, created by scholars at <a href="http://www.sinica.edu.tw/main_e.shtml" rel="nofollow"> Academia Sinica</a>, Taipei, Taiwan, is a part-of-speech tagged version of LDC's <a href="http://catalog.ldc.upenn.edu/LDC2005T14" rel="nofollow">Chinese Gigaword Second Edition (LDC2005T14)</a>. Like the original release, Version 2.0 contains all of the data in Chinese Gigaword Second Edition -- from Central News Agency, Xinhua News Agency and Lianhe Zaobao -- annotated with full part of speech tags. In addtion, this new release removes residual noises in the original and improves tagging accuracy by incorporating lexica of unknown words. The changes represented in Version 2.0 include the following:</p><br>
<ul><br>
<li>A single-width space is used consistently between two segmented words.</li><br>
<li>The position of the newline character remains fixed, better reflecting the source files from <a href="http://catalog.ldc.upenn.edu/LDC2005T14" rel="nofollow">Chinese Gigaword Second Edition (LDC2005T14)</a>.</li><br>
<li>The original coding of partial Latin letters or Arabic numerals is preserved.</li><br>
<li>1,192 documents from Central News Agency (Taiwan) and 13 documents from Xinhua News Agency that were missing from the first publication are included.</li><br>
<li>A set of heuristics for building out-of-vocabulary dictionaries to improve annotation quality of very large corpora is incorporated.</li><br>
</ul><br>
<p>Documents in the corpus were assigned one of the following categories:</p><br>
<ul><br>
<li><strong>story</strong>: This type of DOC represents a coherent report on a particular topic or event, consisting of paragraphs and full sentences.</li><br>
<li><strong>multi</strong>: This type of DOC contains a series of unrelated "blurbs," each of which briefly describes a particular topic or event; examples include "summaries of today's news," "news briefs in ..." (some general area like finance or sports), and so on.</li><br>
<li><strong>advis</strong>: These are DOCs which the news service addresses to news editors; they are not intended for publication to the "end users."</li><br>
<li><strong>other</strong>: These DOCs clearly do not fall into any of the above types; they include items such as lists of sports scores, stock prices, temperatures around the world, and so on.</li><br>
</ul><br>
<h3>Data</h3><br>
<p>Basic statistics of data from each source are summarized below.</p><br>
<table width="80%"><br>
<tbody><br>
<tr><br>
<td width="93"><br>
<p><strong>Source</strong></p><br>
</td><br>
<td width="76"><br>
<p><strong>No. Files</strong></p><br>
</td><br>
<td width="97"><br>
<p><strong>Compressed Size(MB) </strong></p><br>
</td><br>
<td width="85"><br>
<p><strong>Total Size(MB)</strong></p><br>
</td><br>
<td width="85"><br>
<p><strong>No. Words(thousands)</strong></p><br>
</td><br>
<td width="101"><br>
<p><strong>No. Documents</strong></p><br>
</td><br>
</tr><br>
<tr><br>
<td width="93"><br>
<p>CNA_CMN</p><br>
</td><br>
<td width="76"><br>
<p>168</p><br>
</td><br>
<td width="97"><br>
<p>1520</p><br>
</td><br>
<td width="85"><br>
<p>6136</p><br>
</td><br>
<td width="85"><br>
<p>501456</p><br>
</td><br>
<td width="101"><br>
<p>1769953</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="93"><br>
<p>XIN_CMN</p><br>
</td><br>
<td width="76"><br>
<p>168</p><br>
</td><br>
<td width="97"><br>
<p>898</p><br>
</td><br>
<td width="85"><br>
<p>3755</p><br>
</td><br>
<td width="85"><br>
<p>311660</p><br>
</td><br>
<td width="101"><br>
<p>992261</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="93"><br>
<p>ZBN_CMN</p><br>
</td><br>
<td width="76"><br>
<p>10</p><br>
</td><br>
<td width="97"><br>
<p>55</p><br>
</td><br>
<td width="85"><br>
<p>214</p><br>
</td><br>
<td width="85"><br>
<p>18632</p><br>
</td><br>
<td width="101"><br>
<p>41418</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="93"><br>
<p>TOTAL</p><br>
</td><br>
<td width="76"><br>
<p>346</p><br>
</td><br>
<td width="97"><br>
<p>2473</p><br>
</td><br>
<td width="85"><br>
<p>10105</p><br>
</td><br>
<td width="85"><br>
<p>831748</p><br>
</td><br>
<td width="101"><br>
<p>2803632</p><br>
</td><br>
</tr><br>
</tbody><br>
</table><br>
<p>The POS tags and their corresponding explanations are listed below:</p><br>
<table width="80%"><br>
<tbody><br>
<tr><br>
<td width="70"><br>
<p><strong>Tag</strong></p><br>
</td><br>
<td width="198"><br>
<p><strong>Explanation_Chinese</strong></p><br>
</td><br>
<td width="255"><br>
<p><strong>Explantation_English</strong></p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>A</p><br>
</td><br>
<td width="198"><br>
<p>非謂形容詞</p><br>
</td><br>
<td width="255"><br>
<p>Non-predicative adjective</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>Caa</p><br>
</td><br>
<td width="198"><br>
<p>對等連接詞，如：和、跟</p><br>
</td><br>
<td width="255"><br>
<p>Conjunctive conjunction</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>Cab</p><br>
</td><br>
<td width="198"><br>
<p>連接詞，如：等等</p><br>
</td><br>
<td width="255"><br>
<p>Conjunction, e.g.<em>deng3deng3</em></p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>Cba</p><br>
</td><br>
<td width="198"><br>
<p>連接詞，如：的話</p><br>
</td><br>
<td width="255"><br>
<p>Conjunction, e.g.<em>de5hua4</em></p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>Cbb</p><br>
</td><br>
<td width="198"><br>
<p>關聯連接詞</p><br>
</td><br>
<td width="255"><br>
<p>Correlative Conjunction</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>D</p><br>
</td><br>
<td width="198"><br>
<p>副詞</p><br>
</td><br>
<td width="255"><br>
<p>Adverb</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>Da</p><br>
</td><br>
<td width="198"><br>
<p>數量副詞</p><br>
</td><br>
<td width="255"><br>
<p>Quantitative Adverb</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>DE</p><br>
</td><br>
<td width="198"><br>
<p>的, 之, 得, 地</p><br>
</td><br>
<td width="255"><br>
<p>Particle DE and its functional equivalents</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>Dfa</p><br>
</td><br>
<td width="198"><br>
<p>動詞前程度副詞</p><br>
</td><br>
<td width="255"><br>
<p>Pre-verbal Adverb of degree</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>Dfb</p><br>
</td><br>
<td width="198"><br>
<p>動詞後程度副詞</p><br>
</td><br>
<td width="255"><br>
<p>Post-verbal Adverb of degree</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>Di</p><br>
</td><br>
<td width="198"><br>
<p>時態標記</p><br>
</td><br>
<td width="255"><br>
<p>Aspectual Adverb</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>Dk</p><br>
</td><br>
<td width="198"><br>
<p>句副詞</p><br>
</td><br>
<td width="255"><br>
<p>Sentential Adverb</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>FW</p><br>
</td><br>
<td width="198"><br>
<p>外文標記</p><br>
</td><br>
<td width="255"><br>
<p>Foreign Word</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>I</p><br>
</td><br>
<td width="198"><br>
<p>感嘆詞</p><br>
</td><br>
<td width="255"><br>
<p>Interjection</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>Na</p><br>
</td><br>
<td width="198"><br>
<p>普通名詞</p><br>
</td><br>
<td width="255"><br>
<p>Common Noun</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>Nb</p><br>
</td><br>
<td width="198"><br>
<p>專有名稱</p><br>
</td><br>
<td width="255"><br>
<p>Proper Noun</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>Nc</p><br>
</td><br>
<td width="198"><br>
<p>地方詞</p><br>
</td><br>
<td width="255"><br>
<p>Place Noun</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>Ncd</p><br>
</td><br>
<td width="198"><br>
<p>位置詞</p><br>
</td><br>
<td width="255"><br>
<p>Localizer</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>Nd</p><br>
</td><br>
<td width="198"><br>
<p>時間詞</p><br>
</td><br>
<td width="255"><br>
<p>Time Noun</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>Nep</p><br>
</td><br>
<td width="198"><br>
<p>指代定詞</p><br>
</td><br>
<td width="255"><br>
<p>Demonstrative Determinatives</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>Neqa</p><br>
</td><br>
<td width="198"><br>
<p>數量定詞</p><br>
</td><br>
<td width="255"><br>
<p>Quantitative Determinatives</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>Neqb</p><br>
</td><br>
<td width="198"><br>
<p>後置數量定詞</p><br>
</td><br>
<td width="255"><br>
<p>Post-quantitative Determinatives</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>Nes</p><br>
</td><br>
<td width="198"><br>
<p>特指定詞</p><br>
</td><br>
<td width="255"><br>
<p>Specific Determinatives</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>Neu</p><br>
</td><br>
<td width="198"><br>
<p>數詞定詞</p><br>
</td><br>
<td width="255"><br>
<p>Numeral Determinatives</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>Nf</p><br>
</td><br>
<td width="198"><br>
<p>量詞</p><br>
</td><br>
<td width="255"><br>
<p>Measure</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>Ng</p><br>
</td><br>
<td width="198"><br>
<p>後置詞</p><br>
</td><br>
<td width="255"><br>
<p>Postposition</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>Nh</p><br>
</td><br>
<td width="198"><br>
<p>代名詞</p><br>
</td><br>
<td width="255"><br>
<p>Pronoun</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>P</p><br>
</td><br>
<td width="198"><br>
<p>介詞</p><br>
</td><br>
<td width="255"><br>
<p>Preposition</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>SHI</p><br>
</td><br>
<td width="198"><br>
<p>是</p><br>
</td><br>
<td width="255"><br>
<p>you3 (to have)</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>T</p><br>
</td><br>
<td width="198"><br>
<p>語助詞</p><br>
</td><br>
<td width="255"><br>
<p>Particle</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>VA</p><br>
</td><br>
<td width="198"><br>
<p>動作不及物動詞</p><br>
</td><br>
<td width="255"><br>
<p>Active Intransitive Verb</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>VAC</p><br>
</td><br>
<td width="198"><br>
<p>動作使動動詞</p><br>
</td><br>
<td width="255"><br>
<p>Active Causative Verb</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>VB</p><br>
</td><br>
<td width="198"><br>
<p>動作類及物動詞</p><br>
</td><br>
<td width="255"><br>
<p>Active Pseudo-transitive Verb</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>VC</p><br>
</td><br>
<td width="198"><br>
<p>動作及物動詞</p><br>
</td><br>
<td width="255"><br>
<p>Active Transitive Verb</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>VCL</p><br>
</td><br>
<td width="198"><br>
<p>動作接地方賓語動詞</p><br>
</td><br>
<td width="255"><br>
<p>Active Verb with a Locative Object</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>VD</p><br>
</td><br>
<td width="198"><br>
<p>雙賓動詞</p><br>
</td><br>
<td width="255"><br>
<p>Ditransitive Verb</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>VE</p><br>
</td><br>
<td width="198"><br>
<p>動作句賓動詞</p><br>
</td><br>
<td width="255"><br>
<p>Active Verb with a Sentential Object</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>VF</p><br>
</td><br>
<td width="198"><br>
<p>動作謂賓動詞</p><br>
</td><br>
<td width="255"><br>
<p>Active Verb with a Verbal Object</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>VG</p><br>
</td><br>
<td width="198"><br>
<p>分類動詞</p><br>
</td><br>
<td width="255"><br>
<p>Classificatory Verb</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>VH</p><br>
</td><br>
<td width="198"><br>
<p>狀態不及物動詞</p><br>
</td><br>
<td width="255"><br>
<p>Stative Intransitive Verb</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>VHC</p><br>
</td><br>
<td width="198"><br>
<p>狀態使動動詞</p><br>
</td><br>
<td width="255"><br>
<p>Stative Causative Verb</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>VI</p><br>
</td><br>
<td width="198"><br>
<p>狀態類及物動詞</p><br>
</td><br>
<td width="255"><br>
<p>Stative Pseudo-transitive Verb</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>VJ</p><br>
</td><br>
<td width="198"><br>
<p>狀態及物動詞</p><br>
</td><br>
<td width="255"><br>
<p>Stative Transitive Verb</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>VK</p><br>
</td><br>
<td width="198"><br>
<p>狀態句賓動詞</p><br>
</td><br>
<td width="255"><br>
<p>Stative Verb with a Sentential Object</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>VL</p><br>
</td><br>
<td width="198"><br>
<p>狀態謂賓動詞</p><br>
</td><br>
<td width="255"><br>
<p>Stative Verb with a Verbal Object</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="70"><br>
<p>V_2</p><br>
</td><br>
<td width="198"><br>
<p>有</p><br>
</td><br>
<td width="255"><br>
<p>有</p><br>
</td><br>
</tr><br>
</tbody><br>
</table><br>
<p>Since neither manual checking nor automatic checking against a gold standard is feasible for gigaword size corpora, the authors proposed quality assurance of automatic annotation of very large corpora based on heterogeneous CKIP and ICTCLAS tagging systems (Huang et al., 2008). By comparing to word lists generated from the ICTCLAS version of an automatic tagged Xinhua portion of Chinese Gigaword, a set of heuristics for building out-of-vocabulary dictionaries to improve quality were proposed. Randomly selected texts for evaluating effects of these out-of-vocabulary dictionaries were manually checked. Experimental results indicate that there were 30,562 correct words (about 97.3 %) of tested words. The quality control test result follows:</p><br>
<table width="80%"><br>
<tbody><br>
<tr><br>
<td width="145"><br>
<p><strong>Corpora</strong></p><br>
</td><br>
<td width="139"><br>
<p><strong>Thousands of words</strong></p><br>
</td><br>
<td width="123"><br>
<p><strong>No. Test words</strong></p><br>
</td><br>
<td width="116"><br>
<p><strong>No. Correct Words</strong></p><br>
</td><br>
</tr><br>
<tr><br>
<td width="145"><br>
<p>CNA</p><br>
</td><br>
<td width="139"><br>
<p>501459</p><br>
</td><br>
<td width="123"><br>
<p>42,695</p><br>
</td><br>
<td width="116"><br>
<p>41,449</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="145"><br>
<p>XIN</p><br>
</td><br>
<td width="139"><br>
<p>311718</p><br>
</td><br>
<td width="123"><br>
<p>28,744</p><br>
</td><br>
<td width="116"><br>
<p>27,967</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="145"><br>
<p>ZBN</p><br>
</td><br>
<td width="139"><br>
<p>18632</p><br>
</td><br>
<td width="123"><br>
<p>22,825</p><br>
</td><br>
<td width="116"><br>
<p>22,270</p><br>
</td><br>
</tr><br>
<tr><br>
<td width="145"><br>
<p>Total</p><br>
</td><br>
<td width="139"><br>
<p>831809</p><br>
</td><br>
<td width="123"><br>
<p>31,421</p><br>
</td><br>
<td width="116"><br>
<p>30,562</p><br>
</td><br>
</tr><br>
</tbody><br>
</table><br>
<h3>Samples</h3><br>
<p>Please view this <a href="desc/addenda/LDC2009T14.txt" rel="nofollow">sample</a>.</p></br>
Portions © 2005-2009 Academia Sinica, © 1991-1994 Central News Agengy (Taiwan), © 2000-2003 SPH AsiaOne, Ltd., © 1990-2004 Xinhua News Agency, © 2005, 2007, 2009 Trustees of the University of Pennsylvania