DOI: 10.35111/c3n5-8z64
title: Prague Dependency Treebank 1.0

description: <h2>Introduction</h2> The Prague Dependency Treebank Version 1.0: <ul> <li>Morphologically and syntactically annotated Czech data, 1.8MW </li> <li>Czech-English parallel Corpus, aligned, 0.9MW/1MW </li> <li>Czech raw texts (newspaper and journals), over 30MW </li> <li>Czech NLP tools (morphology, tagging) </li> <li>General annotation tools (tree editors, tree viewer) </li> </ul><p>(abridged version of the part of paper: E. Hajicova. Dependency-Based Underlying-Structure Tagging of a Very Large Czech Corpus) </p><p>Since a group of Czech linguists (<a href="http://ufal.ms.mff.cuni.cz" rel="nofollow">Institute of Formal and Applied Linguistics</a>, <a href="http://utkl.ff.cuni.cz" rel="nofollow">Institute of Theoretical and Computational Linguistcs</a>) from <a href="http://www.cuni.cz" rel="nofollow">Charles University</a> in Prague and <a href="http://www.muni.cz" rel="nofollow">Masaryk University</a> in Brno first formulated the <a href="http://ucnk.ff.cuni.cz" rel="nofollow">Czech National Corpus</a>, it has been quite clear to all of us that for the outcome of our project to have broader relevance and multifaceted usage, we cannot confine ourselves to a mere compilation of a very large corpus of Czech texts. We have been aware that in order to make the corpus really useful for future users -- be they linguists or developers of natural language processing systems of any kind -- we have to design annotation schemes and develop tools that will allow us to add as much linguistic information as possible. Having the advantage of a long and fruitful tradition of theoretical and computational linguistics and inspired by the research resulting in the <a href="http://www.cis.upenn.edu/~treebank/home.html" rel="nofollow">Penn Treebank</a>, the project group decided to build the Prague Dependency Treebank (PDT). </p><h2>Data</h2> <p>The following three points are characteristic for the theory underlying the PDT, fully visible at the highest, tectogrammatical level: </p><p><b>(i)</b> Its theoretical background is a dependency-based syntax (handling the sentence structure as concentrated around the verb and its valency, but containing a further dimension, namely coordination). Among the reasons for the choice of a dependency-based syntax, we primarily stress its relative economy and perspicuous, immediate correspondence to the empirical data. </p><p><b>(ii)</b> The nodes of the dependency tree (more precisely, of a multidimensional network) are labeled by complex symbols consisting of lexical, morphological and syntactic parts. Thus, the label of every node contains symbols expressing all of the information contained in the grammatical position of this word and is relevant for a semantic (semantico-pragmatic) interpretation. This makes the output representations, or the trees of our treebank, not only useful for practical applications such as parsing, but also for its inclusion into an integrated theoretical description encompassing all layers from the outer (phonetic or graphemic) shape of the sentence to its semantico-pragmatic representation, be it in the form of truth-conditionally based intensional semantics or in that of a framework paying more attention to the embedding of the sentence in context. </p><p><b>(iii)</b> The dependency tree is understood as projective. Its relationships to the morphemic representation of the sentence (a string of symbols, the order of which corresponds to the surface word order) are handled by means of specific rules. </p><p><b>Prague Dependency Treebank as a project</b> </p><p>The Prague Dependency Treebank (PDT) is a long-term project with two major phases. In the first phase (1996-2000), the morphological and syntactic analytic layers of annotation have been completed and made together with the preview of tectogrammatical layer annotation available as PDT 1.0. During the second phase (2000 - 2004, <a href="http://ckl.mff.cuni.cz/" rel="nofollow">Center for Computational Linguistics</a>), the tectogrammatical layer of annotation will proceed and the PDT 2.0 will be available upon completion.</p> <p>The structure of the Prague Dependency Treebank (PDT) corresponds to a three-layer structure annotated corpus of <a href="http://www.czech-language.cz" rel="nofollow">Czech</a> as a representative of inflectionally rich, free word-order languages: </p><li>Morphological layer (lowest) - Full morphological annotation</li> <li>Analytic layer (middle) - Superficial (surface) syntactic annotation using dependency treebank with a level conceptually close to the syntactic annotation used in the <a href="http://www.cis.upenn.edu/~treebank/home.html" rel="nofollow">Penn Treebank</a> </li> <li>Tectogrammatical layer (highest) - Level of linguistic meaning</li> <b>Text Sources</b> <p>The electronic text sources have been provided by the <a href="http://ucnk.ff.cuni.cz/" rel="nofollow">Institute of the Czech National Corpus.</a>The text material contains samples from the following <b>sources</b>: </p><ol> <li> <i><a href="http://www.lidovenoviny.cz" rel="nofollow">Lidové Noviny</a></i> (daily newspapers), 1991, 1994, 1995</li> <li> <i><a href="http://www.idnes.cz" rel="nofollow">Mladá fronta Dnes</a></i> (daily newspapers), 1992</li> <li> <i>Ceskomoravský Profit</i> (business weekly), 1994</li> <li> <i>Vesmír</i> (scientific magazine), Academia Publishers, 1992, 1993</li> </ol><p>There is also a parallel Czech English corpus. Drawn from Readers Digest 1993-1996, it consists of 450 articles, 53,117 parallel sentences, 1,010,346 English tokens and 877,658 Czech tokens <b>Inner format of PDT</b> </p><p>There are two internal formats employed in PDT: <b>FS</b> and <b>CSTS</b>. The former is an older format, still heavily used by some treebank tools. The latter, more general <a href="http://www.w3.org/MarkUp/SGML/" rel="nofollow">SGML</a>-based encoding, is meant as the main PDT format (in the future, it will be followed by an XML version, probably already for PDT 2.0). See the description of the FS file format and documentation of the CSTS document type definition (csts.dtd). </p><p><b>Prague Dependency Treebank Version 1.0</b> </p><p><a href="http://ufal.ms.mff.cuni.cz/pdt/" rel="nofollow">PDT 0.5</a> (half through) was released in 1998 and contains 456,705 tokens (words and punctuation) in 26,610 sentences. PDT 1.0 contains about three times more tokens and sentences than PDT 0.5. It is completely manually-annotated on the morphological and analytical levels and includes a preview of tectogrammatically annotated data as well. <b>Future</b> </p><p>The Prague Dependency Treebank Version 2.0 will add the tectogrammatical layer of annotation to PDT 1.0. It will be available with a reduced amount of data as preliminary Version 1.5 during 2002. The final data volume will be reached at the end of 2004. <b>Support</b> </p><p>The PDT 1.0 has been supported by the following <b>grants</b> and <b>projects</b> </p><ul> <li> <a href="http://www.gacr.cz/" rel="nofollow">Grant Agency of the Czech Republic</a> No. 405/96/0198 (Treebank Definition and Procedures Specification)</li> <li> <a href="http://www.gacr.cz/" rel="nofollow">Grant Agency of the Czech Republic</a> No. 405/96/K214 (Tools and Morphological Layer Annotation)</li> <li> <a href="http://www.msmt.cz/" rel="nofollow">Ministry of Education of the Czech Republic</a> No. VS96151 (Tools and Structural Annotation on the Analytical Layer)</li> <li> <a href="http://www.nsf.gov/" rel="nofollow">National Science Foundation</a> No. IIS-9732388 (Version 0.5 Preparation for the <a href="http://www.clsp.jhu.edu/ws98/projects/nlp/" rel="nofollow">Workshop 98</a>)</li> </ul> The PDT 2.0 will be supported by the <b>project</b> <ul> <li> <a href="http://www.msmt.cz/" rel="nofollow">Ministry of Education of the Czech Republic</a> No. LN00A063 (<a href="http://ckl.mff.cuni.cz/" rel="nofollow">Center for Computational Linguistics</a>)</li> </ul><h2>Updates</h2> There are no updates at this time. </br>
Portions © 1993-1996 Readers Digest, © 1991, 1994, 1995 Lidové noviny daily newspapers, © 1992 Mladá fronta Dnes daily newspapers, © 1994 Ceskomoravský Profit business weekly, © 1992-1993 Vesmír scientific magazine, Academia Publishers, © 1996-2001 Institute of Formal and Applied Linguistics and Center for Computational Linguistics Faculty of Mathematics and Physics, Charles University, © 2001 Trustees of the University of Pennsylvania