cometadata/datacite-titles-descriptions-related-identifiers huggingface dataset:
DOI: 10.35111/rzz7-xq87
title: GALE Phase 2 Chinese Broadcast News Parallel Text Part 2

description: <h3>Introduction</h3><br>
<p>GALE Phase 2 Chinese Broadcast News Parallel Text Part 2 was developed by the Linguistic Data Consortium (LDC). Along with other corpora, the parallel text in this release comprised training data for Phase 2 of the DARPA GALE (Global Autonomous Language Exploitation) Program. This corpus contains Chinese source text and corresponding English translations selected from broadcast news (BN) data collected by LDC between 2005 and 2007 and transcribed by LDC or under its direction.</p><br>
<h3>Data</h3><br>
<p>This release includes 30 source-translation document pairs, comprising 206,737 characters of translated material. Data is drawn from 12 distinct Chinese BN programs broadcast by China Central TV, a national and international broadcaster in Mainland China; New Tang Dynasty TV, a broadcaster based in the United States; and Phoenix TV, a Hong-Kong based satellite television station. The broadcast news recordings in this release focus principally on current events.</p><br>
<p>The data was transcribed by LDC staff and/or transcription vendors under contract to LDC in accordance with Quick Rich Transcription guidelines developed by LDC. Transcribers indicated sentence boundaries in addition to transcribing the text. Data was manually selected for translation according to several criteria, including linguistic features, transcription features and topic features. The transcribed and segmented files were then reformatted into a human-readable translation format and assigned to translation vendors. Translators followed LDC's Chinese to English translation guidelines. Bilingual LDC staff performed quality control procedures on the completed translations.</p><br>
<p>Source data and translations are distributed in TDF format. TDF files are tab-delimited files containing one segment of text along with meta information about that segment. Each field in the TDF file is described in TDF_format.text. All data are encoded in UTF-8.</p><br>
<h3>Samples</h3><br>
<p>Please view this <a href="desc/addenda/LDC2014T11.cmn.jpg">source sample</a> and <a href="desc/addenda/LDC2014T11.eng.txt">translation sample</a>.</p><br>
<h3>Updates</h3><br>
<p>None at this time.</p><br>
<h3>Sponsorship</h3><br>
<p>This work was supported in part by the Defense Advanced Research Projects Agency, GALE Program Grant No. HR0011-06-1-0003. The content of this publication does not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.</p></br>
 Portions © 2005-2007 China Central TV, © 2005 New Tang Dynasty TV, © 2005-2007 Phoenix TV, © 2005-2007, 2014 Trustees of the University of Pennsylvania
DOI: 10.35111/aa15-9007
title: GALE Phase 2 Chinese Newswire Parallel Text Part 1

description: <h3>Introduction</h3><br>
<p>GALE Phase 2 Chinese Newswire Parallel Text Part 1 was developed by the Linguistic Data Consortium (LDC). Along with other corpora, the parallel text in this release comprised training data for Phase 2 of the DARPA GALE (Global Autonomous Language Exploitation) Program. This corpus contains 117,173 tokens of Chinese source text and corresponding English translations selected from newswire data collected by LDC in 2007 and transcribed by LDC or under its direction.</p><br>
<h3>Data</h3><br>
<p>This release includes 167 source-translation document pairs, comprising 117,173 tokens of translated data. Data is drawn from four distinct Chinese newswire sources: China News Service, Guangming Daily, People's Daily and People's Liberation Army Daily.</p><br>
<p>Data was manually selected for translation according to several criteria, including linguistic features and topic features. The files were formatted into a human-readable translation format and assigned to translation vendors. Translators followed LDC's Chinese to English translation guidelines. Bilingual LDC staff performed quality control procedures on the completed translations.</p><br>
<p>Source data and translations are distributed in TDF format. TDF files are tab-delimited files containing one segment of text along with meta information about that segment. Each field in the TDF file is described in TDF_format.text. All data are encoded in UTF-8.</p><br>
<h3>Samples</h3><br>
<p>Please view this <a href="desc/addenda/LDC2014T15.cmn.jpg">source sample</a> and <a href="desc/addenda/LDC2014T15.eng.txt">translation sample</a>.</p><br>
<h3>Updates</h3><br>
<p>None at this time.</p><br>
<h3>Sponsorship</h3><br>
<p>This work was supported in part by the Defense Advanced Research Projects Agency, GALE Program Grant No. HR0011-06-1-0003. The content of this publication does not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.</p></br>
Portions © 2007 China Military Online, chinanews.com, Guangming Daily, People's Daily, © 2007, 2014 Trustees of the University of Pennsylvania
DOI: 10.35111/4yac-wb16
title: TAC KBP Reference Knowledge Base

description: <h3>Introduction</h3><br>
<p>TAC KBP Reference Knowledge Base was developed by the Linguistic Data Consortium (LDC) in support of the NIST-sponsored TAC-KBP evaluation series. It is a knowledge base built from English Wikipedia articles and their associated infoboxes and covers over 800,000 entities. LDC also released TAC KBP Spanish Cross-lingual Entity Linking - Comprehensive Training and Evaluation Data 2012-2014 (<a href="../../../LDC2016T26">LDC2016T26</a>.)</p><br>
<p><a href="http://www.nist.gov/tac/">TAC</a> (Text Analysis Conference) is a series of workshops organized by <a href="http://www.nist.gov/">NIST</a> (the National Institute of Standards and Technology) to encourage research in natural language processing and related applications by providing a large test collection, common evaluation procedures, and a forum for researchers to share their results. TAC's KBP track (Knowledge Base Population) encourages the development of systems that can match entities mentioned in natural texts with those appearing in a knowledge base and extract novel information about entities from a document collection and add it to a new or existing knowledge base.</p><br>
<p>Consult the LDC <a href="https://www.ldc.upenn.edu/collaborations/current-projects/tac-kbp">TAC-KBP</a> project page for further information about LDC's resource development for the TAC-KBP program.</p><br>
<h3>Data</h3><br>
<p>The source data (Wikipedia infoboxes and articles) was taken from an October 2008 snapshot of Wikipedia.</p><br>
<p>TAC KBP Reference Knowledge Base contains a set of entities, each with a canonical name and title for the Wikipedia page, an entity type, an automatically parsed version of the data from the infobox in the entity's Wikipedia article, and a stripped version of the text of the Wiki article. Each entity is assigned one of four types: PER (person), ORG (organization), GPE (geo-political entity) and UKN (unknown).</p><br>
<p>All data files are presented as UTF-8 encoded XML.</p><br>
<h3>Samples</h3><br>
<p>Please view the following <a href="desc/addenda/LDC2014T16.xml">sample</a>.</p><br>
<h3>Updates</h3><br>
<p>None at this time.</p></br>
Portions © 2008-2009, 2014 Trustees of the University of Pennsylvania
DOI: 10.35111/4t21-1959
title: GALE Phase 2 Chinese Newswire Parallel Text Part 2

description: <h3>Introduction</h3><br>
<p>GALE Phase 2 Chinese Newswire Parallel Text Part 2 was developed by the Linguistic Data Consortium (LDC). Along with other corpora, the parallel text in this release comprised training data for Phase 2 of the DARPA GALE (Global Autonomous Language Exploitation) Program. This corpus contains 117,895 tokens of Chinese source text and corresponding English translations selected from newswire data collected by LDC in 2007 and translated by LDC or under its direction.</p><br>
<p>LDC has also released GALE Phase 2 Chinese Newswire Parallel Text Part 1 (<a href="../../../LDC2014T15">LDC2014T15</a>).</p><br>
<h3>Data</h3><br>
<p>This release includes 177 source-translation document pairs, comprising 117,895 tokens of translated data. Data is drawn from four distinct Chinese newswire sources: China News Service, Guangming Daily, People's Daily and People's Liberation Army Daily.</p><br>
<p>Data was manually selected for translation according to several criteria, including linguistic features and topic features. The files were formatted into a human-readable translation format and assigned to translation vendors. Translators followed LDC's Chinese to English translation guidelines. Bilingual LDC staff performed quality control procedures on the completed translations.</p><br>
<p>Source data and translations are distributed in TDF format. TDF files are tab-delimited files containing one segment of text along with meta information about that segment. Each field in the TDF file is described in TDF_format.text. All data are encoded in UTF-8.</p><br>
<h3>Samples</h3><br>
<p>Please view this <a href="desc/addenda/LDC2014T20.cmn.jpg">Chinese sample</a> and <a href="desc/addenda/LDC2014T20.eng.txt">English sample</a>.</p><br>
<h3>Updates</h3><br>
<p>None at this time.</p><br>
<h3>Sponsorship</h3><br>
<p>This work was supported in part by the Defense Advanced Research Projects Agency, GALE Program Grant No. HR0011-06-1-0003. The content of this publication does not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.</p></br>
Portions © 2007 China Military Online, chinanews.com, Guangming Daily, People's Daily, © 2007, 2014 Trustees of the University of Pennsylvania
DOI: 10.35111/njb6-wb02
title: Chinese Discourse Treebank 0.5

description: <h3>Introduction</h3><br>
<p>Chinese Discourse Treebank 0.5 was developed at Brandeis University as part of the <a href="http://www.cs.brandeis.edu/~clp/ctb/">Chinese Treebank Project </a>and consists of approximately 73,000 words of Chinese newswire text annotated for discourse relations. It follows the lexically grounded approach of the Penn Discourse Treebank (PDTB) (<a href="../../../LDC2008T05">LDC2008T05</a>) with adaptations based on the linguistic and statistical characteristics of Chinese text. Discourse relations are lexically anchored by discourse connectives (e.g., because, but, therefore), which are viewed as predicates that take abstract objects such as propositions, events and states as their arguments. Along with PDTB-style schemes for English, Turkish, Hindi and Czech, Chinese Discourse Treebank provides an additional perspective on how the PDTB approach can be extended for cross-lingual annotation of discourse relations.</p><br>
<h3>Data</h3><br>
<p>Data was selected from the newswire material in Chinese Treebank 8.0 (<a href="../../../LDC2013T21">LDC2013T21</a>), specifically, from Xinhua News Agency stories. There are approximately 5,500 annotation instances. Following the PDTB format, each annotation instance consists of 27 vertical bar delimited fields. The fields specify the attributes of the discourse relation as a whole, as well as the attributes of its two arguments. Not all fields are filled in this release. Filled fields are indicated by a pair of angle brackets; the remaining fields are place holders for future releases.</p><br>
<h3>Samples</h3><br>
<p>Please view this <a href="desc/addenda/LDC2014T21.ann.jpg">annotation sample</a> and <a href="desc/addenda/LDC2014T21.raw.jpg">raw sample</a>.</p><br>
<h3>Updates</h3><br>
<p>None at this time.</p></br>
Portions © 1994-1998, 2006 Xinhua News Agency, © 2001, 2004, 2005, 2007, 2009, 2010, 2013, 2014 Trustees of the University of Pennsylvania
DOI: 10.35111/m9me-vh08
title: Fisher and CALLHOME Spanish--English Speech Translation 

description: <h3>Introduction</h3><br>
<p>Fisher and CALLHOME Spanish-English Speech Translation was developed at Johns Hopkins University and contains English reference translations and speech recognizer output (in various forms) that complement the LDC Fisher Spanish (<a href="../../../LDC2010T04">LDC2010T04</a>) and CALLHOME Spanish audio and transcript releases (<a href="../../../LDC96T17">LDC96T17</a>). Together, they make a four-way parallel text dataset representing approximately 38 hours of speech, with defined training, development, and held-out test sets.</p><br>
<h3>Data</h3><br>
<p>The source data are the Fisher Spanish and CALLOME Spanish corpora developed by LDC, comprising transcribed telephone conversations between (mostly native) Spanish speakers in a variety of dialects. The Fisher Spanish data set consists of 819 transcribed conversations on an assortment of provided topics primarily between strangers, resulting in approximately 160 hours of speech aligned at the utterance level, with 1.5 million tokens. The CALLHOME Spanish corpus comprises 120 transcripts of spontaneous conversations primarily between friends and family members, resulting in approximately 20 hours of speech aligned at the utterance level, with just over 200,000 words (tokens) of transcribed text.</p><br>
<p>Translations were obtained by crowdsourcing using Amazon's Mechanical Turk, after which the data was split into training, development, and test sets. The CALLHOME data set defines its own data splits, organized into train, devtest, and evltest, which were retained here. For the Fisher material, four data splits were produced: a large training section and three test sets. These test sets correspond to portions of the data where four translations exist.</p><br>
<h3>Samples</h3><br>
<p>Please view this <a href="desc/addenda/LDC2014T23.corpus.txt">corpus</a> and <a href="desc/addenda/LDC2014T23.mapping.txt">mapping</a> sample.</p><br>
<h3>Updates</h3><br>
<p>None at this time.</p></br>
Portions © 2014 Chris Callison-Burch, Matt Post, © 1996, 1997, 2005-2006, 2010, 2014 Trustees of the University of Pennsylvania
DOI: 10.35111/tj47-sd65
title: Boulder Lies and Truth

description: <h3>Introduction</h3><br>
<p>Boulder Lies and Truth was developed at the University of Colorado Boulder and contains approximately 1,500 elicited English reviews of hotels and electronics for the purpose of studying deception in written language. Reviews were collected by crowd-sourcing with Amazon Medical Turk.</p><br>
<p>Each review was required to be original and was checked for plagiarism against the web. Reviews were annotated with respect to the following three dimensions:</p><br>
<ul><br>
<li>Domain: Electronics (e.g., iPhone) or Hotels</li><br>
<li>Sentiment: Positive or Negative</li><br>
<li>Truth Value:<br>
<ul><br>
<li>a) Truthful: a review about an object known by the writer reflecting the real sentiment of the writer toward the object of the review</li><br>
<li>b) Opposition: A review about an object known by the writer reflecting the opposite sentiment of the writer toward the object of the review (i.e., if the writer liked the object they were asked to write a negative review; if the writer did not like the object, they were asked to write a positive review)</li><br>
<li>c) Deceptive (i.e., fabricated): a review written about an object not known by the writer either positive or negative in sentiment; the objects reviewed were provided via a URL from the tasks in (a) and (b)</li><br>
</ul><br>
</li><br>
</ul><br>
<h3>Data</h3><br>
<p>Each review was judged a total of 30 times: (1) 10 times to evaluate its perceived quality (on a range from 1-5); (2) 10 times with judgments about its perceived truthfulness (e.g., truthful or somehow deceptive, a lie or a fabrication); and (3) 10 times for its perceived sentiment (i.e., star rating).</p><br>
<p>The following metadata is available for each review:</p><br>
<ul><br>
<li>time consumed by the writer to write the review</li><br>
<li>a pair review ID coupling the two reviews (positive/negative) written about the same object by the same person, either false or truthful</li><br>
<li>the ID of the writer who wrote the review</li><br>
<li>the writer's disclosure as to whether the object to be reviewed was already used and/or known to the writer</li><br>
<li>the URL identifying an instance of the object (i.e., hotel or electronic product) on the web</li><br>
<li>a flag for plagiarized reviews</li><br>
<li>a marker for reviews that may be removed from the corpus</li><br>
<li>the reasons for rejecting a review</li><br>
</ul><br>
<h3>Samples</h3><br>
<p>Please view this <a href="desc/addenda/LDC2014T24.csv">sample</a>.</p><br>
<h3>Updates</h3><br>
<p>None at this time.</p></br>
Portions © 2014 Franco Salvetti, © 2014 Trustees of the University of Pennsylvania
DOI: 10.35111/rp11-v735
title: GALE Phase 2 Chinese Web Parallel Text

description: <h3>Introduction</h3><br>
<p>GALE Phase 2 Chinese Web Parallel Text was developed by the Linguistic Data Consortium (LDC). Along with other corpora, the parallel text in this release comprised training data for Phase 2 of the DARPA GALE (Global Autonomous Language Exploitation) Program. This corpus contains Chinese source text and corresponding English translations selected from weblog and newsgroup data collected by LDC and translated by LDC or under its direction.</p><br>
<h3>Data</h3><br>
<p>This release includes 46 source-translation document pairs, comprising 66,779 tokens of translated data. Data is drawn from four Chinese weblog and newsgroup sources.</p><br>
<p>Data was manually selected for translation according to several criteria, including linguistic features and topic features. The files were formatted into a human-readable translation format and assigned to translation vendors. Translators followed LDC's Chinese to English translation guidelines. Bilingual LDC staff performed quality control procedures on the completed translations.</p><br>
<p>Source data and translations are distributed in TDF format. TDF files are tab-delimited files containing one segment of text along with meta information about that segment. Each field in the TDF file is described in TDF_format.text. All data are encoded in UTF-8.</p><br>
<h3>Samples</h3><br>
<p>Please view this <a href="desc/addenda/LDC2014T26.jpg">Chinese sample</a> and <a href="desc/addenda/LDC2014T26.txt">English sample</a>.</p><br>
<h3>Updates</h3><br>
<p>None at this time.</p><br>
<h3>Sponsorship</h3><br>
<p>This work was supported in part by the Defense Advanced Research Projects Agency, GALE Program Grant No. HR0011-06-1-0003. The content of this publication does not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.</p></br>
Portions © 2011-2012, 2014 Trustees of the University of Pennsylvania
DOI: 10.35111/xh5d-3j19
title: GALE Phase 3 Chinese Broadcast Conversation Transcripts Part 1

description: <h3>Introduction</h3><br>
<p>GALE Phase 3 Chinese Broadcast Conversation Transcripts Part 1 was developed by the Linguistic Data Consortiume (LDC) and contains transcriptions of approximately 126 hours of Chinese broadcast conversation speech collected in 2007 by LDC and Hong University of Science and Technology (HKUST), Hong Kong, during Phase 3 of the DARPA GALE (Global Autonomous Language Exploitation) Program.</p><br>
<p>Corresponding audio data is released as GALE Phase 3 Chinese Broadcast Conversation Speech Part 1 (<a href="../../../LDC2014S09">LDC2014S09</a>).</p><br>
<p>The source broadcast conversation recordings feature interviews, call-in programs and roundtable discussions focusing principally on current events from the following sources: Anhui TV, a regional television station in Anhui Province, China; Beijing TV, a national television station in China; China Central TV (CCTV), a Chinese national and international broadcaster; Hubei TV, a regional television station in Hubei Province, China; and Phoenix TV, a Hong Kong-based satellite television station.</p><br>
<h3>Data</h3><br>
<p>The transcript files are in plain-text, tab-delimited format (TDF) with UTF-8 encoding, and the transcribed data totals 1,556,904 tokens. The transcripts were created with the LDC-developed transcription tool, XTrans, a multi-platform, multilingual, multi-channel transcription tool that supports manual transcription and annotation of audio recordings. XTrans is available from the following link, <a href="https://www.ldc.upenn.edu/language-resources/tools/xtrans">https://www.ldc.upenn.edu/language-resources/tools/xtrans </a>.</p><br>
<p>The files in this corpus were transcribed by LDC staff and/or by transcription vendors under contract to LDC. Transcribers followed LDC's quick transcription guidelines (QTR) and quick rich transcription specification (QRTR) both of which are included in the documentation with this release. QTR transcription consists of quick (near-) verbatim, time-aligned transcripts plus speaker identification with minimal additional mark-up. It does not include sentence unit annotation. QRTR annotation adds structural information such as topic boundaries and manual sentence unit annotation to the core components of a quick transcript. Files with QTR as part of the filename were developed using QTR transcription. Files with QRTR in the filename indicate QRTR transcription.</p><br>
<h3>Samples</h3><br>
<p>Please view this <a href="desc/addenda/LDC2014T28.jpg">sample</a>.</p><br>
<h3>Updates</h3><br>
<p>None at this time.</p><br>
<h3>Acknowledgement</h3><br>
<p>This work was supported in part by the Defense Advanced Research Projects Agency, GALE Program Grant No. HR0011-06-1-0003. The content of this publication does not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.</p></br>
Portions © 2007 Anhui TV, Beijing TV, China Central TV, Hubei TV, Phoenix TV, © 2007, 2014 Trustees of the University of Pennsylvania
DOI: 10.35111/9xeb-gd36
title: SenSem Lexicons

description: <h3>Introduction</h3><br>
<p>SenSem (Sentence Semantics) Lexicons was developed by <a href="http://grial.uab.es/index.php">GRIAL</a>, the Linguistic Applications Inter-University Research Group that includes the following Spanish institutions: the <a href="http://www.uab.es/web/universitat-autonoma-de-barcelona-1345467954774.html">Universitat Autonoma de Barcelona</a>, the <a href="http://www.ub.edu/web/ub/en/index.html">Universitat de Barcelona</a>, the <a href="http://www.udl.es/en.html">Universitat de Lleida</a> and <a href="http://www.uoc.edu/portal/en/index.html">the Universitat Oberta de Catalunya</a>. It contains feature descriptions for approximately 1,300 Spanish verbs and 1,300 Catalan verbs in the SenSem Databank (<a href="../../../LDC2015T02">LDC2015T02</a>). GRIAL's work focuses on resources for applied linguistics, including lexicography, translation and natural language processing.</p><br>
<h3>Data</h3><br>
<p>The verb features for each language consist of two groups: those codified manually, including definition, <a href="https://wordnet.princeton.edu/">WordNet</a> synset, <a href="http://www.glottopedia.org/index.php/Aktionsart">Aktionsart</a>, arguments and semantic functions; and those extracted automatically from the SenSem Databank. Among the latter are verb frequency, semantic construction, syntactic categories and constituent order. The verbs analyzed correspond to the 250 most frequent verbs in Spanish and 320 lemmas in Catalan. Further information about the SenSem project can be obtained from the GRIAL website at <a href="http://grial.uab.es/sensem/corpus">http://grial.uab.es/sensem/corpus</a>.</p><br>
<p>Data is presented in a single XML file per language.</p><br>
<h3>Samples</h3><br>
<p>Please view this <a href="desc/addenda/LDC2015L01.jpg">sample</a>.</p><br>
<h3>Updates</h3><br>
<p>None at this time.</p></br>
Portions © 2015 Dr. Ana Fernandez Montraveta, Dr. Gloria Vázquez-Garcia, Trustees of the University of Pennsylvania