cometadata/datacite-titles-descriptions-related-identifiers huggingface dataset:
DOI: 10.35111/w9ke-2w41
title: Chinese-English Semiconductor Parallel Text

description: <h3>Introduction</h3><p>Chinese-English Semiconductor Parallel Text was developed by <a href="http://www.mitre.org/" rel="nofollow">The MITRE Corporation</a>. It consists of parallel sentences from a collection of abstracts from scientific articles on semiconductors published in Mandarin and translated into English by translators with particular expertise in the technical area. Translators were instructed to err on the side of literal translation if required, but to maintain the technical writing style of the source and to make the resulting English as natural as possible. The translators followed specific guidelines for translation, and those are included in this distribution.</p><h3>Data</h3><p>There are 2,169 lines of parallel Mandarin and English, with a total of 125,302 characters of Mandarin and 64,851 words of English, presented in a separate UTF-8 plain text file for each language. The sentences were translated in sequential order and presented in a scrambled order, such that parallel sentences at identical line numbers are translations. For example, the 31st line of the English file is a translation of the 31st line of the Mandarin file. The original line sequence is not provided. </p><h3>Samples</h3><p>Follow these links for <a href="./desc/addenda/LDC2012T22.cmn.jpg" rel="nofollow">Chinese</a> and <a href="./desc/addenda/LDC2012T22.eng.txt" rel="nofollow">English</a> samples.</p><h3>Updates</h3><p> None at this time. </p></br>
Portions © 2012 The MITRE Corporation, © 2012 Trustees of the University of Pennsylvania
DOI: 10.35111/fgmp-0035
title: Russian-English Computer Security Parallel Text

description: <h3>Introduction</h3><p>Russian-English Computer Security Parallel Text was developed by <a href="http://www.mitre.org/" rel="nofollow">The MITRE Corporation</a>. It consists of parallel sentences from a set of computer security reports published in Russian and translated into English by translators with particular expertise in the technical area. Translators were instructed to err on the side of literal translation if required, but to maintain the technical writing style of the source and to make the resulting English as natural as possible. The translators followed specific guidelines for translation, and those are included in this distribution.</p><h3>Data</h3><p>There are 6,276 lines of parallel Russian and English, with a total of 60,059 words of Russian and 76,437 words of English, presented in a separate UTF-8 plain text file for each language. The sentences were translated in sequential order and presented in a scrambled order, such that parallel sentences at identical line numbers are translations. For example, the 31st line of the English file is a translation of the 31st line of the Russian file. The original line sequence is not provided. 1,694 untranslated lines (such as code snippets) are included as a separate file </p><h3>Samples</h3><p>For a sample of the data please view this <a href="./desc/addenda/LDC2012T23.eng.txt" rel="nofollow">English text sample</a> and <a href="./desc/addenda/LDC2012T23.rus.txt" rel="nofollow">Russian text sample</a>. Here is the Russian sample as an <a href="./desc/addenda/LDC2012T23.rus.jpg" rel="nofollow">image</a>.</p><h3>Updates</h3><p>None at this time. </p></br>
Portions © 2012 The MITRE Corporation, © 2012 Trustees of the University of Pennsylvania
DOI: 10.35111/tahq-9n25
title: Greybeard

description: <h3>Introduction</h3> <p>Greybeard was developed by the Linguistic Data Consortium (LDC) and is comprised of approximately 590 hours of English telephone conversation speech collected in October and November 2008 by LDC. The goal was to record new telephone conversations among subjects who had participated in one or more previous LDC telephone collections, from Switchboard-1 (1991) through the Mixer studies (2006).</p> <p>A total of 172 subjects were enrolled in the Greybeard collection, all of whom had participated in one of the following:</p> <ul> <li>Switchboard-1 (<a href="http://catalog.ldc.upenn.edu/LDC97S62" rel="nofollow">LDC97S62</a>) 1991-1992: 2 subjects</li> <li>Switchboard-2 (<a href="http://catalog.ldc.upenn.edu/LDC98S75" rel="nofollow">LDC98S75</a>, <a href="http://catalog.ldc.upenn.edu/LDC99S79" rel="nofollow">LDC99S79</a>, <a href="http://catalog.ldc.upenn.edu/LDC2002S06" rel="nofollow">LDC2002S06</a>) 1996-1997: 16 subjects</li> <li>Mixer 1 and 2 2003-2005: 103 subjects</li> <li>Mixer 3 2006: 51 subjects</li> </ul><p>Most Greybeard participants completed 12 calls. Some subjects completed up to 24 calls. Calls were made or received via an automatic operator system at LDC which connected two participants and announced a topic for discussion. </p> <h3>Data</h3> <p>This releases consists of 4680 calls -- the complete set of calls recorded during the Greybeard collection (1098 calls) as well as all calls from the legacy collections that involved the Greybeard speakers.</p> <p>The audio from each call was captured digitally by the operator system and stored in a separate file as raw mu-law sample data. As the recordings were uploaded daily from the robot operator to network disk storage, automated processes reformatted the audio into a 2-channel SPHERE-format file for each conversation and queued the recordings for manual audit to verify speaker identification and to check other aspects of the recording. Auditors provided impressionistic judgments on overall audio quality, presence of background noise and cross-channel echo and any other technical difficulty with the call, in addition to confirming the speaker-ID on each channel. These auditor decisions are provided in the call_info tables, described in more detail in the included documentation.</p> <p>For this release, each 2-channel recording was converted from SPHERE to MS-WAV file format and compressed using FLAC. All audio files are 2-channel, 8 KHz, 16-bit PCM sample data, in FLAC-compressed form (<a href="http://flac.sourceforge.net" rel="nofollow">http://flac.sourceforge.net</a>). When uncompressed, they have MS-WAV/RIFF headers.</p> <h3>Samples</h3> <p>Please listen to the following <a href="./desc/addenda/LDC2013S05.wav" rel="nofollow">audio sample</a>.</p> <h3>Updates</h3> <p> None at this time. </p>  </br>
Portions © 2008, 2013 Trustees of the University of Pennsylvania
DOI: 10.35111/w3e2-e464
title: Chinese-English Biology and Chemistry Abstract Parallel Text

description: <h3>Introduction</h3><p>Chinese-English Biology and Chemistry Abstract Parallel Text was developed by <a href="http://www.mitre.org/" rel="nofollow">The MITRE Corporation</a>. It consists of parallel sentences from a collection of chemistry and biology-related scientific article abstracts published in Mandarin and translated into English by translators with particular expertise in the technical area. Translators were instructed to err on the side of literal translation if required, but to maintain the technical writing style of the source and make the resulting English as natural as possible. The translators were given specific guidelines for translation, and those are included in this distribution.</p><h3>Data</h3><p>This release contains 2,239 lines of parallel Mandarin and English, with a total of 156,445 characters of Mandarin and 75,515 words of English, presented in a separate UTF-8 plain text file for each language. The sentences were translated in sequential order and presented in scrambled order, such that parallel sentences at identical line numbers are translations. For example, the 31st line of the English file is a translation of the 31st line of the Mandarin file. The original line sequence is not provided. </p><h3>Samples</h3><p>For an example of the data please consult this <a href="./desc/addenda/LDC2013T02.cmn.jpg" rel="nofollow">Chinese sample</a> and <a href="./desc/addenda/LDC2013T02.eng.txt" rel="nofollow">English sample</a>.</p><h3>Updates</h3><p> None at this time. </p></br>
Portions © 2013 The MITRE Corporation, © 2013 Trustees of the University of Pennsylvania
DOI: 10.35111/59tr-9c74
title: GALE Phase 2 Chinese Broadcast Conversation Transcripts

description: <h3>Introduction</h3><br>
<p>GALE Phase 2 Chinese Broadcast Conversation Transcripts was developed by the Linguistic Data Consortium (LDC) and contains transcriptions of approximately 120 hours of Chinese broadcast conversation speech collected in 2006 and 2007 by LDC and Hong University of Science and Technology (HKUST), Hong Kong, during Phase 2 of the DARPA GALE (Global Autonomous Language Exploitation) Program.</p><br>
<p>Corresponding audio data is released as GALE Phase 2 Chinese Broadcast Conversation Speech (<a href="http://catalog.ldc.upenn.edu/LDC2013S04" rel="nofollow">LDC2013S04</a>).</p><br>
<p>The source broadcast conversation recordings feature interviews, call-in programs and round table discussions focusing principally on current events from the following sources: Anhui TV, a regional television station in Mainland China, Anhui Province, China Central TV (CCTV), a national and international broadcaster in Mainland China, Hubei TV, a regional broadcaster in Mainland China, Hubei Province, and Phoenix TV, a Hong Kong-based satellite television station.</p><br>
<h3>Data</h3><br>
<p>The transcript files are in plain-text, tab-delimited format (TDF) with UTF-8 encoding, and the transcribed data totals 1,523,373 tokens. The transcripts were created with the LDC-developed transcription tool, XTrans, a multi-platform, multilingual, multi-channel transcription tool that supports manual transcription and annotation of audio recordings. XTrans is available from the following link, <a href="https://www.ldc.upenn.edu/language-resources/tools/xtrans" rel="nofollow">https://www.ldc.upenn.edu/language-resources/tools/xtrans</a>.</p><br>
<p>The files in this corpus were transcribed by LDC staff and/or by transcription vendors under contract to LDC. Transcribers followed the quick transcription guidelines (QTR) and quick rich transcription specification (QRTR) developed by LDC, both of which are included in the documentation with this release. QTR transcription consists of quick (near-)verbatim, time-aligned transcripts plus speaker identification with minimal additional mark-up. It does not include sentence unit annotation. QRTR annotation adds structural information such as topic boundaries and manual sentence unit annotation to the core components of a quick transcript. Files with QTR as part of the filename were developed using QTR transcription. Files with QRTR in the filename indicate QRTR transcription.</p><br>
<h3>Samples</h3><br>
<p>Please consult this <a href="desc/addenda/LDC2013T08.jpg" rel="nofollow">text sample</a>.</p><br>
<h3>Updates</h3><br>
<p>None at this time.</p><br>
<h3>Acknowledgement</h3><br>
<p>This work was supported in part by the Defense Advanced Research Projects Agency, GALE Program Grant No. HR0011-06-1-0003. The content of this publication does not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.</p></br>
Portions © 2006-2007 Anhui TV, China Central TV, Hubei TV, Phoenix TV, © 2006-2007, 2013 Trustees of the University of Pennsylvania
DOI: 10.35111/arsx-cw89
title: GALE Phase 2 Chinese Broadcast Conversation Parallel Text Part 1

description: //W3C//DTD HTML 4.01 Transitional//EN&gt; <h3>Introduction</h3> <p>GALE Phase 2 Chinese Broadcast Conversation Parallel Text Part 1 was developed by the Linguistic Data Consortium (LDC). Along with other corpora, the parallel text in this release comprised training data for Phase 2 of the DARPA GALE (Global Autonomous Language Exploitation) Program. This corpus contains Chinese source text and corresponding English translations selected from broadcast conversation (BC) data collected by LDC in 2006 and 2007 and transcribed by LDC or under its direction.</p> <h3>Data</h3> <p>This release includes 21 source-translation document pairs, comprising 146,082 characters of Chinese source text and its English translation. Data is drawn from seven distinct Chinese programs broadcast in 2006 and 2007 from the following sources -- China Central TV, a national and international broadcaster in Mainland China and Phoenix TV, a Hong Kong-based satellite television station. Broadcast conversation programming is generally more interactive than traditional news broadcasts and includes talk shows, interviews, call-in programs and roundtable discussions. The programs in this release focus on current events topics.</p> <p>The data was transcribed by LDC staff and/or transcription vendors under contract to LDC in accordance with Quick Rich Transcription guidelines developed by LDC. Transcribers indicated sentence boundaries in addition to transcribing the text. Data was manually selected for translation according to several criteria, including linguistic features, transcription features and topic features. The transcribed and segmented files were then reformatted into a human-readable translation format and assigned to translation vendors. Translators followed LDCs Chinese to English translation guidelines. Bilingual LDC staff performed quality control procedures on the completed translations.</p> <p>Source data and translations are distributed in TDF format. TDF files are tab-delimited files containing one segment of text along with meta information about that segment. Each field in the TDF file is described in TDF_format.text. All data are encoded in UTF-8.</p> <h3> Samples</h3> <p>Please view the following <a href="./desc/addenda/LDC2013T11.cmn.jpg" rel="nofollow">Chinese source sample</a> and <a href="./desc/addenda/LDC2013T11.eng.txt" rel="nofollow">English translation sample</a>.</p> <h3>Updates</h3> <p> None at this time. </p> <h3>Acknowledgement</h3> This work was supported in part by the Defense Advanced Research Projects Agency, GALE Program Grant No. HR0011-06-1-0003. The content of this publication does not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.  </br>
Portions © 2006-2007 China Central TV, © 2007 Phoenix TV, © 2006-2007, 2013 Trustees of the University of Pennsylvania
DOI: 10.35111/828e-w727
title: Chinese Proposition Bank 3.0

description: <p>Chinese Proposition Bank 3.0 is a continuation of the <a href="http://www.cs.brandeis.edu/~clp/ctb/cpb/" rel="nofollow">Chinese Proposition Bank</a> project which aims to create a corpus of text annotated with information about basic semantic propositions. Chinese Proposition Bank 3.0 adds predicate-argument annotation on 187,731 words from Chinese Treebank 7.0 (<a href="http://catalog.ldc.upenn.edu/LDC2010T07" rel="nofollow">LDC2010T07</a>). The data sources are comprised of newswire, magazine articles, various broadcast news and broadcast conversation programming, web newsgroups and weblogs. </p> <p>LDC has also released Chinese Proposition Bank 1.0 (<a href="http://catalog.ldc.upenn.edu/LDC2005T23" rel="nofollow">LDC2005T23</a>) and Chinese Proposition Bank 2.0 (<a href="http://catalog.ldc.upenn.edu/LDC2008T07" rel="nofollow">LDC2008T07</a>).</p> <h3>Data</h3> <p>This release contains the predicate-argument annotation of 173,206 verb instances and 14,525 noun instances. The annotation of nouns is limited to nominalizations that have a corresponding verb. The general annotation guidelines and the lexical guidelines (called frame files) for each verbal and nominal predicate are also included in this release. Below are some statistics about the corpus.</p> <ul> <li>Total propositions for verbs - 173,206</li> <li>Total propositions for nouns - 14,525</li> <li>Total verbs framed - 24,642</li> <li>Total framesets - 26,467</li> <li>Verbs with multiple framesets - 1337</li> <li>Average framesets per verb - 1.07</li> <li>Total nouns framed - 1,421</li> <li>Total noun framesets - 1,528</li> <li>Nouns with multiple framesets - 48</li> <li>Average framesets per nouns - 1.08</li> </ul><h3>Samples</h3> <p>Please view the following samples.</p> <ul> <li><a href="./desc/addenda/LDC2013T13.noun.jpg" rel="nofollow">Noun Sample</a></li> <li><a href="./desc/addenda/LDC2013T13.verb.jpg" rel="nofollow">Verb Sample</a></li> <li><a href="./desc/addenda/LDC2013T13.xml.jpg" rel="nofollow">XML Sample</a></li> </ul><h3>Updates</h3> <p> None at this time. </p>  </br>
Portions © 2006 Agence France Presse, © 2006 Anhui TV, © 2005 Cable News Network, LP, LLLP, © 2000-2001 China Broadcasting System, © 2000-2001, 2005-2006 China Central TV, © 2000-2001 China National Radio, © 2006 Chinanews.com, © 2000-2001 China Television System, © 2006 Guangming Daily, © 2006 National Broadcasting Company, Inc., © 2006 New Tang Dynasty TV, © 2006 Peoples Daily Online, © 2005-2006 Phoenix TV, © 1999-2001 Sinorama Magazine, © 1996-1998, 2006 Xinhua News Agency, © 2001, 2004, 2005, 2007, 2008, 2009, 2010, 2013 Trustees of the University of Pennsylvania
DOI: 10.35111/bd73-0j59
title: GALE Phase 2 Chinese Broadcast Conversation Parallel Text Part 2

description: <h3>Introduction</h3> <p>GALE Phase 2 Chinese Broadcast Conversation Parallel Text Part 2 was developed by the Linguistic Data Consortium (LDC). Along with other corpora, the parallel text in this release comprised training data for Phase 2 of the DARPA GALE (Global Autonomous Language Exploitation) Program. This corpus contains Chinese source text and corresponding English translations selected from broadcast conversation (BC) data collected by LDC in 2005-2007 and transcribed by LDC or under its direction.</p> <p>LDC has also released GALE Phase 2 Chinese Broadcast Conversation Parallel Text Part 1 (<a href="http://catalog.ldc.upenn.edu/LDC2013T11" rel="nofollow">LDC2013T11</a>). </p><h3>Data</h3> <p>This release includes 20 source-translation document pairs, comprising 152,894 characters of Chinese source text and its English translation. Data is drawn from six distinct Chinese programs broadcast in 2005-2007 from Phoenix TV, a Hong Kong-based satellite television station. Broadcast conversation programming is generally more interactive than traditional news broadcasts and includes talk shows, interviews, call-in programs and roundtable discussions. The programs in this release focus on current events topics.</p> <p>The data was transcribed by LDC staff and/or transcription vendors under contract to LDC in accordance with Quick Rich Transcription guidelines developed by LDC. Transcribers indicated sentence boundaries in addition to transcribing the text. Data was manually selected for translation according to several criteria, including linguistic features, transcription features and topic features. The transcribed and segmented files were then reformatted into a human-readable translation format and assigned to translation vendors. Translators followed LDCs Chinese to English translation guidelines. Bilingual LDC staff performed quality control procedures on the completed translations.</p> <p>Source data and translations are distributed in TDF format. TDF files are tab-delimited files containing one segment of text along with meta information about that segment. Each field in the TDF file is described in TDF_format.text. All data are encoded in UTF-8.</p> <h3>Samples</h3> <p>Please view this <a href="./desc/addenda/LDC2013T16.cmn.jpg" rel="nofollow">Chinese source sample</a> and <a href="./desc/addenda/LDC2013T16.eng.txt" rel="nofollow">English translation sample</a>. </p> <h3>Updates</h3> <p> None at this time. </p> <h3>Acknowledgement</h3> <p>This work was supported in part by the Defense Advanced Research Projects Agency, GALE Program Grant No. HR0011-06-1-0003. The content of this publication does not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred.</p>  </br>
Portions © 2005-2007 Phoenix TV, © 2005-2007, 2013 Trustees of the University of Pennsylvania
DOI: 10.35111/cy4d-7c39
title: Semantic Textual Similarity (STS) 2013 Machine Translation

description: <h3>Introduction</h3> <p>Semantic Textual Similarity (STS) 2013 Machine Translation was developed as part of the STS 2013 Shared Task which was held in conjunction with <a href="http://clic2.cimec.unitn.it/starsem2013/" rel="nofollow">*SEM 2013</a>, the second joint conference on lexical and computational semantics organized by the ACL (Association of Computational Linguistics) interest groups <a href="http://www.clres.com/siglex.html" rel="nofollow">SIGLEX</a> and <a href="http://www.sigsem.org/wiki/Main_Page" rel="nofollow">SIGSEM</a>. It is comprised of one text file containing 750 English sentence pairs translated from the Arabic and Chinese newswire and web data sources.</p> <p>The goal of the Semantic Textual Similarity (STS) task was to create a unified framework for the evaluation of semantic textual similarity modules and to characterize their impact on natural language processing (NLP) applications. STS measures the degree of semantic equivalence. The STS task was proposed as an attempt at creating a unified framework that allows for an extrinsic evaluation of multiple semantic components that otherwise have historically tended to be evaluated independently and without characterization of impact on NLP applications. More information is available at the <a href="http://ixa2.si.ehu.es/sts" rel="nofollow">STS 2013 Shared Task homepage</a>.</p> <h3>Data</h3> <p>The source data is Arabic and Chinese newswire and web data collected by LDC that was translated and used in the DARPA GALE (Global Autonomous Language Exploitation) program and in several NIST Open Machine Translation evaluations. Of the 750 sentence pairs, 150 pairs are from the GALE Phase 5 collection and 600 pairs are from NIST 2008-2012 Open Machine Translation (OpenMT) Progress Test Sets (<a href="http://catalog.ldc.upenn.edu/LDC2013T07" rel="nofollow">LDC2013T07</a>).</p> <p>The data was built to identify semantic textual similarity between two short text passages. The corpus is comprised of two tab delimited sentences per line. The first sentence is a translation and the second sentence is a post-edited translation. Post-editing is a process to improve machine translation with a minimum of manual labor. The gold standard similarity values and other STS datasets can be obtained from the STS homepage, linked above. </p> <h3>Samples</h3> <p>Please view this <a href="./desc/addenda/LDC2013T18.txt" rel="nofollow">text sample</a>.</p> <h3>Updates</h3> <p> None at this time. </p>  </br>
Portions © 2007 Agence France Presse, Al-Ahram, Al Hayat, Al-Quds Al-Arabi, Asharq Al-Awsat, An Nahar, Assabah, China Military Online, Chinanews.com, Guangming Daily, Xinhua News Agency, © 2007, 2013 Trustees of the University of Pennsylvania