cometadata/datacite-titles-descriptions-related-identifiers huggingface dataset:
DOI: 10.35111/nkkx-1576
title: TDT3 Mandarin Audio

description: <h3>Introduction</h3><br>
<p>This publication contains the TDT3 Broadcast News Mandarin Corpus (Audio), produced by the Linguistic Data Consortium (LDC), catalog number LDC2001S95 and ISBN number 1-58563-186-8. The contents of this publication were recorded from various 60-minute, twice daily Mandarin news programs from VOA, amounting to approximately 123 hours of audio. The transcripts of these broadcasts will be published in the TDT3 Mandarin Text and TDT3 Multilanguage Text Corpora.</p><br>
<h3>Data</h3><br>
<p>Topic Detection and Tracking (TDT) refers to automatic techniques for finding topically related material in streams of data such as newswire and broadcast news. The TDT3 corpus was created to support three TDT3 tasks: find topically homogeneous sections (segmentation), detect the occurrence of new events (detection), and track the reoccurrence of old or new events (tracking).</p><br>
<p>The goal of Topic Detection and Tracking - Phase 3 (TDT3) is to create core technology to monitor multiple streams of news in multiple languages and media (newswire, radio, television, web sites or some future combination or innovation), segmenting the streams into individual stories, detecting new topics and tracking all stories discussing them. In additional to the TDT-2 tasks of segmentation, detection and tracking, TDT3 adds the tasks of first story detection and story-link detection. The goal of the latter is to detect links between stories that discuss the same topic even though the topic has not been defined in advance.</p><br>
<p>Please see <a href="desc/addenda/LDC2001S95.tbl" rel="nofollow">file.tbl</a> for the directory structure of this publication, as well as a complete list of files.</p><br>
<p>The data files are recordings of Voice of America (VOA) news broadcasts. The data were collected daily over a period of three months (October-December 1998). The audio files in this corpus are single channel, 16 KHz, 16-bit linear SPHERE files.</p><br>
<h3>Updates</h3><br>
<p>There are no updates at this time.</p></br>
Portions © 2001 Trustees of the University of Pennsylvania
DOI: 10.35111/ex24-j205
title: 2000 NIST Speaker Recognition Evaluation

description: <h3>Introduction</h3><br>
<p>2000 NIST Speaker Recognition Evaluation is part of an ongoing series of yearly evaluations conducted by NIST. These evaluations provide an important contribution to the direction of research efforts and the calibration of technical capabilities. They are intended to be of interest to all researchers working on the general problem of text independent speaker recognition. To this end, the evaluation was designed to be simple, to focus on core technology issues, to be fully supported, and to be accessible.</p><br>
<h3>Data</h3><br>
<p>This publication consists of 10,328 single channel SPHERE files encoded in 8-bit mulaw containing a total of approximately 4.31 Gbytes of data covering 148.9 hours of conversational telephone speech collected by LDC.</p><br>
<p>Supporting documentation for this evaluation may be found in the <a href="https://www.nist.gov/sites/default/files/documents/2017/09/26/spk-2000-plan-v1.0.htm_.pdf">2000  Speaker Recognition Evaluation Plan.</a></p><br>
<p>An optional additional corpus, the AHUMADA corpus, was included in the 2000 evaluation. Information about this corpus can be obtained from Javier Ortega-Garcia, Universidad Politecnica de Madrid.</p><br>
<h3>Updates</h3><br>
<p>As of June, 27, 2017, 1,426 files that were not included in this release were added to the corpus. Downloads after that date will contain the complete data set.</p></br>
Portions © 2001 Trustees of the University of Pennsylvania
DOI: 10.35111/spr5-mm07
title: Speech in Noisy Environments 1 (SPINE1 CODED) Coded Audio

description: <h3>Introduction</h3><br>
<p>Speech in Noisy Environments 1 (SPINE1 CODED) Coded Audio contains the Speech in Noisy Environments 1 (SPINE1) Coded Audio Corpus created for the Department of Defense (DoD) Digital Voice Processing Consortium (DDVPC) by Arcon Corp. The transcripts for this publication are available as Speech in Noisy Environments (SPINE1) Training Transcripts <a href="../../../LDC2000T49">LDC2000T49</a> and Speech in Noisy Environments (SPINE1) Evaluation Transcripts <a href="../../../LDC2000T54">LDC2000T54</a>.</p><br>
<p>This work was sponsored in part by <a href="http://www.nsf.gov/" rel="nofollow">National Science Foundation</a> Grant No. IIS-9982201.</p><br>
<h3>Data</h3><br>
<p>For an example transcript, please click <a href="desc/addenda/LDC2000T54.html" rel="nofollow">here</a>. There are a total of 253 files, one "game" each, for a rough total of 19 hours and 28 minutes (~4.4Gb) of audio data.</p><br>
<p>This corpus was used as part of the training set for the Second Speech in Noisy Environments Evaluation (SPINE2). SPINE2 provided a continuing forum for assessing the state of the art and practice in speech recognition technology for noisy military environments and for exchanging information on innovative speech recognition technology in the context of fully implemented systems that perform realistic tasks. The evaluation provided researchers, potential sponsors, and customers with a quantitative means to appreciate the strengths and weaknesses of the technologies.</p><br>
<h3>Updates</h3><br>
<p>There are no updates at this time.</p></br>
DOI: 10.35111/jygm-3h55
title: Message Understanding Conference (MUC) 7

description: <h3>Introduction</h3><br>
<p>Message Understanding Conference (MUC) 7 was produced by Linguistic Data Consortium (LDC) catalog number LDC2001T02 and ISBN 1-58563-205-8.</p><br>
<p>In the 1990s, the MUC evaluations funded the development of metrics and statistical algorithms to support government evaluations of emerging information extraction technologies. Additional information from NIST can be found <a href="http://www.itl.nist.gov/iaui/894.02/related_projects/muc" rel="nofollow">here</a>.</p><br>
<h3>Data</h3><br>
<p>The following list shows the correspondence between versions of the IE task definition and stages of the MUC-7 evaluation.</p><br>
<p>Version #Stage</p><br>
<table><br>
<tbody><br>
<tr><br>
<td>4.1</td><br>
<td>training and dryrun</td><br>
</tr><br>
<tr><br>
<td>4.2</td><br>
<td>formalrun</td><br>
</tr><br>
<tr><br>
<td>5.1</td><br>
<td>final</td><br>
</tr><br>
</tbody><br>
</table><br>
<p>The dryrun and formalrun have different domains; the dryrun (and training) consists of aircrashes scenarios and the formalrun consists of missile launches scenarios. The final version updates especially the Template Relations portion of the guidelines.</p><br>
<p>Normally, for each scenario, two datasets are provided: training and test. When the evaluation cycle begins, the label for the scenario dataset is training. Then the corresponding test dataset for that same scenario is used for the dryrun testing. For the formal run, a formal training set is given out four weeks before the test answers are due. The formal test is given out one week before the test answers are due. After the entire evaluation and meeting have been held, final edits are made if necessary.</p><br>
<h3>Samples</h3><br>
<p>Please view this <a href="desc/addenda/LDC2001T02.txt">text sample</a>.</p><br>
<h3>Updates</h3><br>
<p>August 22, 2001: This publication was inadvertently released without the guidelines documentation and the scoring software. These documents and programs have now been added to the publication and if you previously purchased this corpus and would like to download a complete copy of the corpus please contact<a rel="nofollow"> ldc@ldc.upenn.edu</a>.</p></br>
Portions © 1996 New York Times, © 2001 Trustees of the University of Pennsylvania
DOI: 10.35111/9p29-k947
title: Speech in Noisy Environments (SPINE2) Part 1 Transcripts

description: <h3>Introduction</h3><br>
<p>This corpus was used as part of the training set for the Second Speech in Noisy Environments Evaluation (SPINE2). SPINE2 provides a continuing forum for assessing the state of the art and practice in speech recognition technology for noisy military environments and for exchanging information on innovative speech recognition technology in the context of fully implemented systems that perform realistic tasks. The evaluation will provide researchers, potential sponsors, and customers with a quantitative means to appreciate the strengths and weaknesses of the technologies. Also, the results reported on will invite customer interest in the potential utility of the technologies. More information on this evaluation is available <a href="http://elazar.itd.nrl.navy.mil/spine" rel="nofollow">here</a>.</p><br>
<p>This work was sponsored in part by <a href="http://www.nsf.gov/" rel="nofollow">National Science Foundation</a> Grant No. ISS-9982201.</p><br>
<h3>Data</h3><br>
<p>This publication contains the Speech in Noisy Environments 2 (SPINE2) Training Transcripts, created for the Department of Defense (DoD) Digital Voice Processing Consortium (DDVPC) by Arcon Corp., and produced by the Linguistic Data Consortium (LDC) as catalog number LDC2001T05 with ISBN 1-58563-207-4. The audio for this publication is available as Speech in Noisy Environments (SPINE2) Training Audio <a href="http://catalog.ldc.upenn.edu/LDC2001S04" rel="nofollow">LDC2001S04</a>, ISBN 1-58563-206-6. These corpora support the 2001 Speech in Noisy Environments evaluation.</p><br>
<p>The training data comprises two talker pairs (four speakers total) with 32 conversations (sessions) per talker pair (64 conversations total).</p><br>
<p>The audio for each session is presented in three forms:</p><br>
<ul><br>
<li><strong>Unprocessed:</strong> the signal recorded at the participant's microphone</li><br>
<li><strong>Bitstream:</strong> the compressed "channel" data produced by the vocoder's analysis stage for transmission from sender to receiver</li><br>
<li><strong>Processed:</strong> the signal produced by the vocoder's synthesis stage, given the bitstream data as input.</li><br>
</ul><br>
<p>There are a total of 64 clean audio files and 64 vocoded files, one "game" each, for a rough total of seven hours of audio data, 1.6Gb (including the unprocessed, the processed, and the bitstream files), 20,850 total tokens (730 unique tokens).</p><br>
<h3>Samples</h3><br>
<p>Please view this <a href="desc/addenda/LDC2001T05.txt">transcript sample</a>.</p><br>
<h3>Updates</h3><br>
<p>There are no updates at this time.</p></br>
DOI: 10.35111/1kzm-rz67
title: Speech in Noisy Environments (SPINE2) Part 2 Transcripts

description: <h3>Introduction</h3><br>
<p>Speech in Noisy Environments (SPINE2) Part 2 Transcripts was used as the development set for the Second Speech in Noisy Environments Evaluation (SPINE2). SPINE2 provided a continuing forum for assessing the state of the art and practice in speech recognition technology for noisy military environments and for exchanging information on innovative speech recognition technology in the context of fully implemented systems that perform realistic tasks. The evaluation provided researchers, potential sponsors, and customers with a quantitative means to appreciate the strengths and weaknesses of the technologies.</p><br>
<p>This work was sponsored in part by <a href="http://www.nsf.gov/" rel="nofollow">National Science Foundation</a> Grant No. IIS-9982201.</p><br>
<h3>Data</h3><br>
<p>This publication contains the Speech in Noisy Environments 2 (SPINE2) Development Transcripts, created for the Department of Defense (DoD) Digital Voice Processing Consortium (DDVPC) by Arcon Corp. The audio for this publication is available as Speech in Noisy Environments (SPINE2) Development Audio <a href="http://catalog.ldc.upenn.edu/LDC2001S06" rel="nofollow">LDC2001S06</a>. These corpora supported the 2001 Speech in Noisy Environments evaluation.</p><br>
<p>The development data comprises two talker pairs (four speakers total) with 16 conversations (sessions) per talker pair (32 conversations total).</p><br>
<p>The audio for each session is presented in three forms:</p><br>
<ul><br>
<li><strong>Unprocessed:</strong> the signal recorded at the participant's microphone</li><br>
<li><strong>Bitstream:</strong> the compressed "channel" data produced by the vocoder's analysis stage for transmission from sender to receiver</li><br>
<li><strong>Processed:</strong> the signal produced by the vocoder's synthesis stage, given the bitstream data as input.</li><br>
</ul><br>
<p>There are a total of 32 clean audio files and 32 vocoded files, one "game" each, for a rough total of three and a half hours (207 minutes) of audio data, 811Mb (including the unprocessed, the processed, and the bitstream files), 9,700 total tokens (600 unique tokens).</p><br>
<h3>Samples</h3><br>
<p>Please view this <a href="desc/addenda/LDC2001T07.txt">transcript sample</a>.</p><br>
<h3>Updates</h3><br>
<p>There are no updates at this time.</p></br>
DOI: 10.35111/f67y-cr97
title: Speech in Noisy Environments (SPINE2) Part 3 Transcripts

description: <h3>Introduction</h3><br>
<p>Speech in Noisy Environments (SPINE2) Part 3 Transcripts was used as the evaluation set for the Second Speech in Noisy Environments Evaluation (SPINE2). SPINE2 provided a continuing forum for assessing the state of the art and practice in speech recognition technology for noisy military environments and for exchanging information on innovative speech recognition technology in the context of fully implemented systems that perform realistic tasks. The evaluation provided researchers, potential sponsors, and customers with a quantitative means to appreciate the strengths and weaknesses of the technologies.</p><br>
<p>This work was sponsored in part by <a href="http://www.nsf.gov/" rel="nofollow">National Science Foundation</a> Grant No. IIS-9982201.</p><br>
<h3>Data</h3><br>
<p>This publication contains the Speech in Noisy Environments 2 (SPINE2) Evaluation Transcripts, created for the Department of Defense (DoD) Digital Voice Processing Consortium (DDVPC) by Arcon Corp. The audio for this publication is available as Speech in Noisy Environments (SPINE2) Training Audio <a href="http://catalog.ldc.upenn.edu/LDC2001S08" rel="nofollow">LDC2001S08</a>. These corpora supported the 2001 Speech in Noisy Environments evaluation.</p><br>
<p>The evaluation data comprises 16 talker pairs (32 speakers total) with four conversations (sessions) per talker pair (64 conversations total).</p><br>
<p>The audio for each session is presented in three forms:</p><br>
<ul><br>
<li><strong>Unprocessed:</strong> the signal recorded at the participant's microphone</li><br>
<li><strong>Bitstream:</strong> the compressed "channel" data produced by the vocoder's analysis stage for transmission from sender to receiver</li><br>
<li><strong>Processed:</strong> the signal produced by the vocoder's synthesis stage, given the bitstream data as input.</li><br>
</ul><br>
<p>There are a total of 64 clean audio files and 64 vocoded files, one "game" each, for a rough total of seven hours (423 minutes) of audio data, 1.6Gb (including the unprocessed, the processed, and the bitstream files), 23,300 total tokens (930 unique tokens).</p><br>
<h3>Samples</h3><br>
<p>Please view this <a href="desc/addenda/LDC2001T09.txt">transcript sample</a>.</p><br>
<h3>Updates</h3><br>
<p>There are no updates at this time.</p></br>
DOI: 10.35111/jfkh-w176
title: Chinese Treebank 2.0

description: <p>The Chinese Treebank 2.0 was produced by:</p><br>
<p>Principal Investigators: Martha Palmer, Mitch Marcus, Tony Kroch</p><br>
<p>Consultants: Martha Palmer, Mitch Marcus, Tony Kroch, Shizhe Huang, Mary Ellen Okurowski, John Kovarik, Boyan A. Onyshkevyc</p><br>
<p>Project Managers and Guideline Designers: Fei Xia, Nianwen Xue</p><br>
<p>Annotators: Fu-Dong Chiou, Nianwen Xue</p><br>
<p>Programming support: Zhibiao Wu</p><br>
<h3>Introduction</h3><br>
<p>Published by the Linguistic Data Consortium (LDC), catalog number LDC2001T11 and ISBN 1-58563-204-X.</p><br>
<p>The Chinese Penn Treebank Project started in Summer 1998. The goal is the creation of a 100,000 word corpus of Chinese with syntactic bracketing. More information is available at <a href="https://www.cs.brandeis.edu/~llc/page2/page2.html">The Chinese Treebank Project</a>. Chinese Treebank 2.0 supersedes and replaces the Chinese Penn Treebank Final Release (LDC2000T48 ISBN 1-58563-187-6).</p><br>
<h3>Data</h3><br>
<table><br>
<tbody><br>
<tr><br>
<td>Size:</td><br>
<td>About 100K words, 325 data files</td><br>
</tr><br>
<tr><br>
<td>Source:</td><br>
<td>325 articles from Xinhua newswire between 1994 and 1998</td><br>
</tr><br>
<tr><br>
<td>Coding:</td><br>
<td>GB code</td><br>
</tr><br>
<tr><br>
<td>Format:</td><br>
<td>Same as the UPenn English Treebank except that we keep some original file information was retained such as "SRCID" and "DATE" in the data file.</td><br>
</tr><br>
<tr><br>
<td>Annotation:</td><br>
<td>All the files are annotated at least twice, the first-pass is done by one annotator, and the resulting files are checked by the second annotator (second-pass).</td><br>
</tr><br>
<tr><br>
<td>SGML:</td><br>
<td>All data files validate against <a href="../../../Catalog/desc/addenda/LDC2001T11_1.dtd" rel="nofollow">chtb.dtd</a> using nsmls.</td><br>
</tr><br>
</tbody><br>
</table><br>
<p>The files are located in the data subdirectory and are sequentially named as follows: chtb_nnn.fid where nnn is the sequential file number. There is a cross reference in <a href="../../../Catalog/desc/addenda/LDC2001T11_2.tbl" rel="nofollow">file.tbl</a> which provides some annotator and historical information.</p></br>
Portions © 1994-1998 Xinhua News Agency, © 2001 Trustees of the University of Pennsylvania
DOI: 10.35111/8j7x-fx86
title: Switchboard Cellular Part 1 Transcription

description: <h3>Introduction</h3><br>
<p>Switchboard Cellular Part 1 Transcription was developed by the Linguistic Data Consortium (LDC) and consists of transcripts of approximately 24 hours of English telephone conversations collected by LDC between 1999-2000. The corresponding audio files are contained in Switchboard Cellular Part 1 Transcribed Audio (<a href="../../../LDC2001S15">LDC2001S15</a>).</p><br>
<h3>Data</h3><br>
<p>This release consists of 250 talker pairs (250 speakers total) with one tracnscript (session) per talker pair for a total of 250 conversations. The documentation included with this release includes information on how calls were selected for transcription and on the specification used to transcribe the audio files. </p><br>
<h3>Sample</h3><br>
<p>For an example transcript please click <a href="desc/addenda/LDC2001T14.html" rel="nofollow">here</a>.</p><br>
<h3>Updates</h3><br>
<p>There are no updates at this time.</p></br>
Portions © 1999-2001 Trustees of the University of Pennsylvania
DOI: 10.35111/6at4-b624
title: Arabic Newswire Part 1

description: <h3>Introduction</h3> <p>This publication contains the Arabic Newswire A Corpus, Linguistic Data Consortium (LDC) catalog number LDC2001T55 and ISBN 1-58563-190-6. The Arabic Newswire Corpus is composed of articles from the Agence France Presse (AFP) Arabic Newswire. The source material was tagged using TIPSTER-style SGML and was transcoded to Unicode (UTF-8). The corpus includes articles from May 13, 1994 to December 20, 2000. </p><h3>Data</h3> <p>The data is in 2,337 compressed (zipped) Arabic text data files. There are 209 Mb of compressed data (869 Mb uncompressed) with approximately 383,872 documents containing 76 million tokens over approximately 666,094 unique words. </p><p>A template of the tagging is presented below. </p> yyyymmdd_AFP_ARB.dddd Arabic Text Arabic Text<p>One or More Paragraphs of Arabic Text</p> Arabic Text Arabic Text <p>For a sample file of tagged articles, please see this <a href="/Catalog/desc/addenda/LDC2001T55.gif" rel="nofollow">sample</a>. </p><h3>Updates</h3> There are no updates at this time.  </br>
Portions © 1994-2000 Agence France Press
DOI: 10.35111/y5wv-df10
title: Syllable-Final /s/ Lenition

description: <h3>Introduction</h3> <p>This publication represents a study of lenition of syllable-final // in Latin American Spanish produced by the Linguistic Data Consortium (LDC). The data used in this study came from three other LDC corpora, the <a href="http://catalog.ldc.upenn.edu/LDC96S35" rel="nofollow">CALLHOME Spanish Speech</a> corpus, the <a href="http://catalog.ldc.upenn.edu/LDC96T17" rel="nofollow">CALLHOME Spanish Transcripts</a>, and the <a href="http://catalog.ldc.upenn.edu/LDC96L16" rel="nofollow">CALLHOME Spanish Lexicon</a>. It is a well-known fact that syllable-final /s/ is subject to lenition in many Latin American Spanish dialects. Lenition of -/s/ is a variable phonological process in which an -/s /may be aspirated (pronounced [h]) or deleted altogether. Lenition of -/s/ has been widely studied by sociolinguists, who have identified various linguistic and extralinguistic factors that favor the process. Since syllable-final /s /is frequent in Spanish, lenition has a great effect on overall pronunciation.</p> <h3>Data</h3> <p>Please see <a href="desc/addenda/LDC2001T60.tbl" rel="nofollow">file.tbl</a> for the directory structure of this publication, as well as a complete list of files. The primary data file consists of data stored in the following fields:</p> <ul> <li>Token id</li> <li>Code</li> <li>Confidence level</li> <li>Speaker id</li> <li>Header of the line in the transcript</li> <li>Words from the transcript</li> <li>Location of word in the speakers turn</li> <li>Location of /s/ in the word</li> <li>Preceding segment</li> <li>Following segment</li> <li>Word stress pattern</li> <li>Following word stress pattern</li> <li>Word start time</li> <li>Word end time</li> <li>Length of pause following word</li> <li>Coder</li> <li>Speakers dialect</li> <li>Speakers sex</li> <li>Speakers age</li> <li>Corrected following word</li> <li>Comment</li> <li>Morphological information</li> </ul><p>There are on the order of 3,000 - 4,000 missing occurences of syllable-final /s/ encodings. These omissions occur for two main reasons: changes in the transcriptions after the list of all of the syllable-final /s/ were generated, and the failure of some transcript lines to be automatically aligned. </p><p>For a more detailed description of this publication see the researchers description in <a href="desc/addenda/LDC2001T60.htm" rel="nofollow">HTML </a>or <a href="desc/addenda/LDC2001T60.doc" rel="nofollow">Microsoft Word </a>format. </p> </br>
Portions © 2001 Trustees of the University of Pennsylvania