cometadata/datacite-titles-descriptions-related-identifiers huggingface dataset:
DOI: 10.35111/xpq7-8p23
title: 2001 HUB5 English Evaluation

description: <h3>Introduction</h3><br>
<p>2001 HUB5 English Evaluation was developed by the Linguistic Data Consortium and consists of approximately 5 hours of English conversational telephone speech and associated transcripts used in the 2001 HUB5 evaluation sponsored by <a href="http://nist.gov/itl/iad/mig/spkr-lang.cfm">NIST</a> (National Institute of Standards and Technology).</p><br>
<p>The HUB5 evaluation series focused on conversational speech recognition over the the telephone with the particular task of transcribing conversational speech into text. Its goals were to explore promising new areas in the recognition of conversational speech, to develop advanced technology incorporating those ideas and to measure the performance of the new technology. Further information about the evaluation is contained in The 2001 NIST Evaluation Plan for Recognition of Conversational Speech over the Telephone, included in this release.</p><br>
<h3>Data</h3><br>
<p>The source data consists of conversational telephone speech collected between 1990-2000 under the Switchboard protocol, specifically, 20 conversations from each of Switchboard-1, Release 2 (<a href="../../../LDC97S62">LDC97S62</a>), Switchboard-2 Phase III Audio (<a href="../../../LDC2002S06">LDC2002S06</a>) and from the Switchboard cellular phone collection, Switchboard Cellular Part 1 Audio (<a href="../../../LDC2001S13">LDC2001S13</a>) and Switchboard Cellular Part 2 Audio (<a href="../../../LDC2004S07">LDC2004S07</a>). In the Switchboard study, recruited speakers were connected through a robot operator to carry on casual conversations about a daily topic announced by the robot operator at the start of the call.</p><br>
<p>The audio files are two-channel &mu;law recordings in sphere format. The corresponding transcripts are presented in stm format.</p><br>
<h3>Samples</h3><br>
<p>Please listen to this <a href="desc/addenda/LDC2002S13.wav">audio sample</a> and view this <a href="desc/addenda/LDC2002S13.txt">transcript sample</a>.</p><br>
<h3>Updates</h3><br>
<p>In March 2015, transcripts were added to this release along with updated documentation.</p></br>
Portions © 1996-2002, 2015 Trustees of the University of Pennsylvania
DOI: 10.35111/y3en-gj62
title: 1997 HUB5 English Evaluation

description: <h3>Introduction</h3><br>
<p>1997 HUB5 English Evaluation was developed by the Lingustic Data Consortium (LDC) and consists of English conversational telephone speech and associated transcripts used in the 1997 HUB5 evaluation sponsored by <a href="http://nist.gov/itl/iad/mig/">NIST</a> (National Institute of Standards and Technology). </p><br>
<p>The Hub5 evaluation series focused on conversational speech over the telephone with the particular task of transcribing conversational speech into text. Its goals were to explore promising new areas in the recognition of conversational speech, to develop advanced technology incorporating those ideas and to measure the performance of new technology. Further information about the evaluation can be found on the <a href="http://www.itl.nist.gov/iad/mig/tests/ctr/1997/">NIST HUB5 website</a> and in The 1997 HUB-5E Evaluation Plan for Recognition of Conversational Speech over the Telephone in English, included in this release.</p><br>
<h3>Data</h3><br>
<p>The source data consists of conversational telephone speech collected by LDC: (1) 20 telephone conversations from the Swtichboard-2 studies (<a href="../../../LDC98S75">LDC98S75</a>, <a href="../../../LDC99S79">LDC99S79</a>) in which recruited speakers were connected through a robot operator to carry on casual conversations about a daily topic announced by the robot operator at the start of the call; and (2) 20 telephone conversations from <a href="http://catalog.ldc.upenn.edu/LDC97S42" rel="nofollow">CALLHOME American English Speech</a> which consists of unscripted telephone conversations between native English speakers.</p><br>
<p>The audio files are in sphere format. The sphere headers have been modified from the original evaluation data by the addition of sample checksums to the CALLHOME data files. The corresponding transcripts are presented in text format.</p><br>
<h3>Samples</h3><br>
<p>Please listen to this <a href="desc/addenda/LDC2002S23.wav">audio sample</a> and view this <a href="desc/addenda/LDC2002S23.txt">transcript sample</a>.</p><br>
<h3>Updates</h3><br>
<p>There are no updates at this time.</p><br>
<h3>Additional Licensing Instructions</h3><br>
<p>This 'members-only' corpora is available to current members who can request the data at the listed reduced-license fee. Contact <a href="mailto:ldc@ldc.upenn.edu">ldc@ldc.upenn.edu</a> for information about becoming a member.</p></br>
Portions © 1996-2002 Trustees of the University of Pennsylvania
DOI: 10.35111/c2j3-2h86
title: 1997 HUB5 German Evaluation

description: <h3>Introduction</h3> <p>The 1997 HUB5 German Evaluation was produced by Linguistic Data Consortium (LDC) catalog number LDC2002S24 and ISBN 1-58563-234-1. </p><p>The 1997 HUB5 Non-English Evaluation is part of an ongoing series of periodic evaluations conducted by NIST. These evaluations provide an important contribution to the direction of research efforts and the calibration of technical capabilities. They are intended to be of interest to all researchers working on the general problem of conversational speech recognition. To this end the evaluation was designed to be simple, to focus on core speech technology issues, to be fully supported, and to be accessible. </p><p>The HUB5 Non-English Evaluation, conducted in the fall of 1997, complemented another related evaluation which was conducted in the spring of that year. The spring evaluation focuses on the recognition of conversational speech in English. This evaluation is dedicated to the advancement of speech recognition technology for languages other than English, and specifically this year for Arabic, German, Mandarin, and Spanish. It focuses also on issues related to porting recognition technology to new languages, to system generality, and to language commonalties and universals. </p><p>The HUB5 Non-English Evaluation focuses on the task of transcribing conversational speech into text. This task is posed in the context of conversational telephone speech in Arabic, German, Mandarin, and Spanish. The evaluation is designed to foster research progress, with the goals of: </p><ul> <li>exploring promising new ideas in the recognition of conversational speech </li> <li>developing advanced technology incorporating these ideas </li> <li>measuring the performance of this technology </li> </ul><p>The task is to transcribe conversational speech. The speech to be transcribed is presented as a set of conversations collected over the telephone. Each conversation is represented as a "4-wire" recording, that is with two distinct sides, one from each end of the telephone circuit. Each side is recorded and stored as a standard telephone codec signal (8 kHz sampling, 8-bit u-law encoding). </p><p>Additional documentation is available at the NIST <a href="http://www.nist.gov/speech/tests/ctr/hub5ne_97/hub5ne_97.htm" rel="nofollow">website</a>. </p><h3>Data</h3> <p>This publication contains 20 sphere files encoded in two channel interleaved mulaw with a sampling rate of 8 KHz, for a total of 561,150,160 bytes (535 Mbytes) or nine hours of sphere data. </p><p>An included documentation table contains information on the speech segments to be processed as follows: </p> ... <h3>Updates</h3> <p>There are no updates at this time. </p> </br>
Portions © 1996-2002 Trustees of the University of Pennsylvania.
DOI: 10.35111/ex0y-vh14
title: 1997 HUB5 Spanish Evaluation

description: <h3>Introduction</h3> <p>The 1997 HUB5 Spanish Evaluation was produced by Linguistic Data Consortium (LDC) catalog number LDC2002S25 and ISBN 1-58563-235-x. </p><p>The 1997 HUB5 Non-English Evaluation is part of an ongoing series of periodic evaluations conducted by NIST. These evaluations provide an important contribution to the direction of research efforts and the calibration of technical capabilities. They are intended to be of interest to all researchers working on the general problem of conversational speech recognition. To this end the evaluation was designed to be simple, to focus on core speech technology issues, to be fully supported, and to be accessible. </p><p>The HUB5 Non-English Evaluation focuses on the task of transcribing conversational speech into text. This task is posed in the context of conversational telephone speech. The evaluation is designed to foster research progress, with the goals of: </p><ul> <li>exploring promising new ideas in the recognition of conversational speech </li> <li>developing advanced technology incorporating these ideas </li> <li>measuring the performance of this technology </li> </ul><p>The task is to transcribe conversational speech. The speech to be transcribed is presented as a set of conversations collected over the telephone. Each conversation is represented as a "4-wire" recording, that is with two distinct sides, one from each end of the telephone circuit. Each side is recorded and stored as a standard telephone codec signal (8 kHz sampling, 8-bit mu-law encoding). </p><p>Additional documentation is available on the NIST <a href="http://www.nist.gov/speech/tests/ctr/hub5ne_97/hub5ne_97.htm" rel="nofollow">website</a>. </p><h3>Data</h3> <p>This publication contains 20 sphere files encoded in two channel interleaved mulaw with a sampling rate of 8 KHz, for a total of 447,201,280 bytes (426 Mbytes) or seven hours of sphere data. </p><p>An included documentation table contains information on the speech segments to be processed as follows: </p> ... <h3>Updates</h3> <p>There are no updates at this time. </p> </br>
Portions © 2002 Trustees of the University of Pennsylvania.
DOI: 10.35111/37ff-a902
title: Emotional Prosody Speech and Transcripts

description: <h3>Introduction</h3><br>
<p>Emotional Prosody Speech and Transcripts was developed by the Linguistic Data Consortium and contains audio recordings and corresponding transcripts, collected over an eight month period in 2000-2001 and designed to support research in emotional prosody. The recordings consist of professional actors reading a series of semantically neutral utterances (dates and numbers) spanning fourteen distinct emotional categories, selected after Banse & Scherers study of vocal emotional expression in German. (Banse, R. & Scherer, K. R. 1996. Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology, 70, 614-636.)</p><br>
<p>Actor participants were provided with descriptions of each emotional context, including situational examples adapted from those used in the original German study. Flashcards were used to display series of four-syllable dates and numbers to be uttered in the approriate emotional category.</p><br>
<p>The Prosody Recordings Project was interested in capturing the aspects of speech (emotion, intonation) that are left out of the written form of a message. In these experiments, simple phrases are expressed in ways that reflect varied contexts. The same phrase might be used to answer different questions, address listeners at different distances from the speaker, or express different emotional states. Actors were used because they are experts at producing this kind of contextual variation in a natural and convincing way.</p><br>
<h3>Data</h3><br>
<p>There are 30 data files: 15 recordings in sphere format and their transcripts. </p><br>
<p>The sphere files are encoded in two-channel interleaved 16-bit PCM, high-byte-first (big-endian) format, for a total of 2,912,067,980 bytes (2777 Mbytes) or nine hours of sphere data.</p><br>
<p>The utterences were recorded directly into WAVES+ datafiles, on two channels with a sampling rate of 22.05K. The two microphones used were a stand-mounted boom Shure SN94 and a headset Seinnheiser HMD 410.</p><br>
<p>The original session recordings are provided in their entirety, including informal chit-chat and discussion between each emotion category elicitation task. Time alignment is limited to utterances within the formal elicitation tasks and miscellanous regions have been marked as such.</p><br>
<h3>Samples</h3><br>
<ul><br>
<li><a href="desc/addenda/LDC2002S28.wav" rel="nofollow">Speech</a></li><br>
<li><a href="desc/addenda/LDC2002S28.txt" rel="nofollow">Transcripts</a></li><br>
</ul><br>
<h3>Updates</h3><br>
<p>There are no updates at this time.</p></br>
Portions © 2000-2002 Trustees of the University of Pennsylvania.
DOI: 10.35111/6ex1-y346
title: 2001 NIST Speaker Recognition Evaluation Corpus

description: <h3>Introduction</h3><br>
<p>2001 NIST Speaker Recognition Evaluation Corpus was developed by the Linguistic Data Consortium (LDC)  and consists of conversational cellular telephone speech collected by LDC.</p><br>
<p>This release is part of an ongoing series of yearly evaluations conducted by NIST. These evaluations provide an important contribution to the direction of research efforts and the calibration of technical capabilities. They are intended to be of interest to all researchers working on the general problem of text independent speaker recognition. To this end the evaluation was designed to be simple, to focus on core technology issues, to be fully supported, and to be accessible.</p><br>
<p>Supporting documentation for this evaluation may be found in the <a href="https://www.nist.gov/sites/default/files/documents/2017/09/26/2001-spkrec-evalplan-v05.9.pdf" rel="nofollow">2001 NIST Speaker Recognition Evaluation Plan</a>.</p><br>
<h3>Data</h3><br>
<p>The files are divided into evaluation and development data. There are a total of 2,350 compressed speech files all of which are in sphere format. The sphere files are compressed and encoded in one channel 8-bit mulaw, for a total of 575,337,198 bytes (548.7 Mbytes), or 26 hours of sphere data.</p><br>
<p>The evaluation data is divided into evaluation training data and evaluation test data. The training data consists of 174 speech files that are two minutes long. The test data comprises 2,038 speech files of varying lengths not exceeding sixty seconds.</p><br>
<p>The development data is similarly divided into development training data and development test data. The training data comprises 60 speech files with durations of two minutes per target speaker. The 78 development test data files contain segments of varying length not exceeding 60 seconds.</p><br>
<h3>Updates</h3><br>
<p>No updates are available at this time.</p></br>
Portions © 1997-2002 Trustees of the University of Pennsylvania
DOI: 10.35111/d86m-x152
title: Voicemail Corpus Part II

description: <h3>Introduction</h3><br>
<p>Voicemail Corpus Part II was produced by Linguistic Data Consortium (LDC) catalog number LDC2002S35 and ISBN 1-58563-242-2. Voicemail Corpus Part II is a continuation of Voicemail Corpus Part I, <a href="../../../LDC98S77" rel="nofollow">LDC98S77</a>.</p><br>
<h3>Data</h3><br>
<p>This publication is comprised of speech and script files, and is structured in training and evaluation data. The training data consists of 2,048 voicemail messages and the corresponding script files. The speech and script files are organized in 41 directories, each of which contains up to 50 messages. The evaluation data consists of 50 voicemail messages and 50 scripts.</p><br>
<p>The speech data is provided in sphere format it is sampled at 8 KHz, and recorded in 8-bit ulaw, totalling approximately 14 hours (406 MB) for training and 23 minutes (11 MB) for evaluation.</p><br>
<p>In addition to the individual script files, there are three files which represent a concatenation of the individual scripts: train_scripts.all and eval_scripts .all represent a concatenation of the training and evaluation script files, one file per line, each line beginning with the fileID. eval_scripts_filtered.all is a filtered version of the file eval_scripts.all, after eliminating the tagged elements () and the proper nouns marker.</p><br>
<h3>Updates</h3><br>
<p>A more recent version of the paper Automatic Speech Recognition Performance on a Voicemail Transcription Task (M. Padmanabhan, G. Saon, J. Huang, B. Kingsbury and L. Mangu, IEEE Transactions on Speech and Audio Processing, vol 10, number 7, pp 433-442, October 2002) is available in both PDF and PS format by email request.</p><br>
<h3>Samples</h3><br>
<p>Please view the following samples:</p><br>
<ul><br>
<li><a href="desc/addenda/LDC2002S35.1.sph">Audio Sample 1 (SPH)</a></li><br>
<li><a href="desc/addenda/LDC2002S35.1.txt">Transcript Sample 1 (TXT)</a></li><br>
<li><a href="desc/addenda/LDC2002S35.2.sph">Audio Sample 2 (SPH)</a></li><br>
<li><a href="desc/addenda/LDC2002S35.2.txt">Transcript Sample 2 (TXT)</a></li><br>
</ul><br>
<h3>Additional Licensing Instructions</h3><br>
<p>This 'members-only' corpora is available to current members who can request the data at the listed reduced-license fee. Contact <a href="mailto:ldc@ldc.upenn.edu">ldc@ldc.upenn.edu</a> for information about becoming a member.</p></br>
Portions © 2002 International Business Machines Corporation, © 2002 Trustees of the University of Pennsylvania
DOI: 10.35111/kahy-mp21
title: CALLHOME Egyptian Arabic Speech Supplement

description: <h3>Introduction</h3><br>
<p>The CALLHOME Egyptian Arabic Speech Supplement was produced by Linguistic Data Consortium (LDC), catalog number LDC2002S37 and ISBN 1-58563-243-0.</p><br>
<p>This publication contains 20 CALLHOME Egyptian Arabic telephone conversations. The corresponding transcripts are published as CALLHOME Egyptian Arabic Transcripts Supplement, LDC catalog number <a href="http://catalog.ldc.upenn.edu/LDC2002T38" rel="nofollow">LDC2002T38</a>. These conversations had originally been held in reserve for future NIST HUB5 Non-English evaluations, but are being "re-tasked" to provide additional material for general use.</p><br>
<h3>Data</h3><br>
<p>There are 20 data files in sphere format. The files are 8 KHz shorten-compressed two-channel mulaw. 12 of the files were recorded from domestic phone calls (both parties living in the continental U.S.), while the other eight are overseas calls (a participant in the U.S. called a friend or relative in Egypt or some other overseas country).</p><br>
<p>There is a total of 273,681,144 bytes (261 Mbytes) or eight hours of audio data.</p><br>
<h3>Samples</h3><br>
<p>Please listen to this <a href="desc/addenda/LDC2002S37.sph">speech sample</a>.</p><br>
<h3>Updates</h3><br>
<p>There are no updates at this time.</p></br>
Portions © 1996-2002 Trustees of the University of Pennsylvania.
DOI: 10.35111/et6h-0e55
title: Multiple-Translation Chinese Corpus

description: <h3>Introduction</h3><br>
<p>Multiple-Translation Chinese Corpus was developed by the Linguistic Data Consortium (LDC) and contains 17 human and machine tranlsations of Chinese newswire and broeadcast data.</p><br>
<p>To support the development of automatic means for evaluating translation quality, LDC was sponsored to solicit 11 sets of human translations for a single set of Mandarin Chinese source materials. LDC was also asked to produce translations from various commercial machine translation (MT) systems as well as from MT systems available on the Internet.</p><br>
<h3> Data</h3><br>
<p>Three sources of journalistic Mandarin Chinese text were selected from existing LDC corpora:</p><br>
<ul><br>
<li>Xinhua News Service: 52 news stories</li><br>
<li>Zaobao News Service: 27 news stories</li><br>
<li>Voice of America Mandarin broadcast transcripts: 26 news stories</li><br>
</ul><br>
<p>for a total of 105 stories.</p><br>
<p>For an example of Mandarin Chinese Text please click on this <a href="desc/addenda/LDC2002T01.gif%20" rel="nofollow">example</a>. For an example of English translation please click on this <a href="desc/addenda/LDC2002T01_engl.html" rel="nofollow">example</a>.</p><br>
<p>The Xinhua data were drawn from Chinese Treebank 2.0 (<a href="http://catalog.ldc.upenn.edu/LDC2001T11" rel="nofollow">LDC2001T11</a>); the file names and "doc_id" attributes assigned to these stories match the file names used in the Chinese Treebank release.</p><br>
<p>The Zaobao and VOA data were both drawn from TDT3 Multilanguage Text Version 2.0 (<a href="http://catalog.ldc.upenn.edu/LDC2001T58" rel="nofollow">LDC2001T58</a>); their file names and "doc_id" attributes match the "DOCNO" tags assigned to these stories in the TDT3 release.</p><br>
<p>Selection of stories from the two newswire collections was controlled by story length: all selected stories contain between about 340 and 400 Chinese characters. The selection from VOA broadcasts varied more widely, between 100 and 1,000 characters per story.</p><br>
<p>The VOA Mandarin transcripts in TDT3 were created manually by a professional transcription service, but with limited editorial quality control -- while generally quite complete, these transcripts were not expected to exceed the quality or accuracy of closed-caption text in television broadcasts.</p><br>
<p>Zaobao is a news portal from Singapore and many of its news stories are translations from other news agencies' releases.</p><br>
<p>There are a total of 1,890 data files.</p><br>
<h3>Updates</h3><br>
<p><strong>February 23, 2002</strong>: Possibly due to segmentation errors, two of the Machine Translation (MT) systems, tb2 and tb3, have output seven instances of obscenities, in files VOM19981114_0900_1588.sgm and chtb_177.sgm</p></br>
Portions: © 1998 SPH AsiaOne Ltd, © 1994-1998 Xinhua News Agency, © 2002 Trustees of the University of Pennsylvania
DOI: 10.35111/1hgg-8891
title: Translanguage English Database (TED) Transcripts

description: <h3>Introduction</h3><br>
<p>Translanguage English Database (TED) Transcripts consists of transcripts of presentations by 39 native English and non-native English speakers at the <a href="http://dblp.uni-trier.de/db/conf/interspeech/eurospeech1993.html">Third European Conference on Speech Communication and Technology, EUROSPEECH 1993</a> in Berlin, Germany. This is a joint publication with the <a href="http://www.elra.info/" rel="nofollow">European Language Resources Association (ELRA)</a> sponsored in part by <a href="http://www.nsf.gov/" rel="nofollow">National Science Foundation</a> Grant No. IIS-9982201. The data set is released by ELRA as Translanguage English Database (TED) Transcripts database (<a href="http://catalog.elra.info/product_info.php?products_id=637">ELRA-S0120</a>).  </p><br>
<h3>Data</h3><br>
<p>The transcripts in this release were developed by the Linguistic Data Consortium and are a subset of the speech recordings in Translanguage English Database (TED) Speech <a href="http://catalog.ldc.upenn.edu/LDC2002S04" rel="nofollow">LDC2002S04</a> and ELRA publication <a href="http://catalog.elra.info/product_info.php?products_id=743">ELRA-S0031</a>. </p><br>
<p>The transcripts are in Universal Transcription Format (UTF). All UTF files were validated against a utf.dtd. Tables containing speaker demographic information and cross-references of file names from the TED audio corpus are included this release. A transcript sample is available <a href="desc/addenda/LDC2002T03.01.example" rel="nofollow">here</a>.</p><br>
<h2>Updates</h2><br>
<p>There are no updates at this time</p></br>
Portions © 1993-2002 University of Munich, LIMSI-CNRS, ELRA, © 2002 Trustees of the University of Pennsylvania