cometadata/datacite-titles-descriptions-related-identifiers huggingface dataset:
DOI: 10.35111/hs15-5a36
title: ATIS3 Training Data

description: <h3>Introduction</h3><br>
<p>ATIS3 Training Data contains 774 scenarios completed by 137 participants in the ATIS (Air Travel Information Services) collection. The ATIS collection was developed to support the research and development of speech understanding systems. Participants were presented with various hypothetical travel planning scenarios and asked to solve them by interacting with partially or completely automated ATIS systems. The resulting utterances were recorded and transcribed.</p><br>
<p>Data was collected in the early 1990s at five US sites: Raytheon BBN, Carnegie Mellon University, MIT Laboratory for Computer Science, National Institute for Standards and Technology and SRI International.</p><br>
<h3>Data</h3><br>
<p>This release contains over 7,300 utterances, all of which were transcribed; a subset of 2,900 utterances were categorized and annotated with canonical reference answers.</p><br>
<p>The relational database for this dataset included flight information for 46 cities and 52 airports. </p><br>
<p>Two 1,000-utterance test sets were set aside. The first set was used in December 1993; the second was reserved for future testing.</p><br>
<h3>Samples</h3><br>
<ul><br>
<li><a href="desc/addenda/LDC94S19.wav" rel="nofollow">Audio</a></li><br>
<li><a href="desc/addenda/LDC94S19.txt" rel="nofollow">Transcripts</a></li><br>
</ul></br>
Portions © 1994 Trustees of the University of Pennsylvania
DOI: 10.35111/0mh7-c698
title: MACROPHONE

description: <h3>Introduction</h3><br>
<p>MACROPHONE consists of approximately 200,000 utterances by 5,000 speakers. It is designed to provide material sufficient and suitable for research, development and evaluation of automatic speech recognition technology for common telephone applications, such as shopping, transportation, database access and autodialing. In addition to application-oriented phrases and numerous digit strings, seven sentences are spoken by each talker to provide ensemble phoneme, diphone and triphone coverage of the language. The spoken material also refers to times, locations, monetary amounts, spellings and interactive operations.</p><br>
<h3>Data</h3><br>
<p>The utterances were collected automatically over the telephone network by recording directly from a T1 connection in 8 kHz, 8-bit mu-law format. The participants, roughly equal numbers of males and females, were solicited by a marketing firm from all regions of the United States. They ranged in age from the teens to the seventies and represented a broad range of educations and incomes as well. Each recorded utterance is accompanied by an orthographic transcription which also notes any unusual acoustic events or anomalies. Macrophone is the American English contribution to an international database of telephone speech corpora called POLYPHONE. Similar data sets are expected for major languages of the world and at least some of these will be made available through LDC. Prospects are currently good for American Spanish (by early 1995), Dutch, Standard French, Standard German, Japanese, Mandarin Chinese, Swiss French and Danish versions of POLYPHONE, all with basically the same structure and methods of collection.</p><br>
<p>MACROPHONE was collected at SRI under LDC sponsorship. A paper describing it was presented at ICASSP-94: "Macrophone: An American English Telephone Speech Corpus for the POLYPHONE Project," by Jared Bernstein, Kelsey Taussig and Jack Godfrey.</p><br>
<h3>Samples</h3><br>
<p>Please listen to this <a href="desc/addenda/LDC94S21.sph">audio sample</a>.</p><br>
<h3>Updates</h3><br>
<p>None at this time.</p></br>
Portions © 1994 Trustees of the University of Pennsylvania
DOI: 10.35111/8m79-yv13
title: UN Parallel Text (English)

description: <a href="http://catalog.ldc.upenn.edu/LDC94T4A" rel="nofollow">LDC94T4A</a> - Complete UN Parallel Text corpus LDC94T4B-1 - English text only <a href="http://catalog.ldc.upenn.edu/LDC94T4B-2" rel="nofollow">LDC94T4B-2</a> - French text only <a href="http://catalog.ldc.upenn.edu/LDC94T4B-3" rel="nofollow">LDC94T4B-3</a> - Spanish text only <p> This set of three compact discs contains documents provided to the LDC by the United Nations, for use in research on machine translation technology. The documents come from the Office of Conference Services at the UN in New York and are drawn from archives that span the period between 1988 and 1993. </p><p> This publication contains the English, French and Spanish archives, with data from each language stored on a separate disc in the set. Care has been taken to arrange the document files in a parallel directory structure for each language, so that corresponding translations of a document are found directly by means of the directory paths and file names.</p><p> All parallel files in this corpus are English-based: for every file on the English disc, there will be a corresponding file on either the French or Spanish disc, or both. Tables are included on all discs to assist in determining which parallels are present. Due to the nature and organization of UN translation services and the original electronic text archives, the process of finding and sorting out parallel documents yielded a numerous gaps, with many files in each language having no parallel in other languages. </p><p> In preparing the text for publication, we have applied a fully-compliant SGML format (Standard Generalized Markup Language). For those researchers who use SGML, a working DTD (Document Type Definition) is provided on each disc. For those who do not need SGML markup, a simple script is included that can be used to filter out the SGML-specific material and leave only the plain text. The character set used is the 8-bit ISO 8859-1 Latin1, in which accented letters and some other non-ASCII characters occupy the upper 128 entries of the character table. </p> </br>
Portions © 1988-1993 United Nations, © 1994 Trustees of the University of Pennsylvania
DOI: 10.35111/5wdt-ew21
title: UN Parallel Text (French)

description: <a href="http://catalog.ldc.upenn.edu/LDC94T4A" rel="nofollow">LDC94T4A</a> - Complete UN Parallel Text corpus <a href="http://catalog.ldc.upenn.edu/LDC94T4B-1" rel="nofollow">LDC94T4B-1</a> - English text only LDC94T4B-2 - French text only <a href="http://catalog.ldc.upenn.edu/LDC94T4B-3" rel="nofollow">LDC94T4B-3</a> - Spanish text only <p> This set of three compact discs contains documents provided to the LDC by the United Nations, for use in research on machine translation technology. The documents come from the Office of Conference Services at the UN in New York and are drawn from archives that span the period between 1988 and 1993. </p><p> This publication contains the English, French and Spanish archives, with data from each language stored on a separate disc in the set. Care has been taken to arrange the document files in a parallel directory structure for each language, so that corresponding translations of a document are found directly by means of the directory paths and file names.</p><p> All parallel files in this corpus are English-based: for every file on the English disc, there will be a corresponding file on either the French or Spanish disc, or both. Tables are included on all discs to assist in determining which parallels are present. Due to the nature and organization of UN translation services and the original electronic text archives, the process of finding and sorting out parallel documents yielded a numerous gaps, with many files in each language having no parallel in other languages. </p><p> In preparing the text for publication, we have applied a fully-compliant SGML format (Standard Generalized Markup Language). For those researchers who use SGML, a working DTD (Document Type Definition) is provided on each disc. For those who do not need SGML markup, a simple script is included that can be used to filter out the SGML-specific material and leave only the plain text. The character set used is the 8-bit ISO 8859-1 Latin1, in which accented letters and some other non-ASCII characters occupy the upper 128 entries of the character table. </p> </br>
Portions © 1988-1993 United Nations, © 1994 Trustees of the University of Pennsylvania
DOI: 10.35111/60v4-vf53
title: UN Parallel Text (Spanish)

description: <a href="http://catalog.ldc.upenn.edu/LDC94T4A" rel="nofollow">LDC94T4A</a> - Complete UN Parallel Text corpus <a href="http://catalog.ldc.upenn.edu/LDC94T4B-1" rel="nofollow">LDC94T4B-1</a> - English text only <a href="http://catalog.ldc.upenn.edu/LDC94T4B-2" rel="nofollow">LDC94T4B-2</a> - French text only LDC94T4B-3 - Spanish text only <p> This set of three compact discs contains documents provided to the LDC by the United Nations, for use in research on machine translation technology. The documents come from the Office of Conference Services at the UN in New York and are drawn from archives that span the period between 1988 and 1993. </p><p> This publication contains the English, French and Spanish archives, with data from each language stored on a separate disc in the set. Care has been taken to arrange the document files in a parallel directory structure for each language, so that corresponding translations of a document are found directly by means of the directory paths and file names.</p><p> All parallel files in this corpus are English-based: for every file on the English disc, there will be a corresponding file on either the French or Spanish disc, or both. Tables are included on all discs to assist in determining which parallels are present. Due to the nature and organization of UN translation services and the original electronic text archives, the process of finding and sorting out parallel documents yielded a numerous gaps, with many files in each language having no parallel in other languages. </p><p> In preparing the text for publication, we have applied a fully-compliant SGML format (Standard Generalized Markup Language). For those researchers who use SGML, a working DTD (Document Type Definition) is provided on each disc. For those who do not need SGML markup, a simple script is included that can be used to filter out the SGML-specific material and leave only the plain text. The character set used is the 8-bit ISO 8859-1 Latin1, in which accented letters and some other non-ASCII characters occupy the upper 128 entries of the character table. </p> </br>
Portions © 1988-1993 United Nations, © 1994 Trustees of the University of Pennsylvania
DOI: 10.35111/h2vd-p896
title: ECI Multilingual Text

description: <p>The first release of the European Corpus Initiative, the Multilingual Corpus 1 (ECI/MCI), has 46 subcorpora in 27 (mainly European) languages. The total size of these is roughly 92 million (lexical) words. The corpora are marked up using TEI P2 conformant SGML (to varying levels of detail), with easy access to the source text without markup. Twelve of the component corpora are multilingual parallel corpora with from two to nine sub-corpora. All the alphabetic corpora (there is some Japanese and Chinese) are encoded in the ISO LATIN family of 8-bit character sets (ISO 8859-1, -5 and -7). The CD-ROM is in High Sierra format (ISO 9660), readable on UNIX, MSDOS and Apple systems at least.</p><br>
<p>The amount of material per language varies, from about 36 million words (German) to about 5 thousand words (Bulgarian). The majority of sources are journalistic in nature (newspapers, magazines, broadcasts) additional sources include dictionaries (Albanian, Gaelic, Turkish, Japanese/English), literature, technical reports and proceedings or publications of international organizations. The table on the next page lists the languages included, the subcorpus numbers for each language (in parentheses) and the amount of data per language in thousands of lexical words.</p><br>
<p>Language (Subcorpus #) Kwords Totals <br />German (70) 34291 (09) 191 (65) 20 (28) 187 (29) 59 (30) 76 (47) 24 (59) 50 (71) 21 (70A) 999 35918 <br />French (31) 4775 (04) 4121 (28) 187 (29) 59 (30) 76 (47) 24 (51) 6 (59) 50 (71) 21 (32) 1667 10986 <br />Spanish (31) 4500 (13) 830 (14) 1041 (15) 447 (47) 24 (32) 1667 8 (59) 50 (71) 8580 <br />English (31) 4222 (36) 1141 (74) 95 (28) 187 (47) 24 (51) 6 (56) 97 (59) 50 (71) 21 (32) 1667 7510 <br />Dutch (03) 5500 (02) 600 (47) 24 (71) 21 6145 <br />Czech (44) 4726 4726 <br />Italian (11) 3518 (42) 303 (58) 13 (29) 59 (30) 76 (47) 24 (71) 21 4014 <br />Chinese (78) 2895 2895 <br />Greek (10) 2515 (47) 24 (59) 50 (71) 21 2610 <br />Norwegian (41) 2226 2226 <br />Swedish (37) 1718 1718 <br />Serb/Croat/Slov(24) 700 (56) 289 989 <br />Tibetan (76) 834 834 <br />Portuguese (60) 675 (47) 24 (71) 21 720 <br />Malay (80) 563 563<br />Russian (73) 364 364 <br />Japanese (57) 203 203 <br />Turkish (20) 173 (20A) 110 283 <br />Albanian (82) 205 205 <br />Gaelic (55) 141 141 <br />Estonian (39) 100 100 <br />Usbek (81) 88 88 <br />Latin (74) 75 75 <br />Danish (47) 24 (71) 21 45 <br />Lithuanian (89) 20 20 <br />Bulgarian (84) 5 5 <br />Total 91969</p></br>
Portions © 1994 Trustees of the University of Pennsylvania
DOI: 10.35111/pzfc-hd68
title: CSR-III Speech

description: <p>CSR-III Speech, the third ARPA Continuous Speech Recognition (CSR) Benchmark Speech Test Collection, is a three CD-ROM set that contains complete development, test and evaluation test sets for speaker-independent, large-vocabulary speech recognition systems.</p><br>
<p>The development and evaluation tests share a common structure, consisting of two core test components ("hubs") and seven specialized test components ("spokes"). The hub tests, which were mandatory for all ARPA CSR participants in the November 1994 evaluations, provide a baseline for ASR performance, while the spokes provide the means for assessing the impact of particular speaking conditions or processing strategies in relation to baseline performance. Participants were free to take any combination of spoke tests according to their research interests. Taken together, the collection encompasses 180 speakers, each producing 20-40 sentences. These are organized into two complete development test sets and one evaluation set.</p><br>
<p>The collection also includes complete documentation on the test specifications, data collection procedures, transcriptions and scoring protocols, together with the latest available version of NIST software for scoring ASR results and managing SPHERE waveform files. All speech data is accompanied by both the prompting texts and the detailed orthographic transcriptions of the utterances.</p><br>
<p>This was the first ARPA CSR benchmark test in which prompting texts were drawn from a variety of English news sources. Whereas earlier benchmarks were based on Wall Street Journal (WSJ) excerpts from the period 1987-89, CSR-III prompts are from a variety of North American Business News Services: Reuters News Service, New York Times, Wahington Post and Los Angeles Times as well as WSJ; all texts are drawn from financial news articles written during the period of April through June 1994. (NAB stands for "North American Business," in contrast to earlier benchmarks and training collections labeled "WSJ").</p><br>
<p>A companion to the 1994 Benchmark Speech data collection is the four-disk CSR-III Text Collection (<a href="http://catalog.ldc.upenn.edu/LDC95T6" rel="nofollow">LDC95T6</a>), which includes the ARPA CSR 1994 Standard Language Model. This corpus is also available from the LDC as a 1995 release.</p></br>
Portions © 1994 Dow Jones & Company, Inc., Los Angeles Times-Washington Post News Service, Inc., New York Times, Reuters America, Inc., © 1994, 1995 Trustees of the University of Pennsylvania
DOI: 10.35111/8p7y-7b92
title: WSJCAM0 Cambridge Read News

description: <p>A British English Speech Corpus for Large Vocabulary Continuous Speech Recognition (The Cambridge University Version of the ARPA <a href="../../../LDC93S6A">CSR Corpus WSJ0</a>).</p><br>
<p>This release of WSJCA0 represents version 1.1 of the corpus, which was initially released on tape by Cambridge University as of August 31, 1994. This collection was modelled directly on the ARPA <a href="../../../LDC93S6A">CSR Corpus</a> released by LDC in 1993: it used the same dual-microphone recording paradigm and a subset of prompting texts drawn from the Wall Street Journal.</p><br>
<p>There are two key differences between WSJ0 and WSJCAM0: (1) the subjects in WSJCAM0 were native speakers of British English and (2) in addition to standard orthographic transcripts, WSJCAM0 also has information on the time alignment between the sampled waveform and both the words and the phonetic segments.</p><br>
<p>The contents of the publication consist of the following:</p><br>
<ul><br>
<li>Training data from head-mounted microphone</li><br>
<li>Development test data from head-mounted microphone, plus first set of evaluation test data</li><br>
<li>Training data from desk-mounted microphone</li><br>
<li>Development test data from desk-mounted microphone, plus second set of evaluation test data</li><br>
</ul><br>
<p>There are 90 utterances from each of 92 speakers that are designated as training material for speech recognition algorithms. An additional 48 speakers each read 40 sentences containing only words from a fixed 5,000 word vocabulary and another 40 sentences using a 64,000 word vocabulary, to be used as testing material. Each of the total of 140 speakers also recorded a common set of 18 adaptation sentences. Recordings were made from two microphones: a far-field desk microphone and a head-mounted close-talking microphone.</p><br>
<p>Within the train and test sets, speech data are organized by speaker prompting texts and detailed transcriptions and speaker information are included in each speaker directory.</p><br>
<p>All waveform files have NIST SPHERE headers. Waveform data are compressed using the Shorten algorithm developed by Tony Robinson at Cambridge University, as adapted for use in the NIST SPHERE software package.</p><br>
<h3>Samples</h3><br>
<p>Please view the following samples:</p><br>
<ul><br>
<li><a href="desc/addenda/LDC95S24.head.wav">Head Mounted Mic</a></li><br>
<li><a href="desc/addenda/LDC95S24.desk.wav">Desk Mounted Mic</a></li><br>
<li><a href="desc/addenda/LDC95S24.phn.txt">Phoneme Alignments</a></li><br>
<li><a href="desc/addenda/LDC95S24.wrd.txt">Word Alignments</a></li><br>
</ul><br>
<h3>Updates</h3><br>
<p>On October 1, 2015 the corpus was modified to be released as a web download. Documentaiton was modified to reflect this.</p></br>
Portions © 1987-1989 Dow Jones & Company, Inc., © 1995 Trustees of the University of Pennsylvania
DOI: 10.35111/vdzw-3271
title: TRAINS Spoken Dialog Corpus

description: <p>This release contains a corpus of task-oriented spoken dialogs. These dialogs were collected in 1993 at the University of Rochester Department of Computer Science as part of the TRAINS project, a project to develop a conversationally proficient planning assistant, which helps a user construct a plan to achieve some task involving the manufacturing and shipment of goods in a railroad freight system. The collection procedure was designed to make the setting as close to human-computer interaction as possible, but was not a "wizard" scenario, where one person pretends to be a computer. Thus these dialogs provide a snapshot into an ideal human-computer interface that would be able to engage in fluent conversations.</p><br>
<p>Altogether, this corpus includes 98 dialogs, collected using 20 different tasks and 34 different speakers. This amounts to six and a half hours of speech, about 5,900 speaker turns and 55,000 transcribed words.</p></br>
Portions © 1995 Trustees of the University of Pennsylvania
DOI: 10.35111/tfyz-q485
title: ATIS3 Test Data

description: <h3>Introduction</h3><br>
<p>ATIS3 Test Data contains the development, test and evaluation material used in the December 1994 benchmark tests in the ATIS (Air Travel Information Services) project. </p><br>
<p>Under the auspices of the Advanced Research Projects Agency Spoken Language Systems (ARPA-SLS) technology development program, the ATIS collection was developed to support the research and development of speech understanding systems. Participants were presented with various hypothetical travel planning scenarios and asked to solve them by interacting with partially or completely automated ATIS systems. The resulting utterances were recorded and transcribed. Data was collected in the early 1990s at five US sites: Raytheon BBN, Carnegie Mellon University, MIT Laboratory for Computer Science, National Institute for Standards and Technology and SRI International.</p><br>
<h3>Data</h3><br>
<p>Utterances were recorded using a close-talking, noise-canceling head-mounted Sennheiser microphone. For some subjects, secondary (noisier) microphone data was recorded simultaneously. The recorded speech was transcribed and annotated with categorizations and canonical reference answers. </p><br>
<p>This release also contains the ATIS3 46 city/52 airport relational database, a revised Principles of Interpretation document, and test implementation and scoring instructions as well as other relevant documentation.</p><br>
<p>ATIS3 Test Data has been verified, collated and documented by the National Institute of Standards and Technology (NIST) in cooperation with the ARPA-SLS Multi-site ATIS Data Collection Working Group (MADCOW) and is distributed by the Linguistic Data Consortium.</p><br>
<h3>Updates</h3><br>
<p>None at this time.</p></br>
Portions © 1995 Trustees of the University of Pennsylvania
DOI: 10.35111/rzvm-5235
title: PhoneBook: NYNEX Isolated Words

description: PhoneBook is a phonetically-rich, isolated-word, telephone-speech database, created because of (1) the lack of available large-vocabulary isolated-word data, (2) anticipated continued importance of isolated-word and keyword-spotting technology to speech-recognition-based applications over the telephone and (3) findings that continuous-speech training data is inferior to isolated-word training for isolated-word recognition. <p> The goal of PhoneBook is to serve as a large database of American English word utterances incorporating all phonemes in as many segmental/stress contexts as are likely to produce coarticulatory variations, while also spanning a variety of talkers and telephone transmission characteristics. We anticipate that it will be useful in ways analogous to TIMIT/NTIMIT. </p><p> The core section of PhoneBook consists of a total of 93,667 isolated-word utterances, totalling 23 hours of speech. This breaks down to 7,979 distinct words, each said by an average of 11.7 talkers, with 1,358 talkers each saying up to 75 words. All data were collected in 8-bit mu-law digital form directly from a T1 telephone line. Talkers were adult native speakers of American English chosen to be demographically representative of the U.S. </p><p> Given the large set of talkers being recruited for PhoneBook database, it made sense to exploit the opportunity to collect additional utterances. We have chosen spontaneous numerical utterances, because of widespread interest in them and the need for very large numbers of talkers for research into spontaneous-speech effects. We restricted to just three spontaneous digit sequences and one money amount, as the lists for the core of PhoneBook have been designed to approach the limit of reasonable duration for a caller's session. As a result, PhoneBook contains a total of 5,105 spontaneous utterances. </p></br>