cometadata/datacite-titles-descriptions-related-identifiers huggingface dataset:
DOI: 10.35111/8rdp-tq10
title: LORELEI Entity Detection and Linking Knowledge Base

description: <h3>Introduction</h3><br>
<p>LORELEI Entity Detection and Linking Knowledge Base was developed by the Linguistic Data Consortium (LDC) and contains the full LORELEI Entity Detection and Linking (EDL) Knowledge Base (KB) used for all LORELEI Representative Language and Incident Language Pack entity linking annotation. The KB content was drawn from GeoNames, the CIA World Leaders List and the CIA World Factbook and was supplemented with manually-created KB entries developed specifically for LORELEI data.</p><br>
<p>The LORELEI (Low Resource Languages for Emergent Incidents) Program was concerned with building human language technology for low resource languages in the context of emergent situations like natural disasters or disease outbreaks. Linguistic resources for LORELEI include Representative Language Packs and Incident Language Packs for over two dozen low resource languages, comprising data, annotations, basic natural language processing tools, lexicons and grammatical resources. Representative languages were selected to provide broad typological coverage, while incident languages were selected to evaluate system performance on a language whose identity was disclosed at the start of the evaluation.</p><br>
<h3>Data</h3><br>
<p>This corpus is comprised of an English knowledge base to support the EDL task in LORELEI for four entity types: geo-political entities (GPE), locations, including facilities (LOC), persons (PER) and organizations (ORG). There are four inputs to the KB, each designated by a unique "origin" code in the KB, as follows: GPE and LOC entities from a 2015 snapshot of <a href="http://www.geonames.org/">GeoNames</a>, PER entities from the <a href="https://www.cia.gov/library/publications/world-leaders-1/">CIA World Leaders List</a> dated May 2015, ORG entities from <a href="https://www.cia.gov/library/publications/resources/the-world-factbook/appendix/appendix-b.html"> Appendix B of the CIA World Factbook</a> downloaded in 2015, and additional entities manually created by LDC for each of the representative and incident languages.</p><br>
<p>The KB contains a total of 10,216,832 entities and consists of three tab-delimited files, which are linked via the entityid in each entry. More information is contained in the included documentation.</p><br>
<h3>Acknowledgement</h3><br>
<p>This material is based upon work supported by the Defense Advanced Research Projects Agency (DARPA) under Contract No. HR0011-15-C-0123. Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of DARPA.</p><br>
<h3>Samples</h3><br>
<p>Please view the following samples:</p><br>
<ul><br>
<li><a href="desc/addenda/LDC2020T10.altnames.tab">Alternate Names Sample</a></li><br>
<li><a href="desc/addenda/LDC2020T10.ent.tab">Entities Sample</a></li><br>
<li><a href="desc/addenda/LDC2020T10.ms.tab">Member States Sample</a></li><br>
</ul><br>
<h3>Updates</h3><br>
<p>None at this time.</p></br>
Portions © 2020 Trustees of the University of Pennsylvania
DOI: 10.35111/vreb-7n07
title: SemTransCNC

description: <h3>Introduction</h3><br>
<p>SemTransCNC was developed by <a href="https://www.polyu.edu.hk/en/">The Hong Kong Polytechnic University</a>. It is comprised of a semantic transparency dataset of Chinese nominal compounds built using a series of crowd-based experiments.</p><br>
<p>Nominal compounds were selected from the <a href="https://ckip.iis.sinica.edu.tw/project/sinicacorpus/">Sinica Corpus</a> and a modern Chinese lexicon. Crowd workers answered questionnaires that included demographic information and questions about the Chinese language. For assessing overall semantic transparency (OST) of selected compounds, they answered the question: "How is the sum of the meanings of <em>A</em> and <em>B</em> similar to the meaning of <em>AB</em>?" For assessing constituent semantic transparency (CST), they were asked to describe the similarity of <em>A</em> alone to its meaning in <em>AB</em> and the meaning of <em>B</em> alone to its meaning in <em>AB</em>.</p><br>
<h3>Data</h3><br>
<p>SemTransCNC consists of OST and CST data for 1,176 dimorphemic Chinese nominal compounds, which consist of free morphemes and have mid-range frequencies.</p><br>
<p>The text data is presented as a UTF-8 encoded comma separated text file.</p><br>
<h3>Samples</h3><br>
<p>Please view this <a href="desc/addenda/LDC2020T12.csv">text sample (CSV)</a>.</p><br>
<h3>Updates</h3><br>
<p>None at this time.</p></br>
Portions © 2020 The Hong Kong Polytechnic University, © 2020 Trustees of the University of Pennsylvania
DOI: 10.35111/cwdb-n353
title: Road Rally

description: The Road Rally corpus was designed for the development and testing of word-spotting systems and was collected in a conversational domain using a road rally planning task as the topic. The corpus actually consists of two sub-corpora: "Stonehenge" and "Waterloo." The Stonehenge corpus contains road rally planning conversations as well as some read speech collected using high quality microphones and a telephone-simulating filter. The Waterloo corpus contains read road rally planning domain speech which was collected using actual telephone lines.<li><b>Stonehenge</b></li> The Stonehenge corpus was collected from subjects using telephone handsets which were modified to contain a high quality microphone. To gather conversational data, two talkers were located in separate rooms, given a road map and asked to participate in a road rally planning task. Their objective was to form a path between two locations on the map which would maximize their road rally point score. They were also given a time limit in which to complete the task to increase their responsiveness. Their speech was recorded on a stereo tape recorder with each subject's speech on a separate track. The tracks were digitized and the speech was edited to remove silences longer than a second or so. This resulted in approximately three minutes of continuous speech per subject. The speech was filtered using a 300Hz to 3300Hz PCM FIR bandpass filter to simulate telephone bandwidth quality. The Stonehenge corpus consists of 80 speakers; 28 females and 52 males.<li><b>Waterloo</b></li> The Waterloo corpus was collected as an extension to Stonehenge to provide similar domain speech under different conditions. The corpus was collected from subjects using conventional telephones and dialed up telephone lines in the Massachussetts area. Unlike the Stonehenge speech, the Waterloo speech is naturally band-limited by the telephones/lines but for consistency, the speech was also filtered using the Stonehenge 300Hz to 3300Hz PCM FIR bandpass filter. The corpus consists of 56 speakers (28 males and 28 females) each reading aloud a paragraph of road rally domain speech.</br>
DOI: 10.35111/2jq6-pa48
title: TIMIT Acoustic-Phonetic Continuous Speech (MS-WAV version)

description: <h3>Introduction</h3> <p>This version of the TIMIT Acoustic-Phonetic Continuous Speech Corpus (LDC93S1) has all the waveform files formatted with ms-wav / RIFF headers, to make the corpus more accessible to a wider audience.</p> <p>The TIMIT corpus of read speech is designed to provide speech data for acoustic-phonetic studies and for the development and evaluation of automatic speech recognition systems. TIMIT contains broadband recordings of 630 speakers of eight major dialects of American English, each reading ten phonetically rich sentences. The TIMIT corpus includes time-aligned orthographic, phonetic and word transcriptions as well as a 16-bit, 16kHz speech waveform file for each utterance. Corpus design was a joint effort among the Massachusetts Institute of Technology (MIT), SRI International (SRI) and Texas Instruments, Inc. (TI). The speech was recorded at TI, transcribed at MIT and verified and prepared for CD-ROM production by the National Institute of Standards and Technology (NIST). </p> <p>The TIMIT corpus transcriptions have been hand verified. Test and training subsets, balanced for phonetic and dialectal coverage, are specified. Tabular computer-searchable information is included as well as written documentation.</p><h3>Samples</h3> <ul> <li> <a href="./desc/addenda/LDC93S1.phn" rel="nofollow">phonemes</a> </li> <li><a href="./desc/addenda/LDC93S1.txt" rel="nofollow">transcripts</a></li> <li><a href="./desc/addenda/LDC93S1.wav" rel="nofollow">audio</a></li> <li><a href="./desc/addenda/LDC93S1.wrd" rel="nofollow">word list</a></li> </ul></br>
Portions © 1993 Trustees of the University of Pennsylvania
DOI: 10.35111/0zg2-nn38
title: NTIMIT

description: <p>NTIMIT was developed by the NYNEX Science and Technology Speech Communication Group to provide a telephone bandwidth adjunct to TIMIT (<a href="../../../LDC93S1">LDC93S1</a>).</p><br>
<p>NTIMIT was collected by transmitting all 6,300 original TIMIT recordings through a telephone handset and over various channels in the NYNEX telephone network and redigitizing them. The recordings were transmitted through ten Local Access and Transport Areas, half of which required the use of long-distance carriers.</p><br>
<p>In order to calibrate the transmission characteristics of the various channels, stationary 1 kHz and frequency-sweeping tones were also recorded for each of the transmission channels.</p><br>
<p>The re-recorded waveforms were time-aligned with the original TIMIT waveforms so that the TIMIT time-aligned transcriptions can be used with NTIMIT as well. In addition to the documentation included with this release, see Jankowski et al., "NTIMIT: A Phonetically Balanced, Continuous Speech, Telephone Bandwidth Speech Database," Proc. ICASSP-90, April 1990. NYNEX retains full copyright on the corpus and all associated materials.</p><br>
<h3>Updates</h3><br>
<p>(02/08/2016) All sphere files were updated to flac, and the corpus was converted from a media release to a web download. Documentation was edited to reflect these changes. Note that some documentation may still refer to the corpus as being relased on CD-ROM and containing sphere files.</p></br>
DOI: 10.35111/g20s-2a57
title: ATIS0 Complete

description: <h3>Introduction</h3><br>
<p>ATIS0 Complete is comprised of spontaneous speech, read speech and other material from participants in the ATIS collection that is contained in the following corpora: ATIS0 Pilot (<a href="http://catalog.ldc.upenn.edu/LDC93S4B" rel="nofollow">LDC93S4B</a>), ATIS0 Read (<a href="http://catalog.ldc.upenn.edu/LDC93S4B-2" rel="nofollow">LDC93S4B-2</a>) and ATIS0 SD-Read (<a href="http://catalog.ldc.upenn.edu/LDC93S4B-3" rel="nofollow">LDC93S4B-3</a>).</p><br>
<p>The ATIS (Air Travel Information Services) collection was developed to support the research and development of speech understanding systems. Participants were presented with various hypothetical travel planning scenarios and asked to solve them by interacting with partially or completely automated ATIS systems. The resulting utterances were recorded and transcribed. Data was collected in the early 1990s at five US sites: Raytheon BBN, Carnegie Mellon University, MIT Laboratory for Computer Science, National Institute for Standards and Technology and SRI International.</p><br>
<p>ATIS0 Pilot contains spontaneous utterances elicited in a "Wizard-of-Oz" simulation, along with a relational database containing travel information (excluding connecting flights). In that data set, 36 speakers produced a total of 912 utterances.</p><br>
<p>ATIS0 Read contains "read" versions of the spontaneous utterances for 20 of the 36 speakers above, for a total of 478 productions. This is supplemented by a set of 40 "adaptation" sentences read by each of the 20 speakers.</p><br>
<p>ATIS0 SD-Read contains "read" speech in the ATIS domain for ten of the speakers in ATIS0 Pilot consituting 3,171 utterances, or approximately 317 utterances per speaker.</p><br>
<h3>Data</h3><br>
<p>ATIS speech data was recorded at 16kHz sample rate, 16-bit quantization, from two microphones: a close-talking (Sennheiser HMD414) and a desk-top (Crown PCC-160) model. Utterances were transcribed.</p><br>
<h3>Samples</h3><br>
<p>Please view this <a href="desc/addenda/LDC93S4A.wav">audio sample</a> and <a href="desc/addenda/LDC93S4A.txt">transcript sample</a>.</p><br>
<h3>Updates</h3><br>
<p>None at this time.</p></br>
Portions © 1993 Trustees of the University of Pennsylvania
DOI: 10.35111/4t8c-r397
title: ATIS0 Pilot

description: <p><a href="http://catalog.ldc.upenn.edu/LDC93S4A" rel="nofollow">LDC93S4A</a> - Complete ATIS0 corpus LDC93S4B - ATIS0 Pilot <a href="http://catalog.ldc.upenn.edu/LDC93S4B-2" rel="nofollow">LDC93S4B-2</a> - ATIS0 Read <a href="http://catalog.ldc.upenn.edu/LDC93S4B-3" rel="nofollow">LDC93S4B-3</a> - ATIS0 SD-Read</p><br>
<p>The ATIS0 Corpus is comprised of six parts: one with spontaneous data from 36 speakers; one with read versions of the data from 20 of those speakers, along with some adaptation material; and four with extensive speaker dependent material from the ATIS domain, read by ten of the same speakers.</p><br>
<p>All ATIS speech data is recorded at 16kHz sample rate, 16-bit quantization, from two different microphones, a close-talking (Sennheiser HMD414) and a desk-top (Crown PCC-160) model.</p><br>
<p>The first disc (ATIS0 Pilot) contains spontaneous utterances elicited in a "Wizard-of-Oz" simulation, along with the relational database containing the travel information (excluding connecting flights). 36 speakers produced a total of 912 utterances.</p><br>
<p>The second disc (ATIS0 Read) contains "read" versions of the spontaneous utterances for 20 of the 36 speakers above, for a total of 478 productions. This is supplemented by a set of 40 "adaptation" sentences read by each of the 20 speakers.</p><br>
<p>The third through the sixth discs (ATIS0 SD-Read) contain "read" speech in the ATIS domain for ten of the speakers on the first disc. They read a total of 3,171 utterances, or approximately 317 utterances per speaker. This data was collected for the purpose of training speaker-dependent speech recognition systems for the ATIS0 domain. Two of these four discs contain the close-talking (Sennheiser) microphone data and the other two contain corresponding data for the desk-top (Crown PCC-160) microphone. Thus there are 6,342 waveform files on the four discs.</p></br>
Portions © 1993 Trustees of the University of Pennsylvania
DOI: 10.35111/n7da-xk25
title: ATIS0 Read

description: <a href="http://catalog.ldc.upenn.edu/LDC93S4A" rel="nofollow">LDC93S4A</a> - Complete ATIS0 corpus <a href="http://catalog.ldc.upenn.edu/LDC93S4B" rel="nofollow">LDC93S4B</a> - ATIS0 Pilot LDC93S4B-2 - ATIS0 Read <a href="http://catalog.ldc.upenn.edu/LDC93S4B-3" rel="nofollow">LDC93S4B-3</a> - ATIS0 SD-Read <p> The ATIS0 Corpus totals six CD-ROMs: one with spontaneous data from 36 speakers; one with read versions of the data from 20 of those speakers, along with some adaptation material; and four with extensive speaker dependent material from the ATIS domain, read by ten of the same speakers. </p><p> All ATIS speech data is recorded at 16kHz sample rate, 16-bit quantization, from two different microphones, a close-talking (Sennheiser HMD414) and a desk-top (Crown PCC-160) model. </p><p> The first disc (ATIS0 Pilot) contains spontaneous utterances elicited in a "Wizard-of-Oz" simulation, along with the relational database containing the travel information (excluding connecting flights). 36 speakers produced a total of 912 utterances.</p><p> The second disc (ATIS0 Read) contains "read" versions of the spontaneous utterances for 20 of the 36 speakers above, for a total of 478 productions. This is supplemented by a set of 40 "adaptation" sentences read by each of the 20 speakers.</p><p> The third through the sixth discs (ATIS0 SD-Read) contain "read" speech in the ATIS domain for ten of the speakers on the first disc. They read a total of 3,171 utterances, or approximately 317 utterances per speaker. This data was collected for the purpose of training speaker-dependent speech recognition systems for the ATIS0 domain. Two of these four discs contain the close-talking (Sennheiser) microphone data and the other two contain corresponding data for the desk-top (Crown PCC-160) microphone. Thus there are 6,342 waveform files on the four discs.</p></br>
Portions © 1993 Trustees of the University of Pennsylvania
DOI: 10.35111/qabj-bp07
title: ATIS0 SD Read

description: <a href="http://catalog.ldc.upenn.edu/LDC93S4A" rel="nofollow">LDC93S4A</a> - Complete ATIS0 corpus <a href="http://catalog.ldc.upenn.edu/LDC93S4B" rel="nofollow">LDC93S4B</a> - ATIS0 Pilot <a href="http://catalog.ldc.upenn.edu/LDC93S4B-2" rel="nofollow">LDC93S4B-2</a> - ATIS0 Read LDC93S4B-3 - ATIS0 SD-Read <p> The ATIS0 Corpus totals six CD-ROMs: one with spontaneous data from 36 speakers; one with read versions of the data from 20 of those speakers, along with some adaptation material; and four with extensive speaker dependent material from the ATIS domain, read by ten of the same speakers. </p><p> All ATIS speech data is recorded at 16kHz sample rate, 16-bit quantization, from two different microphones, a close-talking (Sennheiser HMD414) and a desk-top (Crown PCC-160) model. </p><p> The first disc (ATIS0 Pilot) contains spontaneous utterances elicited in a "Wizard-of-Oz" simulation, along with the relational database containing the travel information (excluding connecting flights). Thirty-six speakers produced a total of 912 utterances.</p><p> The second disc (ATIS0 Read) contains "read" versions of the spontaneous utterances for 20 of the 36 speakers above, for a total of 478 productions. This is supplemented by a set of 40 "adaptation" sentences read by each of the 20 speakers.</p><p> The third through the sixth discs (ATIS0 SD-Read) contain "read" speech in the ATIS domain for ten of the speakers on the first disc. They read a total of 3,171 utterances, or approximately 317 utterances per speaker. This data was collected for the purpose of training speaker-dependent speech recognition systems for the ATIS0 domain. Two of these four discs contain the close-talking (Sennheiser) microphone data and the other two contain corresponding data for the desk-top (Crown PCC-160) microphone. Thus there are 6,342 waveform files on the four discs.</p><h4>Update</h4> <p>This publication has been condensed from 4 CDROM discs to a single DVDROM. The contents of each CD reside in separate directories that are organized identically to the original version.</p> </br>
Portions © 1993 Trustees of the University of Pennsylvania
DOI: 10.35111/2ktf-2q33
title: ATIS2

description: <h4>Introduction</h4><br>
<p>ATIS2 contains approximately 15,000 utterances from 450 participants in the ATIS (Air Travel Information Services) collection. The ATIS collection was developed to support the research and development of speech understanding systems. Participants were presented with various hypothetical travel planning scenarios and asked to solve them by interacting with partially or completely automated ATIS systems.</p><br>
<p>Data was collected in the early 1990s at five US sites: Raytheon BBN, Carnegie Mellon University, MIT Laboratory for Computer Science, National Institute for Standards and Technology and SRI International.</p><br>
<h4>Data</h4><br>
<p>All utterances were recorded and transcribed and approximately 10,000 were annotated with categorizations and canonical reference answers.</p><br>
<p>For ATIS2, the ATIS0 ten-city relational database was revised to accommodate connecting flights and fares and some table headings were renamed.</p><br>
<p>This release includes training data and the February 1992 and November 1992 ATIS benchmark tests. Each set contains approximately 1,000 utterances from the pool of data collected by the five sites.</p><br>
<p><a href="http://www.ldc.upenn.edu/cgi-bin/lol/speech/file/nph-viewspeech-atis2?corpus=atis2&fileid=e00041ss&segment=second&datatype=java&javawidth=600&javaheight=400&start=0&end=10" rel="nofollow"> Audio Sample</a></p><br>
<p> </p></br>
Portions © 1993 Trustees of the University of Pennsylvania
DOI: 10.35111/ap42-7n83
title: CSR-I (WSJ0) Sennheiser

description: <p><a href="http://catalog.ldc.upenn.edu/LDC93S6A" rel="nofollow">LDC93S6A</a> - Complete CSR-I corpus LDC93S6B - CSR-I Sennheiser speech <a href="http://catalog.ldc.upenn.edu/LDC93S6C" rel="nofollow">LDC93S6C</a> - CSR-I other speech</p><br>
<p>During 1991, the DARPA Spoken Language Program initiated efforts to build a new corpus to support research on large-vocabulary Continuous Speech Recognition (CSR) systems.</p><br>
<p>The first two CSR Corpora consist primarily of read speech with texts drawn from a machine-readable corpus of Wall Street Journal news text and are thus often known as WSJ0 and WSJ1. (Later sections of the CSR set of corpora, however, will consist of read texts from other sources of North American business news and eventually from other news domains).</p><br>
<p>The texts to be read were selected to fall within either a 5,000-word or a 20,000-word subset of the WSJ text corpus. (See the documentation for details). Some spontaneous dictation is included in addition to the read speech. The dictation portion was collected using journalists who dictated hypothetical news articles. This amounts to approximately 70 hours of speech.</p><br>
<p>Two microphones are used throughout: a close-talking Sennheiser HMD414 and a secondary microphone, which may vary. The corpora are thus offered in three configurations: the speech from the Sennheiser, the speech from the other microphone and the speech from both; all three sets include all transcriptions, tests, documentation, etc.</p><br>
<p>In general, transcriptions of the speech, test data from ARPA evaluations, scores achieved by various speech recognition systems and software used in scoring are included on separate discs from the waveform data.</p><br>
<p>Please note this corpus has been updated from its original disc release to a web download, some of the documentation may still reflect its original disc state. However all data is still present.</p></br>
Portions © 1987-1989 Dow Jones & Company, Inc., © 1992, 1993 Trustees of the University of Pennsylvania