cometadata/datacite-titles-descriptions-related-identifiers huggingface dataset:
DOI: 10.35111/z46b-j130
title: HUB5 Spanish Transcripts

description: <a href="http://catalog.ldc.upenn.edu/LDC98S70" rel="nofollow">LDC98S70</a> - Speech data LDC98T27 - Transcripts <h3>Introduction</h3> <p>This release of HUB5 Spanish training data consists of 106 calls derived from the <a href="/Catalog/docs/LDC98T27/index.html" rel="nofollow">CALLFRIEND</a> Spanish (Language ID) collection. The transcripts cover a contiguous 10-30 minute segment taken from a recorded conversation lasting up to 30 minutes. These calls were originally collected by the LDC in support of the project on Language Recognition, sponsored by the U.S. Department of Defense. All of these calls are being designated as additional training data for the project on Large Vocabulary Conversational Speech Recognition (LVCSR) in Spanish.</p><h3>Data</h3> <p>Speakers were solicited by the LDC to participate in this telephone speech collection effort via the internet, publications (advertisements) and personal contacts. A total of 200 call originators were found, each of whom placed a telephone call via a toll-free robot operator maintained by the LDC. Access to the robot operator was possible via a unique Personal Identification Number (PIN) issued by the recruiting staff at the LDC when the caller enrolled in the project. </p><p>Once a caller was recruited to participate, he/she was given a free choice of whom to call. Recruits were given no guidelines concerning what they should talk about. Most participants called family members or close friends. All calls originated in North America and were placed to various locations within North America, Puerto Rico or the Dominican Republic. The participants were made aware that their telephone call would be recorded, as were the call recipients. The call was allowed only if both parties agreed to being recorded. Each caller was allowed to talk up to 30 minutes. Upon successful completion of the call, the caller was paid $20 (in addition to making a free long-distance telephone call). Each caller was allowed to place only one telephone call. </p><p>HUB5 Spanish speech and transcript data may be obtained by contacting the <a rel="nofollow">LDC</a> </p><h3>Updates</h3> There are no updates at this time.</br>
DOI: 10.35111/m20q-1s68
title: 1997 English Broadcast News Transcripts (HUB4)

description: <p><a href="http://catalog.ldc.upenn.edu/LDC98S71" rel="nofollow">LDC98S71</a> - Speech data LDC98T28 - Transcripts</p><br>
<h3>Introduction</h3><br>
<p>This publication has been prepared to serve as a supplement to the 1996 Broadcast News Speech collection (consisting of over 100 hours of similar recordings). The primary motivation for this collection is to provide additional training data for the DARPA "HUB4" Project on continuous speech recognition in the broadcast domain.</p><br>
<h3>Data</h3><br>
<p>This set of 18 CD-ROMs contains a total of 97 hours of recordings from radio and television news broadcasts, gathered between June 1997 and February 1998.</p><br>
<p>Transcripts have been made of all recordings in this publication, manually time aligned to the phrasal level, annotated to identify boundaries between news stories, speaker turn boundaries and gender information about the speakers. The transcription conventions are described in the file "transcrp.doc" -- please note that this file describes the transcription methods by reference to text formatting conventions used internally by the LDC during the transcription process. The released version of the transcripts is in SGML format, comparable to the format that was used in the 1996 Broadcast News Speech transcriptions and there is accompanying documentation and an SGML DTD file, included with the transcription release.</p><br>
<h3>Updates</h3><br>
<p>There are no updates at this time.</p><br>
<h3>Additional Licensing Instructions</h3><br>
<p>This 'members-only' corpora is available to current members who can request the data at the listed reduced-license fee. Contact <a href="mailto:ldc@ldc.upenn.edu">ldc@ldc.upenn.edu</a> for information about becoming a member.</p></br>
DOI: 10.35111/1b28-g771
title: 1997 Spanish Broadcast News Transcripts (HUB4-NE)

description: <h3>Introduction</h3><br>
<p>This corpus contains a portion of the acoustic data designated as the training set for the 1997 DARPA HUB4 Spanish Benchmark. It contains speech and transcripts of 30 hours of broadcast news from the following sources: Televisa, Univision and VOA.</p><br>
<p>Corresponding speech data is released as 1997 Spanish Broadcast News Speech (HUB4-NE) (<a href="http://catalog.ldc.upenn.edu/LDC98S74" rel="nofollow">LDC98S74</a>)</p><br>
<h3>Data</h3><br>
<p>All acoustic files are in NIST SPHERE format, without compression. The sample data are 16-bit linear PCM, 16-KHz sample frequency, single channel. Most files contain 30 minutes of recorded material, and some contain 60 or 120 minutes (approximately); the sampling format requires roughly two megabytes (MB) per minute of recording, so the file sizes are typically around 60 MB, with some files ranging up to 120 or 240 MB.</p><br>
<p>The transcripts are in SGML format, using the same markup conventions that have been applied to the other 1997 Broadcast News speech corpora (in English and Mandarin).</p><br>
<h3>Samples</h3><br>
<p>Please view this <a href="desc/addenda/LDC98T29.sgm">SGML sample</a>.</p><br>
<h3>Updates</h3><br>
<p>There are no updates at this time.</p></br>
Portions © 1997 Televisa S.A. de C.V., © 1997 Univision Network Limited Partnership, © 1997, 1998 Trustees of the University of Pennsylvania
DOI: 10.35111/j208-rp93
title: North American News Text Supplement

description: <h3>Introduction</h3><br>
<p>This release of North American News Text provides a supplement to the LDC's earlier publication of similar materials <a href="http://catalog.ldc.upenn.edu/LDC95T21" rel="nofollow">(LDC95T21: North American News Text Corpus)</a>. The same TIPSTER-style SGML markup is used in formatting the data. The data sources are as follows:</p><br>
<p>Source Dates Approx. # Words Covered (Millions) ------------------------------------------------------- Los Angeles Times & 09/97-04/98 11 Washington Post New York Times News 01/97-04/98 116 Syndicate Associated Press 11/94-04/98 143 World Stream English -------------------------------------------------------</p><br>
<p>The previous North American News release included prior materials from both the LA Times/Washington Post and the New York Times; this supplement provides the continuation of those sources.</p><br>
<h3>Data</h3><br>
<p>The LDC has been collecting the Associated Press Worldstream newswire service in six languages since 1994. The is the first release of the English language portion of this service. The material in this set is typically NOT North American in origin -- the reporters who provide the stories may or may not be American born, but the locations and topics covered are much more heavily international in comparison to the North American wire services. Reports from Asia, Africa and Europe are found here that show up only rarely or not at all in North American newspapers, including political, financial and sports stories that are presumably geared to English-speaking readers in those parts of the world.</p><br>
<p>This release, when combined with the LDC's earlier NA News Text Corpus, constitutes all the English-language newswire text collected by the LDC between January 1994 and April 1998, inclusive.</p><br>
<h3>Updates</h3><br>
<p>There are no updates at this time.</p><br>
<h3>Additional Licensing Instructions</h3><br>
<p>This 'members-only' corpora is available to current members who can request the data at the listed reduced-license fee. Contact <a href="mailto:ldc@ldc.upenn.edu">ldc@ldc.upenn.edu</a> for information about becoming a member.</p></br>
Portions © 1994-1998 The Associated Press, © 1997-1998 Los Angeles Times - Washington Post News Service, Inc., © 1997-1998 New York Times, © 1998 Trustees of the University of Pennsylvania
DOI: 10.35111/jvpt-9682
title: 1996 CSR HUB4 Language Model

description: <h3>Introduction</h3><br>
<p>This corpus contains data from transcribed news broadcasts, designated for use in the baseline language model (LM) for the 1996 CSR HUB4 Evaluation.</p><br>
<h3>Data</h3><br>
<p>The LDC obtained the bulk of the data from broadcast news CD-ROMs produced by Primary Source Media, Inc. This portion includes the period from January 1992 to April 1996 and contains approximately one gigabyte of data uncompressed. This release also includes about 36 megabytes of material received on floppy disks covering the period from late May through June 1996, with somewhat different format from the bulk of the data.</p><br>
<p>The text data are presented in two forms: (1) a relatively unprocessed ("raw" or "sentence-tagged") form and (2) a fully processed ("conditioned," "verbalized-punctuation") form. The "raw" form includes the header and footer information accompanying the articles, such as network, show name, headline, copyright, credits and so forth; the text and ancillary data are presented in a fairly consistent (though simple) SGML format. The "processed" form contains only the text content of the articles, together with SGML tags to mark the boundaries of articles, paragraphs and sentences; the text content has been modified by replacing numeric strings (dates, dollar amounts, quantities) with orthographic strings (e.g. "nineteen ninety six"), replacing abbreviations ("Inc.," "Ltd.," "Corp.," etc.) with corresponding full-word forms and replacing punctuation characters with corresponding word tokens (e.g. "," becomes "COMMA"). This release also includes an archive of the tools used to create the "processed" form of the data.</p><br>
<h3>Updates</h3><br>
<p>There are no updates at this time.</p><br>
<h3>Additional Licensing Instructions</h3><br>
<p>This 'members-only' corpora is available to current members who can request the data at the listed reduced-license fee. Contact <a href="mailto:ldc@ldc.upenn.edu">ldc@ldc.upenn.edu</a> for information about becoming a member.</p></br>
DOI: 10.35111/4w95-zg53
title: JURIS

description: <h3>Introduction</h3><br>
<p>This publication represents a release of the JURIS (Justice Department Retrieval and Inquiry System) data collection that has been made available to the Linguistic Data Consortium (LDC) by the U.S. Department of Justice. The time span of the text ranges from the 1700s to the early 1990s.</p><br>
<h3>Data</h3><br>
<p>There are 1,664 individual text files in the corpus, 1011 on the first CD-ROM and 653 on the second. The original archive consisted of 219 files ranging between less than 1 MB and nearly 70 MB in size. In order to make the data more accessible for researchuse, we chose to divide the larger files into pieces, such that the average file size was about 2 MB when uncompressed (the largest uncompressed file size is about 4.5 MB). Divisions of the files were done at document boundaries, so all files contain whole documents.</p><br>
<p>There are a total of 694,667 document units in the corpus and these can be categorized to some extent with regard to their content. The following is a partial list of categories and their descriptions drawn from JURIS documentation contained in the corpus. The terminology and organization of categories are those used in the JURIS documentation:</p><br>
<ul><br>
<li>Case Law</li><br>
<li>Executive Order</li><br>
<li>Regulations</li><br>
<li>Federal Register</li><br>
<li>Statutory Law</li><br>
<li>Administrative Law</li><br>
<li>International Agreements</li><br>
<li>Freedom of Information Act and related documents</li><br>
<li>Indian Law</li><br>
<li>Tax Law</li><br>
<li>Brief</li><br>
</ul><br>
<p>As many of the documents contain Social Security Numbers of the parties involved, these have been redacted to protect the privacy of those individuals. All valid Social Security Numbers have been replaced with the string XXX-XX-XXXX. In some documents, number strings may be identified as Social Security Numbers, but they are in fact substitutions such as the series, 123-45-6789 or 987-65-4321. These ersatz numbers have been left unchanged. Some personal names have also been redacted and replaced with XXXXXXXX.</p><br>
<h3>Updates</h3><br>
<p>There are no updates at this time.</p></br>
Portions © 1998 Trustees of the University of Pennsylvania
DOI: 10.35111/v678-8018
title: Egyptian Colloquial Arabic Lexicon

description: <h3>Introduction</h3> <p>This lexicon represents the first electronic pronunciation dictionary of Egyptian Colloquial Arabic (ECA), the spoken variety of Arabic found in Egypt. The dialect of ECA that this dictionary represents is Cairene Arabic. </p><h3>Data</h3> <p>The lexicon contains 51,202 entries, drawn from 140 CALLHOME telephone conversations among native speakers of Colloquial Egyptian Arabic, collected and published by the LDC as follows: <a href="http://catalog.ldc.upenn.edu/LDC97S45" rel="nofollow">CALLHOME Egyptian Arabic Speech LDC97S45</a>, <a href="http://catalog.ldc.upenn.edu/LDC97T19" rel="nofollow">CALLHOME Egyptian Arabic Transcripts LDC97T19</a>, <a href="http://catalog.ldc.upenn.edu/LDC2002S37" rel="nofollow">CALLHOME Egyptian Arabic Speech Supplement LDC200237</a> and <a href="http://catalog.ldc.upenn.edu/LDC2002T38" rel="nofollow">CALLHOME Egyptian Arabic Transcripts Supplement LDC2002T38</a>. The lexicon also contains entries derived manually from the Badawi & Hines dictionary of Colloquial Egyptian Arabic. </p><p>The lexical entries are written one to a line with tab-separated fields, including orthographic representation in both the LDC romanization as well as Arabic script, morphological, phonological, stress, source, and frequency information for each word. </p><p>Here is a <a href="desc/addenda/LDC99L22_eg.gif" rel="nofollow">sample page</a>. </p><p>Relative to earlier versions of the Arabic Pronouncing Lexicon, this release provides not only a significant increase in the number of entries, but also a significant effort to improve the quality and consistency of all entries. </p><h3>Updates</h3> There are no updates at this time. </br>
Portions © 1996-2002 Trustees of the University of Pennsylvania
DOI: 10.35111/fe0b-zt47
title: American English Spoken Lexicon

description: <h3>Introduction</h3><br>
<p>This lexicon contains pronunciations captured in individual audio files for 53,602 of the most common words in English.</p><br>
<h3>Data</h3><br>
<p>50,892 words were chosen from LDC's CALLHOME American English Lexicon on the basis of their frequency in the data that were used in creating the 1994 CSR Language Model Text Corpus ("CSR-III Text Corpus," LDC95T6). The sources for the language model include Wall Street Journal (1987-1994), Associated Press (1989-1991), and San Jose Mercury News (1991); all taken from the three CD-ROM volumes of TIPSTER (LDC93T3A). To extend the coverage of common words that happen not to occur in the LDC corpora sampled, an additional 2,922 words (ie. compounds, companies, places, languages, and numerals) were added from other sources.</p><br>
<p>Each word was read by the speaker in a quiet recording studio, using a Sennheiser HMD 410 microphone and a Sony DAT recorder. The recordings were downsampled to 16KHz for storage on disk with the individual lexical utterances segmented into separate waveform files, with a consistent margin of silence on both sides of each word.</p><br>
<p>The CD-ROMs were created using the ISO-9660 Level 2 data format, along with Rock Ridge extensions. All common computer operating systems should be able to read the full-length file names. The corpus has since been converted to a web downloaded file.</p><br>
<h3>Updates</h3><br>
<p>There are no updates at this time.</p></br>
DOI: 10.35111/x4at-ff87
title: SUSAS

description: <h3>Introduction</h3><br>
<p>Speech Under Simulated and Actual Stress (SUSAS) was created by the Robust Speech Processing Laboratory at the University of Colorado-Boulder under the direction of Professor John H. L. Hansen and sponsored by the Air Force Research Laboratory.</p><br>
<h3>Data</h3><br>
<p>The database is partitioned into four domains, encompassing a wide variety of stresses and emotions. A total of 32 speakers (13 female, 19 male), with ages ranging from 22 to 76 years were employed to generate in excess of 16,000 utterances.</p><br>
<p>SUSAS also contains several longer speech files from four Apache helicopter pilots. Those helicopter speech files were transcribed by the Linguistic Data Consortium and are available in SUSAS Transcripts (<a href="../../../LDC99T33">LDC99T33</a>).</p><br>
<p>A common highly confusable vocabulary set of 35 aircraft communication words make up the database. All speech tokens were sampled using a 16-bit A/D converter at a sample rate of 8kHz.</p><br>
<h3>Samples</h3><br>
<p>Please listen to the following four audio samples:</p><br>
<ul><br>
<li><a href="desc/addenda/LDC99S78.1.sph">Sample 1</a></li><br>
<li><a href="desc/addenda/LDC99S78.2.sph">Sample 2</a></li><br>
<li><a href="desc/addenda/LDC99S78.3.sph">Sample 3</a></li><br>
<li><a href="desc/addenda/LDC99S78.4.sph">Sample 4</a></li><br>
</ul><br>
<h3>Updates</h3><br>
<p>There are no updates at this time.</p></br>
Portions © 1999 Trustees of the University of Pennsylvania
DOI: 10.35111/5qpg-1r82
title: Switchboard-2 Phase II

description: <h3>Introduction</h3><br>
<p>SWB-2 Phase II consists of 4,472 five-minute telephone conversations involving 679 participants. This corpus was collected by the Linguistic Data Consortium (LDC) in support of a project on Speaker Recognition sponsored by the U.S. Department of Defense.</p><br>
<h3>Data</h3><br>
<p>Participants in SWB-2 Phase II were recruited from the following midwestern college campuses: Iowa State University, Michigan State University, University of Michigan, University of Minnesota, University of Wisconsin at Madison, Northwestern University, and Ohio State University. Solicitation methods included the Internet, newspaper advertisements and personal contacts. The majority of the participants resided in Minnesota, Wisconsin, Ohio, Iowa, Michigan and Illinois as follows:</p><br>
<p>Minnesota - 156 speakers</p><br>
<p>Wisconsin -- 105 speakers</p><br>
<p>Ohio -- 70 speakers</p><br>
<p>Iowa 64 speakers</p><br>
<p>Michigan -- 41 speakers</p><br>
<p>Illinois - 37 speakers</p><br>
<p>Each recruit was asked to participate in at least ten five-minute phone calls. Ideally each participant would receive five calls at a designated number and make five calls from phones with different (ANI) codes. Participants were asked to discuss a specific topic (read by the automated operator) and not to provide personal information during their call.</p><br>
<p>Each of the 679 participants placed their calls via a toll-free robot operator maintained by LDC. Access to the robot operator was possible via a unique Personal Identification Number (PIN) issued by the recruiting staff at LDC when the caller enrolled in the project.</p><br>
<p>Upon conclusion of the study all calls were audited by LDC staff members. Particular attention was paid to PIN verification (matching speaker with PIN), checking call duration, and call quality. Upon completion of this process, checks were issued and mailed to participants. The conversations have not been transcribed.</p><br>
<h3>Updates</h3><br>
<p><strong>09/29/2011:</strong> The file table and readme were updated to reflect that this data set was made available on DVD.</p></br>
Portions © 1999 Trustees of the University of Pennsylvania
DOI: 10.35111/s6aq-4f17
title: 1997 Speaker Recognition Benchmark

description: <h3>Introduction</h3> <p>The 1997 speaker recognition evaluation was part of an ongoing series of yearly evaluations conducted by NIST. These evaluations provide an important contribution to the direction of research efforts and the calibration of technical capabilities. They are intended to be of interest to all researchers working on the general problem of text independent speaker recognition. To this end the evaluation was designed to be simple, to focus on core technology issues, to be fully supported, and to be accessible. </p><h3>Data</h3> <p>Technical Objectives of the 1997 speaker recognition evaluation were: </p><p>1. Exploring promising new ideas in speaker recognition 2. Developing advanced technology incorporating these ideas 3. Measuring the performance of this technology </p><p>The evaluation data was drawn from the Switchboard-2 Phase 1 corpus. Both training and test segments were constructed by concatenating consecutive turns for the desired speaker, similar to what was done in 1996. Each segment is stored as a continuous speech signal in a separate SPHERE file. The speech data is stored in 8-bit mulaw format. </p><h3>Updates</h3> There are no updates at this time. </br>
DOI: 10.35111/fj0k-d582
title: 1999 Speaker Recognition Benchmark

description: <h3>Introduction</h3> <p>The 1999 speaker recognition evaluation is part of an ongoing series of yearly evaluations conducted by NIST. These evaluations provide an important contribution to the direction of research efforts and the calibration of technical capabilities. They are intended to be of interest to all researchers working on the general problem of text independent speaker recognition. </p><h3>Data</h3> <p>Technical Objectives of the 1999 speaker recognition evaluation were: </p><p>1. Exploring promising new ideas in speaker recognition 2. Developing advanced technology incorporating these ideas 3. Measuring the performance of this technology </p><p>The evaluation data was drawn from the Switchboard-2 Phase 3 corpus. Both training and test segments were constructed by concatenating consecutive turns for the desired speaker, similar to what was done in 1996. Each segment is stored as a continuous speech signal in a separate SPHERE file. The speech data is stored in 8-bit mulaw format. </p><h3>Updates</h3> There are no updates at this time.  </br>
Portions © 1999 Trustees of University of Pennsylvania
DOI: 10.35111/smp0-ak59
title: USC Marketplace Broadcast News Speech

description: <h3>Introduction</h3> <p>The USC Marketplace Broadcast News Corpus contains approximately 40 hours of audio data, which was recorded daily between May 1, 1996 and September 18, 1996. Corresponding transcript files were created by Federal Document Clearing House and enhanced by the LDC to include: story boundaries, disfluency markers, and speaker and gender identification. In keeping with HUB4 style transcription conventions, LDC spelled all digit strings in standard orthography. Commercial and music segments, while a part of the audio publication, were excluded from the transcripts. The timestamps mark the beginning of each speaker turn relative to the beginning of the recording and are precise to the 100th of a second. Although the transcripts were created using HUB4 conventions, the second and third pass quality checks, typically required by government sponsored evaluation projects, were skipped.</p><h3>Data</h3> <p>The USC Marketplace recordings from the summer of 1996 were received on digital audio tapes (DATs) from the University of Southern California. LDC excluded from this set the roughly seven hours of broadcast that are currently included in the 1996 English Broadcast News publication.</p><p>Marketplace is produced by USC Radio in Los Angeles, a division of the University of Southern California.</p><h3>Updates</h3> There are no updates at this time. </br>