cometadata/datacite-titles-descriptions-related-identifiers huggingface dataset:
DOI: 10.35111/5cwm-3709
title: LATINO-40 Spanish Read News

description: <p>This database provides a set of recordings for training speaker-independent systems that recognize Latin-American Spanish. It was recorded by the Entropic Research Laboratory in the period from July 11 through September 9 1994 in Palo Alto, California. The database comprises about 5,000 utterances files. These files include about 125 utterances from each of 40 different speakers, 20 male and 20 female.</p><br>
<p>The recordings were all made with a high-quality, head-mounted microphone (Shure SM10A) in an office environment, and the utterances were digitized in 16-bit samples at 16 kHz.</p><br>
<p>The Linguistic Data Consortium provided 13,000 sentences that had been selected from Latin American newspaper text by people working at Texas Instruments. The sentences are all shorter than 80 characters and are not grouped into larger constituents such as paragraphs or stories. The speech files have NIST SPHERE headers and are presented in compressed format, using the shorten speech compression algorithm developed by Tony Robinson at Cambridge Univesity, as implemented in the NIST SPHERE software package. This software is included with the data.</p></br>
Portions © 1995 Trustees of the University of Pennsylvania
DOI: 10.35111/1c1n-1906
title: European Language Newspaper Text

description: <p>The European Language Newspaper Text corpus is also know as the French Language News Corpus. This corpus includes roughly 100 million words of French, 90 million words of German and 15 million words of Portuguese and has been marked using SGML. The text is taken from the following sources:</p><br>
<ol><br>
<li>Approximately 60 million words of text in French and German have been made available from the Associated Press (AP) World Stream. AP World Stream is a compilation of AP news reports produced in 86 bureaus in 68 countries.<br>
<p>The Associated Press Worldstream newswire service provides articles in six languages, interleaved on a single data stream. The data is collected via an Associated Press installed telephone line at the LDC.</p><br>
</li><br>
<li>Approximately 110 million words of text in French, German and Portuguese have been made available from Agence France Presse. Each language was supplied in separate data streams collected via a Dateno MKII satellite receiver and associated equipment at the LDC.</li><br>
<li>Approximately 20 million words of text in German have been made available from Deutsche Presse Agentur. The text is collected via an AP Datafeatures telephone line installed at the Linguistic Data Consortium.</li><br>
<li>A smaller part of the corpus comes from Le Monde newspaper. The Le Monde data covers about 5.6 million words of French. It is quite distinct from the AP and AFP materials in its markup approach, because it has been prepared in compliance with the conventions of the Text Encoding Initiative (TEI), rather than having been based on the model of the TIPSTER collections, which were originally developed prior to the establishment of the TEI conventions.</li><br>
</ol></br>
Portions © 1993-1995 Agence France Presse, © 1993-1995 The Associated Press, © 1995-1996 Deutsche Presse Agentur, © 1992-1993 Le Monde, © 1995 Trustees of the University of Pennsylvania
DOI: 10.35111/ajd2-0b82
title: Mandarin Chinese News Text

description: The Linguistic Data Consortium (LDC) announces the availability of a Mandarin Chinese text corpus. This corpus includes about 250 million GB-encoded text characters. <p> The Mandarin News Corpus includes text from various journalistic sources: </p><ul> <li>newspaper text from Renmin Ribao (People's Daily) </li> <li>radio scripts from China Radio International </li> <li>newswire text from Xinhua newswire service </li> </ul> The format of this corpus uses a labeled bracketing, expressed in the style of SGML (Standard Generalized Markup Language). The header fields provided by the sources, which give information such as topic, date and article ID, have been retained. The articles cover a variety of topics, including international and domestic news, sports and culture. </br>
DOI: 10.35111/jhgn-rv21
title: Hansard French/English

description: <p>The Hansard Corpus consists of parallel texts in English and Canadian French, drawn from official records of the proceedings of the Canadian Parliament. While the content is therefore limited to legislative discourse, it spans a broad assortment of topics and the stylistic range includes spontaneous discussion and written correspondance along with legislative propositions and prepared speeches.</p><br>
<p>The collection presented here has been assembled by the LDC by way of archives from two distinct secondary sources. Material from one time period of parliamentary proceedings was acquired through the IBM T. J. Watson Research Center, while material from another period was acquired through Bell Communications Research Inc. (Bellcore). The combined collection covers a time span from the mid-1970's through 1988, with no apparent duplication between the two data sources.</p><br>
<p>Aside from covering different time periods, the two archives have different organization and have undergone different amounts and kinds of processing in being prepared as a parallel language resource. In addition, the Bellcore set itself comprises two distinct types of data -- one appears to be the main parliamentary proceedings (similar in nature to the IBM set), while the other consists of transcripts from committee hearings.</p><br>
<p>The three sets have been kept distinct in this publication and each is described in greater detail in separate documentation files.</p><br>
<p>In terms of what the three sets have in common:</p><br>
<ul><br>
<li>They are rendered here using the 8-bit ISO-Latin1 character encoding standard.</li><br>
<li>They use a minimal amount of SGML tagging to identify sentences or paragraphs.</li><br>
<li>All sets are organized using a parallel file structure, in which the content of a given English text file is matched by the content of a corresponding French text file.</li><br>
<li>The SGML text files for the IBM and the Bellcore committee-hearings data are published in compressed form, using the public-domain GNU-Zip utility (gzip). The Bellcore main-session files are not compressed.</li><br>
</ul><br>
<p>In terms of differences between the three sets:</p><br>
<ul><br>
<li>The IBM collection is presented as a sequence of parallel sentences (there are nearly 2.87 million parallel sentence pairs in the set).</li><br>
<li>The Bellcore data are presented as sequences of paragraphs.</li><br>
<li>The Bellcore main-session data is accompanied by mapping files that provide computed paragraph alignments and word-token correspondences; no additional alignment data are provided for the Bellcore committee texts (and none are needed for the IBM sentences).</li><br>
</ul></br>
DOI: 10.35111/56ty-0638
title: North American News Text Corpus

description: <p>North American News Text Corpus is composed of English newswire text formatted using <a href="../../../LDC93T3A">TIPSTER</a>-style SGML markup from the following sources:</p><br>
<p>Los Angeles Times/Washington Post Service  05/94-08/97 -  52 million words </p><br>
<p>New York Times News 07/94-12/96 - 173 million words</p><br>
<p>Reuters News Service 04/94-12/96 - 85 million words</p><br>
<p>Wall Street Journal 07/94-12/96 - 40 million words</p><br>
<p>The New York Times and the L. A. Times/Washington Post services also  include a range of other newspaper sources in their syndicated newswires. The Los Angeles Times/Washington Post material includes the following sources (in lesser amounts) in addition to the two predominant sources:</p><br>
<ul><br>
<li>Newsday</li><br>
<li>The Baltimore Sun</li><br>
<li>The Hartford Courant</li><br>
</ul><br>
<p>The New York Times material contains the following sources in lesser amounts, but New York Times articles predominate:</p><br>
<ul><br>
<li>Bloomberg Business News</li><br>
<li>The Boston Globe</li><br>
<li>Los Angeles Daily News</li><br>
<li>Fort Worth Star-Telegram</li><br>
<li>Newsweek</li><br>
<li>Cox News Service</li><br>
<li>The Arizona Republic</li><br>
<li>Seattle Post-Intelligencer</li><br>
<li>San Francisco Examiner</li><br>
<li>Houston Chronicle</li><br>
<li>San Francisco Chronicle</li><br>
<li>Economist Newspaper Ltd.</li><br>
<li>Hearst Newspapers</li><br>
</ul><br>
<p>These newswire services also include small numbers of articles from a larger set of miscellaneous sources. The ones listed above appear with some frequency on a daily basis.</p><br>
<h3>Additional Licensing Instructions</h3><br>
<p>This 'members-only' corpus is available to current LDC members who can request the data at the listed reduced-license fee.</p></br>
Portions © 1994-1996 Dow Jones & Company, Inc., © 1994-1997 Los Angeles Times-Washington Post News Service, Inc., © 1994-1996 New York Times, © 1994-1996 Reuters America, Inc., © 1995-1997 Trustees of the University of Pennsylvania.
DOI: 10.35111/r8va-wb28
title: CSR-III Text

description: <p>The third ARPA Continuous Speech Recognition (CSR) Language Model Training Data is a set for speaker-independent, large-vocabulary speech recognition systems. This corpus is an important companion to the 1994 Benchmark Speech data collection (<a href="http://catalog.ldc.upenn.edu/LDC95S23" rel="nofollow">LDC95S23</a>).</p><br>
<p>The text collection comprises both source text data (prepared by LDC and BBN) and derived statistical tables (compiled by CMU) of unigram, bigram and trigram word frequencies. The sources include all available WSJ texts, spanning 1987 through March 1994 and all AP and San Jose Mercury news data from the three TIPSTER volumes. (Some of the WSJ data, from 1992 through 1994, appears here for research use for the first time). This corpus is also available from the LDC as a 1995 release.</p><br>
<p>Because of restrictions imposed by the copyright holders of much of the NAB text, both the speech and text collections are available to LDC members only. For more information on how to join, send email to <a rel="nofollow">ldc@ldc.upenn.edu</a>.</p></br>
DOI: 10.35111/1psy-zz16
title: Japanese Business News Text

description: <p>The Linguistic Data Consortium announces the availability of a Japanese language text corpus composed of business and financial news from two sources:</p><br>
<ol><br>
<li>Approximately 30 million words of text have been made available from the morning edition of Nihon Kezai Shimbun, the largest Japanese financial news daily newspaper; the release this year covers all text that was published during 1994.<br>
<p>The data was received at the LDC on nine-track magnetic tape; the character encoding was EBCDIC, but was standardized to EUC, which the LDC has chosen as its standard for Japanese.</p><br>
</li><br>
<li>A smaller part of the corpus comes from Dow Jones Telerate, which markets its Japanese Language Service. This is a financial newswire produced by Kyodo News Service; its recipients are primarily managers of Japanese owned corporations, or Japanese employees working in North American brokerage houses, banking, etc. The text is received at the LDC via a digital transmission service installed by Telerate; special software was written by the LDC to poll a central database and download articles individually. The character encoding is EUC.</li><br>
</ol><br>
<p>This corpus is available to LDC members only.</p><br>
<p> </p></br>
Portions © 1994-1995 Kyodo News Service, © 1995 Nihon Keizai Shimbun, © 1995 Trustees of the University of Pennsylvania
DOI: 10.35111/4dex-xm86
title: Spanish News Text

description: <p>The Spanish News Corpus consists of journalistic text data from one newspaper (El Norte, Mexico) and from the Spanish-language services of three newswire sources: Agence France Presse, Associated Press Worldstream, and Reuters. (The Reuters collection comprises two distinct services: Reuters Spanish Language News Service and Reuters Latin American Business Report).</p><br>
<p>All text data are stored in a standard compressed form. The fours sets of newswire data (AFP, APWS and two Reuters services) are each organized as one data file per day of collection. The period covered by these collections runs from December 1993 (for APWS and Reuters) or May 1994 (APWS) through December 1995. (The El Norte data, provided to us by INFOSEL Mexico, are arbitrarily grouped into files of about 1 megabyte in size when uncompressed; date information is not available for individual articles, but the general period of the collection is 1993).</p><br>
<p>The approximate amounts of data per source (when uncompressed) is indicated below (in total megabytes and millions of words of text):</p><br>
<table><br>
<tbody><br>
<tr><br>
<td>Source</td><br>
<td>MB</td><br>
<td>MW</td><br>
</tr><br>
<tr><br>
<td>AFP</td><br>
<td>345</td><br>
<td>44</td><br>
</tr><br>
<tr><br>
<td>APWS</td><br>
<td>253</td><br>
<td>33</td><br>
</tr><br>
<tr><br>
<td>REUSL </td><br>
<td>333</td><br>
<td>41</td><br>
</tr><br>
<tr><br>
<td>REULA </td><br>
<td>233</td><br>
<td>23</td><br>
</tr><br>
<tr><br>
<td>INFOSEL</td><br>
<td>209</td><br>
<td>31</td><br>
</tr><br>
</tbody><br>
</table><br>
<p>The presentation of text data in these collections is modeled on the TIPSTER corpus. Within each data file, SGML tagging is used (1) to mark article boundaries, (2) to delimit the text portion within each article and (3) to label various pieces of information about the article that are external to the text content (e.g. headlines, bylines and so on).</p><br>
<p>The copyright holders of this text have requested that it be made available to LDC members only. Due to the release date this corpus is available to 1995 and 1996 members. In order to obtain this corpus, current LDC members must submit a signed User Agreement Form.</p></br>
Portions © 1994 Agence France Presse, © 1993-1994 The Associated Press, © 1987-1993 INFOSEL, © 1993-1994 Reuters Latin American Business Report, © 1993-1994 Reuters Spanish Language News Service, © 1995 Trustees of the University of Pennsylvania
DOI: 10.35111/ysmr-h820
title: CALLHOME Mandarin Chinese Lexicon

description: <p>The CALLHOME Mandarin Chinese collection includes a lexical component. The CALLHOME Mandarin Lexicon consists of 44,405 words and contains separate information fields with phonological, morphological and frequency information for each word.</p><br>
<p>The token coverage by the LDC Mandarin lexicon of words occurring in the 20 LDC Mandarin CALLHOME devtest transcripts (ten minutes of conversation each) is 98%.</p><br>
<p>Orthographic Chinese characters are GB-encoded and are simplified in the Mainland style. A representation of the headword in tone pinyin with strictly lexical tone, i.e. not reflecting phonetic/phonological processes is also provided.</p><br>
<p>Here is a <a href="desc/addenda/LDC96L15_eg.gif" rel="nofollow">sample page </a> from the lexicon. The transcripts and documentation (<a href="http://catalog.ldc.upenn.edu/LDC96T16" rel="nofollow">LDC96T16</a>) are available separately, as is a corpus of telephone speech (<a href="http://catalog.ldc.upenn.edu/LDC96S34" rel="nofollow">LDC96S34</a>).</p></br>
DOI: 10.35111/tsgt-ts93
title: CALLHOME Spanish Lexicon

description: <p> The <a href="/Catalog/docs/LDC96L16/index.html" rel="nofollow">CALLHOME Spanish</a> collection includes a lexical component. The CALLHOME Spanish Lexicon consists of 45,582 words and contains separate information fields with phonological, morphological and frequency information for each word. </p><p> The token coverage by the LDC Spanish lexicon of words occurring in the 20 LDC Spanish CALLHOME devtest transcripts (ten minutes of conversation each) is 98.7%. </p><p> For examples of listings from the Lexicon, please look at the following samples pages:<a href="desc/addenda/LDC96L16_sample1.gif" rel="nofollow">sample1</a> <a href="desc/addenda/LDC96L16_sample2.gif" rel="nofollow">sample2</a> </p><p> The transcripts and documentation (<a href="http://catalog.ldc.upenn.edu/LDC96T17" rel="nofollow">LDC96T17</a>) are available separately, as is a corpus of telephone speech (<a href="http://catalog.ldc.upenn.edu/LDC96S35" rel="nofollow">LDC96S35</a>). </p></br>
DOI: 10.35111/r0q4-qq14
title: CALLHOME Japanese Lexicon

description: <p>The CALLHOME Japanese collection includes a lexical component. The CALLHOME Japanese Lexicon consists of 80,688 words and contains separate information fields with morphological, phonological and stress information for each word.</p><br>
<p>The lexicon is distributed via FTP. A verbal analyzer/synthesizer (transducer) is also included.</p><br>
<p>Here is a <a href="desc/addenda/LDC96L17_eg.gif" rel="nofollow">sample page </a> from the lexicon. The transcripts and documentation (<a href="http://catalog.ldc.upenn.edu/LDC96T18" rel="nofollow">LDC96T18</a>) are available separately, as is a corpus of telephone speech (<a href="http://catalog.ldc.upenn.edu/LDC96S37" rel="nofollow">LDC96S37</a>).</p></br>
DOI: 10.35111/tx9f-xt67
title: Frontiers in Speech Processing 93

description: <p>This CD reflects the cooperative efforts of 28 researchers who attend the 1993 summer workshop in speech processing hosted by the Center for Computer Aids for Industrial Productivity (CAIP) at Rutgers University and sponsored by the National Security Agency. The workshop was an outgrowth of summers at the Center for Communication Research in Princeton (CCR-P) and targeted problems concerning general-purpose speech recognition with particular emphasis on front end processing. The project was held from July 6th to August 13th and utilized extensive computational resources: both equipment native to CAIP and additional hardware acquired for the workshop.</p><br>
<h3>Additional Licensing Instructions</h3><br>
<p>This 'members-only' corpora is available to current members who can request the data at the listed reduced-license fee. Contact <a href="mailto:ldc@ldc.upenn.edu">ldc@ldc.upenn.edu</a> for information about becoming a member.</p></br>
DOI: 10.35111/4fn9-2m52
title: CTIMIT

description: <p>CTIMIT is a cellular-bandwidth adjunct to TIMIT Acoustic Phonetic Continuous Speech (<a href="../../../LDC93S1">LDC93S1</a>).</p><br>
<p>CTIMIT has been designed to provide a large phonetically-labeled database for use in the design and evaluation of speech processing systems operating in diverse, often hostile, cellular telephone environments. CTIMIT was collected by members of the Voice Communication Initiative (VCI) at Lockheed-Martin Sanders' Signal Processing Center of Technology (SPCOT) as part of internal R&D efforts, with additional sponsorship from the Wireless Communications Group in the company's Advanced Engineering and Technology (AE&T) Division.</p><br>
<p>Like NTIMIT (<a href="../../../LDC93S2">LDC93S2</a>), CTIMIT is based on the original TIMIT recordings, which were passed through a sample of actual telephone circuits -- cellular circuits in the case of CTIMIT. Thus, the original phonetic segmentation and labeling of TIMIT continue to be applicable to CTIMIT as well as NTIMIT.</p></br>
Portions © 1993, 1996 Trustees of the University of Pennsylvania
DOI: 10.35111/xqjm-hp63
title: CSR-IV HUB4

description: <p>This release contains all of the speech data provided to sites participating in the DARPA CSR November 1995 HUB4 (Radio) Broadcast News tests. The data consists of digitized waveforms of MarketPlace (tm) business news radio shows provided by KUSC through an agreement with the Linguistic Data Consortium and detailed transcriptions of those broadcasts. The software NIST used to process and score the output of the test systems is also included.</p><br>
<p>The data is organized as follows:</p><br>
<p>CD26-1: Training Data-Ten complete half-hour broadcasts with minimal-verified transcripts. The transcripts are time aligned with the waveforms at the story-boundary level.</p><br>
<p>CD26-2: Development-Test Data-Six complete half-hour broadcasts with verified transcripts. The transcripts are time aligned with the waveforms at the story- and turn-boundary level. Index files have been included which specify how the data may be partitioned into 2 test sets.</p><br>
<p>CD26-6 Evaluation-Test Data-Five complete half-hour broadcasts with verified/adjudicated transcripts. The transcripts are time aligned with the waveforms at the story-, turn- and music-boundary level. An index file has been included which specifies how the data was partitioned into the test set used in the CSR 1995 HUB4 tests.</p><br>
<h3>Samples</h3><br>
<ul><br>
<li><a href="desc/addenda/LDC96S31.wav" rel="nofollow">Audio</a></li><br>
<li><a href="desc/addenda/LDC96S31.txt" rel="nofollow">Transcripts</a></li><br>
<li><a href="desc/addenda/LDC96S31.spk" rel="nofollow">Speaker</a></li><br>
</ul></br>
DOI: 10.35111/ftsx-tk27
title: FFMTIMIT

description: <p>FFMTIMIT contains the previously unreleased secondary microphone waveforms for TIMIT Acoustic-Phonetic Continuous Speech. The primary microphone waveforms, which were recorded using a close-talking noise-cancelling head-mounted Sennheiser microphone (model HMD-414), are available from LDC on NIST Speech Disc 1-1.1 (<a href="http://catalog.ldc.upenn.edu/LDC93S1" rel="nofollow">LDC93S1</a>). The secondary microphone used in the recording of the TIMIT corpus was a Breul & Kjaer (B&K) 1/2" free-field microphone (model 4165).</p><br>
<p>While the Sennheiser microphone recordings are relatively "clean" with respect to non-speech noise, the FFMTIMIT recordings include significant low frequency noise, which was due to the HVAC system and mechanical vibration transmitted through the floor of the double-walled sound booth used in recording. Because it is noiser than its TIMIT counterpart, the data of FFMTIMIT may be used in the development of more noise-robust speech recognition systems. In addition, this data may be of value to researchers involved in vocal tract modeling because the B&K microphone has extremely flat free-field frequency response and calibration tones are provided.</p><br>
<p>Note that the B&K TIMIT data contained with this release has not been processed through any highpass filter, (e.g., the 1,581-point filter described in the paper "The DARPA Speech Recognition Research Database" by Fisher, Doddington and Goudie-Marshall in "DARPA TIMIT Acoustic-Phonetic Continuous Speech Corpus CD-ROM," NISTIR 4930 / NTIS Order No. PB93- 173938.)</p></br>