cometadata/datacite-titles-descriptions-related-identifiers huggingface dataset:
DOI: 10.35111/ka1n-0c43
title: Speech in Noisy Environments (SPINE) Training Audio

description: <h3>Introduction</h3><br>
<p>Speech in Noisy Environments (SPINE) Training Audio Corpus was developed for the Department of Defense (DoD) Digital Voice Processing Consortium (DDVPC) by Arcon Corp. Corresonding transripts, Speech in Noisy Environments (SPINE) Training Transcripts, are available as <a href="../../../LDC2000T49">LDC2000T49</a>. These corpora supported the 2000 Speech in Noisy Environments (SPINE1) evaluation.</p><br>
<p>The 2000 Speech in Noisy Environments Evaluation (SPINE1) was a first attempt to assess the state of the art and practice in speech recognition technology in noisy military environments and to exchange information on innovative speech recognition technology in the context of fully implemented systems that perform realistic tasks. It was intended to be of interest to all university, industrial and commercial speech system developers working on the problem of robust speech recognition. The evaluation gave participants the opportunity to participate in a flexible evaluation, suited to development needs and abilities.</p><br>
<p>The SPINE1 evaluation focused on the task of transcribing speech produced in noisy environments with emphasis on noisy military environments. The evaluation was designed to promote research progress in this area, to provide the opportunity for participants to try out new ideas for developing robust speech recognition systems that were of both scientific and practical interest, and to measure the performance of this technology.</p><br>
<p>This work was sponsored in part by <a href="http://www.nsf.gov/" rel="nofollow">National Science Foundation</a> Grant No. IIS-9982201.</p><br>
<h3>Data</h3><br>
<p>The evaluation task was to transcribe speech produced in noisy environments. The training and test speech data used for this evaluation were generated by ARCON Corp. for the DoD Digital Voice Processing Consortium (DDVPC) under controlled conditions.</p><br>
<p>The speech data consists of conversations between two communicators working on a collaborative battleship-like task in which they seek and shoot at targets (ARCON Communicability Exercise, ACE). Participants could talk freely, but the total vocabulary used was fairly limited. Each person was seated in a sound chamber in which a previously recorded military background noise environment was accurately reproduced. The participants used handsets and transmission channels that were resident to the particular environment.</p><br>
<p>The training data includes 10 of twenty available talker pairs with 14 five-minute conversations per talker pair (about 720 minutes total), which includes four noise scenarios.</p><br>
<h3>Samples</h3><br>
<p>For an example of the data contained in this corpus, please listen to this <a href="desc/addenda/LDC2000S87.wav" rel="nofollow">audio</a> sample.</p><br>
<h3>Updates</h3><br>
<p>There are no updates at this time.</p></br>
DOI: 10.35111/r4e7-nb71
title: 1999 HUB4 Broadcast News Evaluation English Test Material

description: <h3>Introduction</h3><br>
<p>This publication contains the English evaluation test material used in the 1999 NIST Broadcast News Transcription Evaluation administered by the <a href="http://www.nist.gov/speech" rel="nofollow">NIST, Spoken Natural Language Processing Group </a> and produced by the <a href="http://www.ldc.upenn.edu" rel="nofollow">Linguistic Data Consortium</a>Catalog number LDC2000S88 ISBN 1-58563-176-0.</p><br>
<h3>Data</h3><br>
<p>The test material is contained in two SPHERE-formatted waveform files. The file bn99en_1.sph (set1) contains 1.5 hours of Broadcast News excerpts from last year's set2 epoch. The file bn99en_2.sph (set2) contains 1.5 hours of Broadcast News excerpts from the summer of 1998. Each file should be separately recognized per the <a href="http://www.itl.nist.gov/iaui/894.01/tests/bnr/bnews_99/bnews_99.htm" rel="nofollow">Broadcast News English Evaluation Specification</a>.</p><br>
<p>Additional test material for each set is also included. Test materials include evaluation map files (<a href="../../../Catalog/desc/addenda/LDC2000S88_1.uem" rel="nofollow">bn99en_1.uem</a>), automatically generated segmentation files (<a href="../../../Catalog/desc/addenda/LDC2000S88_2.seg" rel="nofollow">bn99en_1.seg</a>), transcripts from the evaluation (<a href="../../../Catalog/desc/addenda/LDC2000S88_3.utf" rel="nofollow">bn99en_1.utf</a>) and the <a href="../../../Catalog/desc/addenda/LDC2000S88_4.dtd" rel="nofollow">utf.dtd</a> used to validate the transcripts, reference STM files (<a href="../../../Catalog/desc/addenda/LDC2000S88_5.stm" rel="nofollow">bn99en_1.stm</a>), and transcript orthography mapping files (<a href="../../../Catalog/desc/addenda/LDC2000S88_6.glm" rel="nofollow">en981118.glm</a>). For more complete information, see the <a href="http://www.nist.gov/speech" rel="nofollow">1998 HUB4 Website</a>.</p><br>
<h3>Updates</h3><br>
<p>There are no updates at this time.</p><br>
<p><em>Note that the waveform and transcript data on this disc are licensed through the <a href="http://www.ldc.upenn.edu" rel="nofollow">Linguistic Data Consortium (LDC)</a> and are subject to usage restrictions. Contact the <a rel="nofollow">LDC</a> for license agreement information.</em></p><br>
<h3>Additional Licensing Instructions</h3><br>
<p>This 'members-only' corpora is available to current members who can request the data at the listed reduced-license fee. Contact <a href="mailto:ldc@ldc.upenn.edu">ldc@ldc.upenn.edu</a> for information about becoming a member.</p></br>
Portions Copyright 1998 PRI-Public Radio International Portions Copyright 1997-1998 ABC News Portions Copyright 1998 NBC News Portions Copyright 1997-1998 Cable News Network, Inc. All Rights Reserved <br><br><i>Note that the waveform and transcript data on this disc are licensed through the <a href="http://www.ldc.upenn.edu" rel="nofollow">Linguistic Data Consortium (LDC)</a> and are subject to usage restrictions. Contact the <a rel="nofollow">LDC</a> for license agreement information.</i>
DOI: 10.35111/5tcz-x844
title: Voice of America (VOA) Czech Broadcast News Audio

description: <h3>Introduction</h3><br>
<p>Voice of America (VOA) Czech Broadcast News Audio was developed by the Linguistic Data Consortium (LDC). Corresponding transcripts are contained in Voice of America (VOA) Czech Broadcast News Transcripts (<a href="../../../LDC2000T53">LDC2000T53</a>), the documentation for which is included with this release.</p><br>
<h3>Data</h3><br>
<p>Between February 9 and May 28, 1999, LDC collected approximately 30 hours of Czech broadcast audio from the Voice of America news service. The 62 data files presented in this corpus represent the audio of the daily broadcasts of 30-minute news programs.</p><br>
<p>Due to technical limitations in the hardware at LDC that was used to receive the VOA broadcasts via a satellite downlink, a number of files contain brief portions where the audio signal was interrupted. These interruptions typically yielded regions of complete silence that lasted less than two seconds and were scattered sparsely throughout an affected audio file. Additional markup was provided in the transcription texts to isolate the regions where these interruptions occurred.</p><br>
<p>The 62 audio files in this corpus are single-channel, 16 KHz, 16-bit linear SPHERE files.</p><br>
<h3>Samples</h3><br>
<p>For an example of the data in this corpus, please review this <a href="desc/addenda/LDC2000S89.wav" rel="nofollow">audio sample</a>.</p><br>
<h3>Updates</h3><br>
<p>There are no updates at this time.</p></br>
Portions © 2000 Trustees of the University of Pennsylvania
DOI: 10.35111/rf63-4396
title: TDT2 Careful Transcription Audio

description: <h3>Introduction</h3><br>
<p>TDT2 (Topic Detection and Tracking) Careful Transcription Audio was developed by the Linguistic Data Consortium (LDC) and contains English broadcast news audio recordings collected by LDC in 1998. Corresponding transcripts are available in TDT2 Careful Transcription Text <a href="http://catalog.ldc.upenn.edu/LDC2000T44" rel="nofollow">LDC2000T44</a>.</p><br>
<p>Topic Detection and Tracking refers to automatic techniques for finding topically-related material in streams of data such as newswire and broadcast news. The TDT2 corpus was created to support three TDT2 tasks: find topically homogeneous sections (segmentation), detect the occurrence of new events (detection) and track the reoccurrence of old or new events (tracking).</p><br>
<h3>Data</h3><br>
<p>This publication contains 1998 broadcasts from the following sources: ABC News, Cable News Network, Public Radio International and Voice of America.</p><br>
<h3>Samples</h3><br>
<p>For an example of the data in this corpus, please review this <a href="desc/addenda/LDC2000S92.wav" rel="nofollow">audio sample</a>.</p><br>
<h3>Updates</h3><br>
<p>There are no updates at this time.</p></br>
Portions © 1998 American Broadcasting Company, Cable News Network, LP, LLLP, Public Radio International,  © 2000 Trustees of the University of Pennsylvania
DOI: 10.35111/fwew-da58
title: BLLIP 1987-89 WSJ Corpus Release 1

description: <h3>Introduction</h3><br>
<p>Brown Laboratory for Linguistic Information Processing (BLLIP)1987-89 WSJ Corpus Release 1 contains a complete, Treebank-style part-of-speech (POS) tagged and parsed version of the three-year Wall Street Journal (WSJ) collection from ACL/DCI (<a href="../../../LDC93T1">LDC93T1</a>), approximately 30 million words. The annotation was performed using statistically-based methods developed by BLIIP researchers Eugene Charniak, Don Blaheta, Niyu Ge, Keith Hall, John Hale and Mark Johnson.</p><br>
<p>This corpus both overlaps and supplements the million-word Penn Treebank (PTB) collection of parsed and POS-tagged WSJ texts.</p><br>
<h3>Data</h3><br>
<p>The PTB project selected 2,499 stories from a three-year WSJ collection of 98,732 stories for syntactic annotation. These 2,499 stories are distributed in Treebank-2 (<a href="../../../LDC95T7">LDC95T7</a>) and Treebank-3 (<a href="../../../LDC99T42">LDC99T42</a>), both of which include the raw text for each story.</p><br>
<h3>Updates</h3><br>
<p>There are no updates at this time.</p></br>
Portions © 1987-1989 Dow Jones & Company, Inc., © 2000 Trustees of the University of Pennsylvania
DOI: 10.35111/0ywn-fh57
title: TDT2 Careful Transcription Text

description: <h3>Introduction</h3><br>
<p>TDT2 (Topic Detection and Tracking) Careful Transcription was developed by the Linguistic Data Consortium (LDC) and contains transcripts of English broadcast news audio recordings collected by LDC in 1998. The corresponding audio data is available in TDT2 Careful Transcription Audio <a href="http://catalog.ldc.upenn.edu/LDC2000S92" rel="nofollow">LDC2000S92</a>.</p><br>
<p>Topic Detection and Tracking refers to automatic techniques for finding topically-related material in streams of data such as newswire and broadcast news. This corpus was created to support three TDT2 tasks: to find topically homogeneous sections (segmentation), to detect the occurrence of new events (detection) and to track the reoccurrence of old or new events (tracking).</p><br>
<h3>Data</h3><br>
<p>The broadcast data was collected from the following sources: ABC News, Cable News Network, Public Radio International and Voice of America.</p><br>
<p>Please look at this <a href="desc/addenda/LDC2000T44.utf" rel="nofollow">sample transcript</a>.</p><br>
<h3>Updates</h3><br>
<p>There are no updates at this time.</p></br>
Portions © 1998 American Broadcasting Company, Cable News Network, LP, LLLP, Public Radio International,  © 2000 Trustees of the University of Pennsylvania
DOI: 10.35111/4wep-9z24
title: Korean Newswire

description: <h3>Introduction</h3> <p>This corpus is a collection of Korean Press Agency news articles from June 2, 1994 to March 20, 2000. The collection includes articles from the date ranges listed below. Please click <a href="desc/addenda/LDC2000T45_1.gif" rel="nofollow">here</a> to see an example of the newswire. Not all dates in each interval are represented by files or articles: </p> 1994 Jun. 2 to Dec. 31 87 files, 8.6 MB 1995 Jan. 1 to Dec. 31 179 files, 16.9 MB 1996 Jan. 1 to Mar. 29 83 files, 10.6 MB 1997 Jul 28 to Dec. 31 245 files, 48.9 MB 1998 Jan. 2 to Dec. 31 285 files, 64.2 MB 1999 Jan. 3 to Dec. 31 216 files, 56.7 MB 2000 Jan. 3 to Mar. 20 56 files, 13.6 MB Total 1,151 files 219.5 MB <h3>Data</h3> <p>The articles provided here have been collected by means of a continuous feed from the news provider over a modem connection. Incoming data from the modem was spooled directly to a "raw collection" file on a daily basis and the raw files were then processed to produce the format for release by the LDC. There are approximately 143,137 articles this corpus. It is probable that there are duplicate articles in this corpus. </p><p>We have taken steps to remove articles that were corrupted by failures or noise in modem transmission. The kinds of corruption that we were able to eliminate include truncated articles (a valid end-of-article sequence is not observed before a valid start-of-article) and invalid character codes within the text segment of articles. Some corruption may have occurred that did not produce these symptoms (e.g. service interruptions that might cause partial loss of data within or across articles or corruptions that garble the content but happen not to produce any invalid character codes). At present we have no means for detecting these more subtle problems in the data, but we expect that they are relatively infrequent. </p><p>The format chosen for release consists of SGML tagging (since this gives a fairly simple and self-explanatory presentation of the data) and the KSC-5601 Korean character encoding. </p><h3>Updates</h3> There are no updates at this time.  </br>
Portions Copyright 1994-2000, Korean Press Agency, All Rights Reserved
DOI: 10.35111/5n10-kt36
title: Hong Kong News Parallel Text

description: <h3>Introduction</h3><br>
<p>Hong Kong News Parallel Text was developed by the Linguistic Data Consortium (LDC) and consists of parallel Chinese - English news articles from the Information Services Department of Hong Kong Special Administrative Region (HKSAR) of the Peoples Republic of China.</p><br>
<p>LDC wishes to thank the Hong Kong Special Administrative Region of the Peoples Republic of China for granting the LDC permission to distribute this data to the research community.</p><br>
<h3>Data</h3><br>
<p>This corpora contains 18,147 aligned article pairs released by HKSAR from July 1, 1997 to April 30, 2000. Automatic article alignment was done at the LDC.</p><br>
<p>The data directory contains 36,294 articles. Each article is a separate file, thus there are 18,147 article pairs. The files are named using the convention yyyymmdd_nnn.[ce] where</p><br>
<ul><br>
<li>yyyy = year</li><br>
<li>mm = month</li><br>
<li>dd = date</li><br>
<li>nnn = article date sequence number</li><br>
<li>c = Cantonese, and e = English.</li><br>
</ul><br>
<p>The <a href="desc/addenda/hknews.example.c.html" rel="nofollow">example.c</a> and <a href="desc/addenda/hknews.example.e.html" rel="nofollow">example.e</a> files contains a corresponding sample news article from the corpus.</p><br>
<p>The articles were collected by an automated system from the internet. Incoming data was spooled directly to a raw collection file and the raw files were then processed to produce the following format for release by the LDC.</p><br>
<p>Table.txt maps the Chinese files (*.c) to the corresponding English files (*.e).</p><br>
<p>The Chinese files are encoded in BIG5 with user-defined characters by HKSAR. Click <a href="http://www.info.gov.hk/gccs" rel="nofollow"> here </a> for details.</p><br>
<h3>Copying and Distribution</h3><br>
<p>Permission has been granted to the Linguistic Data Consortium to make and distribute copies of the laws, press releases and news of Hong Kong Special Administrative Region provided that this copyright notice and the following permission notice are distributed with all copies.</p><br>
<p>Permission has been given to the Linguistic Data Consortium reproduce the laws, press releases, and/or news articles from the Hong Kong Special Administrative Region Government website for research, education and technology development.</p><br>
<h3>Updates</h3><br>
<p>There are no updates at this time.</p><br>
<h3>Additional Licensing Instructions</h3><br>
<p>This 'members-only' corpora is available to current members who can request the data at the listed reduced-license fee. Contact <a href="mailto:ldc@ldc.upenn.edu">ldc@ldc.upenn.edu</a> for information about becoming a member.</p></br>
Portions © 1997-2000 The Government of the Hong Kong Special Administrative Region, © 2000 Trustees of the University of Pennsylvania
DOI: 10.35111/zh7f-8r93
title: Speech in Noisy Environments (SPINE) Training Transcripts

description: <h3>Introduction</h3><br>
<p>Speech in Noisy Environments (SPINE) Training Transcripts was developed  for the Department of Defense (DoD) Digital Voice Processing Consortium (DDVPC) by Arcon Corp. The corresponding audio data, Speech in Noisy Environments (SPINE) Training Audio, is available as <a href="../../../LDC2000S87">LDC2000S87</a>. These corpora supported the 2000 Speech in Noisy Environments evaluation. For an example transcript, please click <a href="desc/addenda/LDC2000T49_1.html" rel="nofollow">here</a>.</p><br>
<p>The 2000 Speech in Noisy Environments Evaluation (SPINE1) was a first attempt to assess the state of the art and practice in speech recognition technology in noisy military environments and to exchange information on innovative speech recognition technology in the context of fully implemented systems that perform realistic tasks. It was intended to be of interest to all university, industrial and commercial speech system developers working on the problem of robust speech recognition. The evaluation gave participants the opportunity to participate in a flexible evaluation, suited to development needs and abilities.</p><br>
<p>The SPINE1 evaluation focused on the task of transcribing speech produced in noisy environments with the emphasis on speech produced in noisy military environments. The evaluation was designed to promote research progress in this area, to provide the opportunity for participants to try out new ideas for developing robust speech recognition systems that were of both scientific and practical interest, and to measure the performance of this technology.</p><br>
<p>This work was sponsored in part by <a href="http://www.nsf.gov/" rel="nofollow">National Science Foundation</a> Grant No. IIS-9982201.</p><br>
<p> </p><br>
<h3>Data</h3><br>
<p>The evaluation task was to transcribe speech produced in noisy environments. The training and test speech data used for this evaluation were generated by ARCON Corp. for the DoD Digital Voice Processing Consortium (DDVPC) under controlled conditions.</p><br>
<p>The speech data consists of conversations between two communicators working on a collaborative, battleship-like task in which they seek and shoot at targets (ARCON Communicability Exercise, ACE). Participants could talk freely, but the total vocabulary used was fairly limited. Each person was seated in a sound chamber in which a previously recorded military background noise environment was accurately reproduced. The participants used handsets and transmission channels that were resident to the particular environment.</p><br>
<p>The training data includes 10 of 20 available talker pairs with 14 five-minute conversations per talker pair (about 720 minutes total) available, which includes four noise scenarios.</p><br>
<h3>Updates</h3><br>
<p>There are no updates at this time.</p></br>
DOI: 10.35111/krhs-dd17
title: TREC Spanish

description: <h3>Introduction</h3><br>
<p>TREC Spanish was developed by the Linguistic Data Consortium and consists of Spanish newswire data from Agence France Presse and El Norte that was used in the <a href="https://trec.nist.gov/">TREC</a> (Text REtrieval Conference) Spanish tasks sponsored by <a href="https://www.nist.gov/">NIST</a> (National Institute of Standards and Technology), specifically, TREC-3, TREC-4 and TREC-5.</p><br>
<h3>Data</h3><br>
<p>The El Norte material (250 megabytes) was used in TREC-3 and TREC-4; the Agence France Presse documents (300 megabytes) were used in TREC-5. The text has been formatted to include TREC document IDs.</p><br>
<p>Further information about TREC-5 is available from the <a href="https://trec.nist.gov/presentations/TREC5/index.html">NIST TREC-5 website</a>. </p><br>
<h3>Updates</h3><br>
<p>There are no updates at this time.</p></br>
Portions © 1994 Agence France Presse, © 1994 INFOSEL, © 2000 Trustees of the University of Pennsylvania
DOI: 10.35111/rn8c-7105
title: TREC Mandarin

description: <p>This publication contains the TREC ("Text REtreival Conference") Mandarin Corpus used for the Chinese task in TRECs 5-6 and consist of approximately 170 megabytes of articles drawn from the People's Daily newspaper and the Xinhua newswire formatted to include TREC document IDs. The text is Mandarin Chinese and is encoded using the GB encoding scheme. The topics (questions) and relevance judgments (right answers) are not included in this publication but can be downloaded from the Data/Non-English section of the <a href="http://trec.nist.gov" rel="nofollow">TREC</a> web site. </p><p>The Mandarin Chinese text data is from the Xinhua News Agency and the People's Daily News Service (both from mainland China). Click here to see the appereance of a sample file from <a href="desc/addenda/LDC2000T52_xin_eg.gif" rel="nofollow"> Xinhua Newswire</a> and <a href="desc/addenda/LDC2000T52_pd_eg.gif" rel="nofollow"> People's Daily</a>. This collection of text was originally gathered by the Linguistic Data Consortium (LDC), and then adapted by the National Institute of Standards and Technology (NIST) for use in the TREC Mandarin evaluation program.</p></br>
Portions © 1991, 1993 People's Daily, © 1994, 1995 Xinhua News Agency, © 2000 Trustees of the University of Pennsylvania