cometadata/datacite-titles-descriptions-related-identifiers huggingface dataset:
DOI: 10.35111/050q-5r95
title: Buckwalter Arabic Morphological Analyzer Version 2.0

description: <h3>Introduction</h3><br>
<p>This file contains documentation on the Buckwalter Arabic Morphological Analyzer Version 2.0.</p><br>
<h3>Data</h3><br>
<p>The data consists primarily of three Arabic-English lexicon files: prefixes (299 entries), suffixes (618 entries), and stems (82158 entries representing 38600 lemmas). The lexicons are supplemented by three morphological compatibility tables used for controlling prefix-stem combinations (1648 entries), stem-suffix combinations (1285 entries), and prefix-suffix combinations (598 entries). The actual code for morphology analysis and POS tagging is contained in a Perl script. The documentation consists of a readme file with a description of the lexicon files, the morphological compatibility tables, the morphology analysis algorithm, a summary of stem morphological categories, and a table with the authors Arabic transliteration system.</p><br>
<h3>Samples</h3><br>
<p>To see an example of the analyzers output, please examine this <a href="desc/addenda/LDC2004T27.xml" rel="nofollow">sample</a>.</p><br>
<h3>Additional Licensing Instructions</h3><br>
<p>This 'members-only' corpus is available to current members who can request the data at the listed reduced-license fee. Contact <a href="mailto:ldc@ldc.upenn.edu">ldc@ldc.upenn.edu</a> for information about becoming a member.</p></br>
DOI: 10.35111/axbp-bw85
title: 2002 NIST Speaker Recognition Evaluation

description: <h3>Introduction</h3><br>
<p>2002 NIST Speaker Recognition Evaluation was developed produced by the Linguistic Data Consortium (LDC).</p><br>
<p>The main evaluation data was extracted from Switchboard Cellular Part 2 Audio (<a href="../../../LDC2004S07">LDC2004S07</a>). The extended data task used Switchboard-2 Phase II (<a href="../../../LDC99S79">LDC99S79</a>) and Switchboard-2 Phase III Audio (<a href="../../../LDC2002S06">LDC2002S06</a>). This evaluation also included the first multi-modal task, using data from an FBI voice database. Supporting documentation for this evaluation may be found in the 2002 NIST Speaker Recognition Evaluation Plan included in this release. </p><br>
<p>2002 NIST Speaker Recognition Evaluation is part of an ongoing series of yearly evaluations conducted by NIST. These evaluations provide an important contribution to the direction of research efforts and the calibration of technical capabilities. They are intended to be of interest to all researchers working on the general problem of text independent speaker recognition. To this end the evaluation was designed to be simple, to focus on core technology issues, to be fully supported, and to be accessible.</p><br>
<h3>Data</h3><br>
<p>There are a total of 9,153 speech files (6,098 at 8 KHz and 3,055 at 16KHz), all of which are in sphere format, for a total of ~156 hours.</p><br>
<p>The data was initially distributed by NIST on 13 CD-ROMs (r81_1_1 through r81_13_1). This corpus consists of training and test data and replicates exactly the content and structure of the 13 CD-ROMs.</p><br>
<h3>Updates</h3><br>
<p>There are no available updates at this time.</p></br>
Portions © 1997-2002, 2004 Trustees of the University of Pennsylvania
DOI: 10.35111/64zw-4k57
title: ISL Meeting Speech Part 1

description: <h3>Introduction</h3> <p>ISL Meeting Speech Part 1 was produced by Linguistic Data Consortium (LDC) catalog number LDC2004S05 and ISBN 1-58563-294-5. </p><p>The ISL Meeting Speech Part 1 is a first subset of the ISL Meeting Corpus (112 meetings). It contains 18 meetings collected at the Interactive Systems Laboratories at Carnegie Mellon University in Pittsburgh, PA during the years 2000-2001. The recorded meetings were either natural meetings where participants needed to meet in the real world, or artificial meetings, which were designed explicitly for the purposes of data collection but still had real topics and tasks. The duration of the meetings in this corpus ranges from eight to 64 minutes and averages at 34 minutes. Word-level orthographic transcriptions are available as ISL Meeting Transcripts Part 1. The transcriptions are available as <a href="http://catalog.ldc.upenn.edu/LDC2004T10" rel="nofollow">ISL Meeting Transcripts Part 1</a>. </p><h3>Data</h3> <p>The collection includes 105 speech files, for a total of approximately 10 hours of meeting speech. The speech for each meeting consists of wave files for each channel and a wave file containing a mix of all channels. </p><p>The audio was collected at a 16 kHz sample-rate. Audio files for each meeting are provided as separate time-synchronous recordings for each channel, encoded as 16-bit (little-endian) wave files. </p><p>During meeting recordings, each speaker wore an individual lapel microphone and was recorded via an Alesis 8-channel mix board and an ECHO Layla 8-channel sound card. This setup was designed to obtain a consumer- or application-style sound quality. All meetings were recorded in the same instrumented meeting area. </p><p>For an example transcript, please click <a href="./desc/addenda/LDC2004T10" rel="nofollow">here</a>. </p><p>There are a total of 31 unique speakers in the corpus. Meetings involved anywhere from three to nine participants, averaging at five. The corpus contains a significant proportion of non-native English speakers, varying in fluency. </p><h3>Sponsorship</h3> <p>The collection and preparation of this corpus was made possible in large part through funding from DARPA, both through the GENOA project and through ROAR. </p><h3>Updates</h3> <p>Additional information, updates, bug fixes may be avaibale on the <a rel="nofollow">ISL Meeting Room project page</a>. </p> </br>
Portions © 2000-2003 Interactive Systems Laboratories, Carnegie Mellon University, Pittsburgh, © 2004 Trustees of the University of Pennsylvania
DOI: 10.35111/mgp6-4j96
title: Switchboard Cellular Part 2 Audio

description: <h3>Introduction</h3><br>
<p>Switchboard Cellular Part 2 Audio was devloped by the Linguistic Data Consortium (LDC) and consists of approximately 200 hours of English telephone conversations collected by LDC in 2000. The Switchboard cellular collection focused primarily on cellular phone technology of all service types. The goal was to target 200 subjects balanced by gender to participate in (10+) five-six minute conversations on cellular phones. The speech data was collected for research, development, and evaluation of automatic systems for speech-to-text conversion, talker identification, language identification and speech signal detection purposes.</p><br>
<p>During the study period, LDC collected a total of 2,020 calls, or 4,040 sides (2,950 cellular) from 419 participants (2,405 female speakers, 1,635 male speakers) under varied environmental conditions.</p><br>
<h3>Data</h3><br>
<p>This release contains speech data files with documentation describing speaker information (sex, age, education, city and state where raised), call information (date, time, call duration, Personal Identification Numbers, topic), and audit information (channel quality, background noise). The documentation also contains reports on clipped files.</p><br>
<p>Each speech file consists of a 1,024-byte ASCII-formatted Sphere header, followed by two-channel interleaved mu-law sample data. The mu-law samples represent the actual digital data transmission from the telephone service provider (MCI), as captured separately for each side of the telephone conversation by LDC's telephone collection platform. The header also indicates the caller_pin, callee_pin, topic_id, cellular service/handset information and speaker demographic information. The data files are not compressed.</p><br>
<p>Other releases in this series include:</p><br>
<p>Switchboard Cellular Part 1 Audio (<a href="../../../LDC2001S13">LDC2001S13</a>)</p><br>
<p>Switchboard Cellular Part 1 Transcribed Audio (<a href="../../../LDC2001S15">LDC2001S15</a>)</p><br>
<p>Switchboard Cellular Part 1 Transcription (<a href="../../../LDC2001T14">LDC2001T14</a>)</p><br>
<h3>Sample</h3><br>
<p>Please examine this <a href="desc/addenda/LDC2004S07.wav" rel="nofollow">example audio file</a> to review a sample of this corpus.</p><br>
<h3>Updates</h3><br>
<p>There are no updates available at this time.</p></br>
Portions © 2000, 2004 Trustees of the University of Pennsylvania
DOI: 10.35111/800p-fv08
title: NIST Meeting Pilot Corpus Speech

description: <h3>Introduction</h3><br>
<p>NIST Meeting Pilot Corpus Speech consists of approximately 15 hours of English meeting speech and was collected in the NIST Meeting Data Collection Laboratory for the <a href="http://www.nist.gov/speech/test_beds/mr_proj" rel="nofollow">NIST Automatic Meeting Recognition Project</a>. The corresponding transcripts are available as the <a href="http://catalog.ldc.upenn.edu/LDC2004T13" rel="nofollow">NIST Meeting Pilot Corpus Transcripts and Metadata</a>, while the video files will be published later as NIST Meeting Pilot Corpus Video.</p><br>
<p>For more information regarding the data collection conditions, meeting scenarios, transcripts, speaker information, recording logs, errata, and other ancillary data for the corpus, please consult the <a href="http://www.nist.gov/speech/test_beds/mr_proj/meeting_corpus_1" rel="nofollow"> NIST project website</a> for this corpus.</p><br>
<h3>Data</h3><br>
<p>The data in this corpus consists of 369 SPHERE audio files generated from 19 meetings (comprising about 15 hours of meeting room data and amounting to about 32 GB) recorded between November 2001 and December 2003.</p><br>
<p>Each meeting was recorded using two wireless "personal" mics attached to each meeting participant: a close-talking noise-cancelling boom mic and an omni-directional lapel mic. Each meeting was also recorded using three omni-directional table mics and a four-channel directional table mic covering 365 degrees (each channel is recorded in a separate file). Each individual channel was converted from its 48Khz, 24-bits, linear PCM source format to 16 Khz, 16-bits, linear PCM-sampled audio SPHERE-formatted files.</p><br>
<h3>Updates</h3><br>
<p>There are no updates available at this time.</p></br>
Portions © 2004 Trustees of the University of Pennsylvania
DOI: 10.35111/h5sg-hp80
title: TalkBank Ethology Data: Field Recordings of Vervet Monkey Calls

description: <h3>Introduction</h3><br>
<p>TalkBank Ethology Corpus: Field Recordings of Vervet Monkey Calls contains digitized audio files of field recordings of vervet monkeys (cercopithecus aethiops) collected by Robert M. Seyfarth and Dorothy L. Cheney in 1977 and 1978. The original recordings were made on 1/8 inch reel-to-reel tapes, and were digitized at LDC using the sampling frequency of 44.1 kHz. This publication contains downsampled versions of the recordings.</p><br>
<p>From 2001 through 2004, Dr. Seyfarth and one of his students annotated the recordings for the following fields: start time, end time, type (bout, commentary, etc.), recording date and time, caller ID, recipient ID, context, call type and remarks. This publication contains annotation files that can be viewed with the accompanying software or with spreadsheet software, such as Microsoft Excel.</p><br>
<h3>Data</h3><br>
<p>There are 60 audio files (approximately 5 GB), containing approximately 30 hours of recordings. All of the audio files are in the Microsoft WAV format with the sampling frequency of 22,050 Hz. A sample audio file may be found <a href="desc/addenda/LDC2004S12.wav" rel="nofollow">here</a>.</p><br>
<p>There are 60 annotation files containing approximately 1,270 annotations of selected audio files in the distributions. All of the annotation files are tab-separated table files without a header, and use the UNIX-style newline ( ). A sample annotation may be found <a href="desc/addenda/LDC2004S12.ann" rel="nofollow">here</a>.</p><br>
<p>Annotation files for the following audio files are not included in this publication: <em>V08, V21, V42, V43, V44, V66, Vb1, Vb2, Vb3, Vb4, Vb5, Vb6, Vb7, Vb8, Vb9, Vc1, Vc2 and Vc3.</em></p><br>
<h3>Software</h3><br>
<p>The data/software directory contains a Windows version of the AGTK TableTrans tool for annotation of audio that was used in creating the annotations.</p><br>
<p>Requirements: PC running Windows XP, Windows 2000 or WindowsNT</p><br>
<p>Installation: The AGTK TableTrans1_2_2.exe file is a self-extracting installation program. Double clicking on the file will start the installation program.</p><br>
<p>Information: Information about the AGTK (the Annotation Graph Toolkit) project is available at: <a href="http://agtk.sf.net/" rel="nofollow"> http://agtk.sf.net/</a></p><br>
<h3>Updates</h3><br>
<p>None at this time.</p><br>
<h3>Sponsorship</h3><br>
<p>The publication of the Field Recordings of Vervet Monkey Calls was funded in part through a five-year grant (BCS-998009, KDI, SBE) from the National Science Foundation via <a href="https://talkbank.org/" rel="nofollow">TalkBank</a>, an interdisciplinary project to foster research and development in communicative behavior by providing tools and standards for analysis and distribution of language and animal communication data.</p></br>
Portions © 1977-1978, 2001-2004, Robert M. Seyfarth, Dorothy L. Cheney, © 2004 Trustees of the University of Pennsylvania
DOI: 10.35111/da4a-se30
title: Fisher English Training Speech Part 1 Speech

description: <h3>Introduction</h3><br>
<p>Fisher English Training Speech Part 1 Speech represents the first half of a collection of conversational telephone speech (CTS) that was created at the LDC during 2003. It contains 5,850 audio files, each one containing a full conversation of up to 10 minutes. Additional information regarding the speakers involved and types of telephones used can be found in the companion text corpus of transcripts, <a href="http://catalog.ldc.upenn.edu/LDC2004T19" rel="nofollow">Fisher English Training Speech Part 1, Transcripts (LDC2004T19)</a>.</p><br>
<p>The Fisher telephone conversation collection protocol was created at LDC to address a critical need of developers trying to build robust automatic speech recognition (ASR) systems. Previous collection protocols, such as CALLFRIEND and Switchboard-II and the resulting corpora, have been adapted for ASR research but were in fact developed for language and speaker identification respectively. Although the CALLHOME protocol and corpora were developed to support ASR technology, they feature small numbers of speakers making telephone calls of relatively long duration with narrow vocabulary across the collection. CALLHOME conversations are challengingly natural and intimate. Under the Fisher protocol, a very large number of participants each make a few calls of short duration speaking to other participants, whom they typically do not know, about assigned topics. This maximizes inter-speaker variation and vocabulary breath while also increasing formality.</p><br>
<p>Previous protocols such as CALLHOME, CALLFRIEND and Switchboard relied upon participant activity to drive the collection. Fisher is unique in being platform driven rather than participant driven. Participants who wish to initiate a call may do so; however the collection platform initiates the majority of calls. Participants need only answer their phones at the times they specified when registering for the study.</p><br>
<p>To encourage a broad range of vocabulary, Fisher participants are asked to speak on an assigned topic which is selected at random from a list, which changes every 24 hours and which is assigned to all subjects paired on that day. Some topics are inherited or refined from previous Switchboard studies while others were developed specifically for the Fisher protocol.</p><br>
<h3>Data</h3><br>
<p>The individual audio files are presented in NIST SPHERE format, and contain two-channel mu-law sample data; "shorten" compression has been applied to all files.</p><br>
<p>Data collection and transcription were sponsored by DARPA and the U.S. Department of Defense, as part of the EARS project for research and development in automatic speech recognition.</p><br>
<h3>Samples</h3><br>
<p>Please examine this <a href="desc/addenda/LDC2004S13.wav" rel="nofollow">sample</a> to see an example of the data in this corpus.</p></br>
© 2003-2004 Trustees of the University of Pennsylvania
DOI: 10.35111/9eej-de39
title: Czech Broadcast News Transcripts

description: <h3>Introduction</h3> <p>Czech Broadcast News Transcripts contains the transcripts corresponding to the Czech broadcast news audio published as <a href="http://catalog.ldc.upenn.edu/LDC2004S01" rel="nofollow">Czech Broadcast News Speech</a>. </p><p>The audio recordings were collected from three Czech radio stations (Cesky rozhlas 1 Radiozurnal - CRo1, Cesky rozhlas 2 Praha - CRo2, Cesky rozhlas 3 Vltava - CRo3) and two TV channels (Ceska televize - CTV and Prima TV - Prima). The audio was recorded between February 1 and April 22, 2000, at the Department of Cybernetics, University of West Bohemia in Pilsen. </p><p>The corpus was created to support the development of large vocabulary speaker independent speech recognition systems for Czech. </p><h3>Data</h3> <p>There are 286 transcripts, corresponding to the 286 audio files (approximately 50 hours of broadcast news). The transcripts contain approximatelly 196K words and 27K unique words. The news does not contain weather forecasts, sports news, or traffic announcements. The stations, channels, number of files and number of hours are listed below: </p><p><b>Radio</b> </p><table width="200"> <tr> <td><b>Source</b></td> <td><b>Files</b></td> <td><b>Hours</b></td> </tr> <tr> <td>CRo1</td> <td>138</td> <td>30.8</td> </tr> <tr> <td>CRo2</td> <td>90</td> <td>7.8</td> </tr> <tr> <td>CRo3</td> <td>14</td> <td>2</td> </tr> </table><p><b>TV</b> </p><table width="200"> <tr> <td><b>Source</b></td> <td><b>Files</b></td> <td><b>Hours</b></td> </tr> <tr> <td>CTV</td> <td>22</td> <td>5.1</td> </tr> <tr> <td>Prima</td> <td>22</td> <td>4.2</td> </tr> </table><p>The transcripts were created by native Czech speakers working at the Department of Cybernetics, University of West Bohemia in Pilsen, under the direction of Vlasta Radova. The transcription was done using software provided by the LDC (Transcriber 1.4.1). Those parts of the audio recordings that do not contain speech or where the signal was disrupted, were not transcribed. As a consequence, the corpus contains about 23 hours of transcribed speech. The transcriptions are provided both in the ISO-8859-2 and Windows-1250 character set. </p><p>For an example transcript please click on this <a href="./desc/addenda/LDC2004T01.gif" rel="nofollow">example</a>. </p><h3>Sponsorship</h3> The completion of this corpus was facilitated by funding provided by the Ministry of Education of the Czech Republic (Grants No. MSM235200004 and LN00A063) and by the National Science Foundation (NSF) project no. IIS-9820687 entitled "1999 Language Engineering Workshop for Students and Professionals: Integrating Research and Education (WS99)" under the agreement no. 8004-48231 between the Johns Hopkins University, Baltimore, Maryland, and the University of West Bohemia in Pilsen, Czech Republic. <h3>Updates</h3> <p>There are no updates available at this time. </p></br>
Portions © 2000 Ceska televize, © 2000 Cesky rozhlas 1 Radiozurnal, © 2000 Cesky rozhlas 2 Praha, © 2000 Cesky rozhlas 3 Vltava, © 2000 FTV Premiera, © 2004 Trustees of the University of Pennsylvania
DOI: 10.35111/ds4r-3x44
title: Arabic Treebank: Part 2 v 2.0

description: <h3>Introduction</h3><br>
<p>Arabic Treebank: Part 2 v 2.0 was produced by Linguistic Data Consortium (LDC) catalog number LDC2004T02 and ISBN 1-58563-282-1.</p><br>
<p>This publication is the second part of a corpus of 1,000,000 words of Arabic Treebank, designed to support language research and development of language technology for Modern Standard Arabic. Part one was released in 2003 as <a href="http://catalog.ldc.upenn.edu/LDC2003T06" rel="nofollow">Arabic Treebank: Part 1 v 2.0</a>, having the source data extracted from Agence France Press stories. The current Arabic Treebank: Part 2 v 2.0 corpus consists of stories from Al-Hayat distributed by Ummah.</p><br>
<h3>Data</h3><br>
<p>This corpus includes 501 stories from the Ummah Arabic News Text. There are a total of 144,199 words (counting non-Arabic tokens such as numbers and punctuation) in the 501 files - one story per file. New features of annotation include complete vocalization (including case endings), lemma IDs, and more specific POS tags for verbs and particles.</p><br>
<p>The corpus contains 125,698 Arabic-only word tokens (prior to the separation of clitics), of which 124,740 (99.24%) were provided with an acceptable morphological analysis and POS tag by the morphological parser, and 958 (0.76%) were items that the morphological parser failed to analyze correctly.</p><br>
<h3>Samples</h3><br>
<p>Please view the following samples:</p><br>
<ul><br>
<li><a href="desc/addenda/LDC2004T02.sgm">SGML</a></li><br>
<li><a href="desc/addenda/LDC2004T02.tree">Treebank</a></li><br>
<li><a href="desc/addenda/LDC2004T02.tbnk.xml">Treebank - XML</a></li><br>
<li><a href="desc/addenda/LDC2004T02.pos.xml">POS</a></li><br>
</ul><br>
<h3>Updates</h3><br>
<p>There are no updates available at this time.</p></br>
Portions © 2001-2002 Ummah Press, © 2004 Trustees of the University of Pennsylvania
DOI: 10.35111/0sq8-s977
title: ICSI Meeting Transcripts

description: <h3>Introduction</h3> <p>ICSI Meeting Transcripts was produced by Linguistic Data Consortium (LDC) catalog number LDC2004T04 and ISBN 1-58563-286-4. </p><p>The ICSI Meeting corpus is a collection of 75 meetings collected at the International Computer Science Institute in Berkeley during the years 2000-2002. The meetings included are "natural" meetings in the sense that they would have occurred anyway: they are generally regular weekly meetings of various ICSI working teams, including the team working on the ICSI Meeting Project. In recording meetings of this type, we hoped to capture meeting dynamics and speaking styles that are as natural as possible given that speakers are wearing close-talking microphones and are fully cognizant of the recording process. The speech files range in length from 17 to 103 minutes, but generally run just under an hour each. The speech files are available as <a href="http://catalog.ldc.upenn.edu/LDC2004S02" rel="nofollow">ICSI Meeting Speech</a>. </p><h3>Data</h3> <p>This corpus consists of 75 word-level transcripts (one transcript file per meeting), time-synchronized to digitized audio recordings. There are approximately 795 K-words and 13K unique words in the transcripts. </p><p>The meetings were recorded with close-talking and far-field microphones. The transcripts were based mostly on the close-talking microphones, either separately or blended together in a so-called "mixed" channel. The focus of the transcripts was on capturing the flow of audible events, especially the words which were spoken, and who spoke them. </p><p>Transcripts were prepared by means of the "<a href="http://www.icsi.berkeley.edu/Speech/mr/channeltrans.html" rel="nofollow">Channeltrans</a>" interface. Channeltrans is an extension of the "Transcriber" interface. </p><p>There are a total of 53 unique speakers in the corpus. Meetings involved anywhere from three to 10 participants, averaging six. The corpus contains a significant proportion of non-native English speakers, varying in fluency from nearly-native to challenging-to-transcribe. </p><h3>Sponsorship</h3> The collection and preparation of this corpus was made possible in large part through funding from DARPA, both through the Communicator project and through a ROAR "seedling," the Swiss IM2 project (National Centre of Competence in Research, sponsored by the Swiss National Science Foundation), and a supplementary award from IBM. <h3>Updates</h3> <p>There are no updates available at this time. More information is available at <a href="http://www.ICSI.Berkeley.EDU/Speech/mr" rel="nofollow">http://www.ICSI.Berkeley.EDU/Speech/mr</a>. </p> </br>
Portions © 2000-2003 International Computer Science Institute, © 2004 Trustees of the University of Pennsylvania