DOI: 10.35111/1bsf-4c55
title: First DIHARD Challenge Evaluation - Nine Sources

description: <h3>Introduction</h3><br>
<p>First DIHARD Challenge Evaluation - Nine Sources was developed by the Linguistic Data Consortium (LDC) and contains approximately 18 hours of English and Chinese speech data along with corresponding annotations used in support of the <a href="https://coml.lscp.ens.fr/dihard/2018/index.html">First DIHARD Challenge</a>.</p><br>
<p>The First DIHARD Challenge was an attempt to reinvigorate work on diarization through a shared task focusing on "hard" diarization; that is, speech diarization for challenging corpora where there was an expectation that existing state-of-the-art systems would fare poorly. As such, it included speech from a wide sampling of domains representing diversity in number of speakers, speaker demographics, interaction style, recording quality, and environmental conditions, including, but not limited to: clinical interviews, extended child language acquisition recordings, YouTube recordings, and conversations collected in restaurants.</p><br>
<h3>Data</h3><br>
<p>This release, when combined with First DIHARD Challenge Evaluation - SEEDLingS (<a href="../../../LDC2019S13">LDC2019S13</a>), contains the evaluation set audio data and annotation as well as the official scoring tool. The development data for the First DIHARD Challenge is also available from LDC as Eight Sources (<a href="../../../LDC2019S09">LDC2019S09</a>) and SEEDLingS (<a href="../../../LDC2019S10">LDC2019S10</a>).</p><br>
<p>The source data was drawn from the following (all sources are in English unless otherwise indicated):</p><br>
<ul><br>
<li>Autism Diagnostic Observation Schedule (ADOS) interviews</li><br>
<li>Conversations in Restaurants</li><br>
<li>DCIEM/HCRC map task (<a href="../../../LDC96S38">LDC96S38</a>)</li><br>
<li>Audiobook recordings from <a href="https://librivox.org/">LibriVox</a></li><br>
<li>Meeting speech collected by LDC in 2001 for the ROAR project (see, e.g., ISL Meeting Speech Part 1 (<a href="../../../LDC2004S05">LDC2004S05</a>))</li><br>
<li>2001 U.S. Supreme Court oral arguments</li><br>
<li>Mixer 6 Speech (<a href="../../../LDC2013S03">LDC2013S02</a>)</li><br>
<li>Chinese video collected by LDC as part of the Video Annotation for Speech Technologies (VAST) project</li><br>
<li>YouthPoint radio interviews</li><br>
</ul><br>
<p>All audio is provided in the form of 16 kHz, mono-channel FLAC files. The diarization for each recording is stored as a NIST Rich Transcription Time Marked (RTTM) file. RTTM files are space-separated text files containing one turn per line. Segmentation files are stored as HTK label files. Each of these files contains one speech segment per line. Both of the annotation file types are encoded as UTF-8. More information about the file formats are in the included documentation.</p><br>
<h3>Samples</h3><br>
<p>Please view the following samples:</p><br>
<ul><br>
<li><a href="desc/addenda/LDC2019S12.flac">Speech</a></li><br>
<li><a href="desc/addenda/LDC2019S12.lab">Segmentation</a></li><br>
<li><a href="desc/addenda/LDC2019S12.rttm">Diarization</a></li><br>
</ul><br>
<h3>Updates</h3><br>
<p>None at this time.</p></br>
Portions © 1995 Defence and Civil Institute of Environmental Medicine, © 2002 Interactive Systems Laboratories, Carnegie Mellon University, © 2003 SIL International (IPA93 Fonts), © 2011-2018 YouTube, LLC, © 1996, 2001, 2004, 2009-2010, 2013, 2018, 2019 Trustees of the University of Pennsylvania