DOI: 10.35111/whbr-1r87
title: Second DIHARD Challenge Evaluation - Eleven Sources

description: <h3>Introduction</h3><br>
<p>Second DIHARD Challenge Evaluation - Eleven Sources was developed by LDC and contains approximately 20 hours of English and Chinese speech data along with corresponding annotations used in support of the <a href="https://dihardchallenge.github.io/dihard2">Second DIHARD Challenge</a>.</p><br>
<p>The DIHARD Challenges are a set of shared tasks on diarization focusing on "hard" diarization; that is, speech diarization for challenging corpora where there was an expectation that existing state-of-the-art systems would fare poorly. As with the <a href="https://dihardchallenge.github.io/dihard1/">first challenge</a>, the second development and evaluation sets were drawn from a diverse sampling of sources including monologues, map task dialogues, broadcast interviews, sociolinguistic interviews, meeting speech, speech in restaurants, clinical recordings, extended child language acquisition recordings, and YouTube videos.</p><br>
<h3>Data</h3><br>
<p>This release, when combined with Second DIHARD Challenge Evaluation - SEEDLingS (forthcoming from LDC), contains the evaluation set audio data and annotation, except for CHiME-5 audio files, which must be obtained from the University of Sheffield.</p><br>
<p>Data sources in this release are as follows (all sources are in English unless otherwise indicated):</p><br>
<ul><br>
<li>Autism Diagnosis Observation Schedule (ADOS) interviews</li><br>
<li>Conversations in Restaurants</li><br>
<li>DCIEM/HCRC map task (<a href="../../../LDC96S38">LDC96S38</a>)</li><br>
<li>Audiobook recordings from <a href="https://librivox.org/">LibriVox</a></li><br>
<li>Meeting speech from 2004 Spring NIST Rich Transcription (RT-04S) Development (<a href="../../../LDC2007S11">LDC2007S11</a>) and Evaluation (<a href="../../../LDC2007S12">LDC2007S12</a>) releases</li><br>
<li>Meeting speech collected by LDC in 2001 for the ROAR project (see, e.g., ISL Meeting Speech Part 1 (<a href="../../../LDC2004S05">LDC2004S05</a>))</li><br>
<li>2001 U.S. Supreme Court oral arguments</li><br>
<li>Sociolinguistic interviews from SLX Corpus of Classic Sociolinguistic Interviews (<a href="../../../LDC2003T15">LDC2003T15</a>)</li><br>
<li>Mixer 6 Speech (<a href="../../../LDC2013S03">LDC2013S03</a>)</li><br>
<li>English and Chinese video collected by LDC as part of the Video Annotation for Speech Technologies (VAST) project</li><br>
<li>YouthPoint radio interviews</li><br>
</ul><br>
<p>All audio is provided in the form of 16 kHz, 16-bit, mono-channel FLAC files. The diarization for each recording is stored as a NIST Rich Transcription Time Marked (RTTM) file. RTTM files are space-separated text files containing one turn per line. Segmentation files are stored as HTK label files. Each of these files contains one speech segment per line. Scoring regions for each recording are specific by un-partitioned evaluation map (UEM) files. All annotation file types are encoded as UTF-8. More information about file formats, data sources and domains is contained in the included documentation.</p><br>
<h3>Samples</h3><br>
<p>Please view the following samples:</p><br>
<ul><br>
<li><a href="desc/addenda/LDC2022S06.flac">Speech (FLAC)</a></li><br>
<li><a href="desc/addenda/LDC2022S06.lab">Segmentation (TXT)</a></li><br>
<li><a href="desc/addenda/LDC2022S06.rttm">Diarization (TXT)</a></li><br>
</ul><br>
<h3>Updates</h3><br>
<p>None at this time.</p></br>
Portions © 1995 Defence and Civil Institute of Environmental Medicine, © 2002 Interactive Systems Laboratories, Carnegie Mellon University, © 2000-2001 International Computer Science Institute, © 2003 SIL International (IPA93 Fonts), © 2011-2018 YouTube, LLC, © 1996, 2001, 2003, 2004, 2007, 2009-2010, 2013, 2018, 2019, 2022 Trustees of the University of Pennsylvania