DOI: 10.35111/awny-7397
title: 2017 NIST Language Recognition Evaluation Training and Development Sets

description: <h3>Introduction</h3><br>
<p>2017 NIST Language Recognition Evaluation Training and Development Sets contains training and development material for the <a href="https://www.nist.gov/itl/iad/mig/nist-2017-language-recognition-evaluation">2017 NIST Language Recognition Evaluation</a>. It consists of approximately 2,100 hours of conversational telephone speech, broadcast conversation, broadcast narrow band speech, and speech from video in the following 14 languages, dialects, and varieties: Arabic (Iraqi, Levantine, Maghrebi, Egyptian), English (British, American), Polish, Russian, Portuguese (Brazilian), Spanish (Caribbean, European, Latin American Continental), and Chinese (Mandarin, Min Nan).</p><br>
<p>The goal of the <a href="https://www.nist.gov/">NIST</a> (National Institute of Standards and Technology) <a href="https://www.nist.gov/itl/iad/mig/language-recognition">Language Recognition Evaluation</a> (LRE) is to establish the baseline of current performance capability for language recognition of conversational telephone speech and to lay the groundwork for further research efforts in the field. NIST conducted language recognition evaluations in 1996, 2003, 2005, 2007, 2009, 2011, and 2015. The <a href="https://www.nist.gov/itl/iad/mig/nist-2017-language-recognition-evaluation">2017</a> evaluation focused on differentiating closely related language pairs. In addition to conversational telephone speech, broadcast conversation, and broadcast narrow band speech, speech excerpts extracted from video data were used. Further information regarding this evaluation can be found in the <a href="https://www.nist.gov/system/files/documents/2017/09/29/lre17_eval_plan-2017-09-29_v1.pdf">evaluation plan</a> which is also included in the documentation for this release.</p><br>
<p>LDC released the prior LREs as:</p><br>
<ul><br>
<li>2003 NIST Language Recognition Evaluation (<a href="../../../LDC2006S31">LDC2006S31</a>)</li><br>
<li>2005 NIST Language Recognition Evaluation (<a href="../../../LDC2008S05">LDC2008S05</a>)</li><br>
<li>2007 NIST Language Recognition Evaluation Test Set (<a href="../../../LDC2009S04">LDC2009S04</a>)</li><br>
<li>2007 NIST Language Recognition Evaluation Supplemental Training Set (<a href="../../../LDC2009S05">LDC2009S05</a>)</li><br>
<li>2009 NIST Language Recognition Evaluation Test Set (<a href="../../../LDC2014S06">LDC2014S06</a>)</li><br>
<li>2011 NIST Language Recognition Evaluation Test Set (<a href="../../../LDC2018S06">LDC2018S06</a>)</li><br>
</ul><br>
<h3>Data</h3><br>
<p>This release includes data from LDC's CALLFRIEND and Fisher telephone collections, the VAST video collection, various broadcast sources and earlier NIST LRE test sets.</p><br>
<p>The training audio files are single-channel, 8-KHz sample rate in NIST SPHERE format, either mu-law, A-law or 16-bit PCM. The development audio files are also single-channel, but vary in format: either SPHERE or FLAC-compressed MSWAV (RIFF). All "*.flac" files are 16-bit PCM, 44.1 KHz sample rate; the "*.sph" files are all 8-KHz, with either mu-law or 16-bit PCM samples.</p><br>
<h3>Samples</h3><br>
<h3>Updates</h3><br>
<p>None at this time.</p></br>
 Portions © 2022 Trustees of the University of Pennsylvania