Skip to main content    

An official website of the United States government

Here’s how you know

**Official websites use .gov**              A **.gov** website belongs to an official government organization in the United States.            

**Secure .gov websites use HTTPS**              A **lock** (  LockA locked padlock) or **https://** means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.            

https://www.nist.gov/itl/iad/mig/nist-2017-language-recognition-evaluation

            -  Topics  -  All Topics 
-  Advanced communications 
-  Artificial intelligence 
-  Bioscience 
-  Buildings and construction 
-  Chemistry 
-  Climate 
-  Cybersecurity 
-  Electronics 
-  Energy 
-  Environment 
-  Fire 
-  Forensic science 
-  Health 
-  Information technology 
-  Infrastructure 
-  Manufacturing 
-  Materials 
-  Mathematics and statistics 
-  Metrology 
-  Nanotechnology 
-  Neutron research 
-  Performance excellence 
-  Physics 
-  Public safety 
-  Resilience 
-  Standards 
-  Transportation 
 
            -  Publications 
            -  Labs & Major Programs  -  Laboratories    -  Communications Technology Laboratory 
  -  Engineering Laboratory 
  -  Information Technology Laboratory 
  -  Material Measurement Laboratory 
  -  Physical Measurement Laboratory 
-  User Facilities    -  NIST Center for Neutron Research 
  -  CNST NanoFab 
-  Research Test Beds 
-  Research Projects 
-  Tools & Instruments 
-  Major Programs    -  Baldrige Performance Excellence Program 
  -  CHIPS for America Initiative 
  -  Manufacturing Extension Partnership (MEP) 
  -  Office of Advanced Manufacturing 
  -  Special Programs Office 
  -  Technology Partnerships Office 
 
            -  Services & Resources  -  Standards and Measurements    -  Calibration Services 
  -  Laboratory Accreditation (NVLAP) 
  -  Quality System 
  -  Standard Reference Materials (SRMs) 
  -  Standards.gov 
  -  Time Services 
  -  Office of Weights and Measures 
-  Software 
-  Data    -  Chemistry WebBook 
  -  National Vulnerability Database 
  -  Physical Reference Data 
  -  Standard Reference Data (SRD) 
-  Storefront 
-  License & Patents 
-  Computer Security Resource Center (CSRC) 
-  NIST Research Library 
 
            -  News & Events  -  News 
-  Events 
-  Blogs 
-  Feature Stories 
-  Awards 
-  Video Gallery 
-  Image Gallery 
-  Media Contacts 
 
            -  About NIST  -  About Us    -  Leadership 
  -  Organization Structure 
  -  Budget & Planning 
-  Contact Us 
-  Visit 
-  Careers    -  Student programs 
-  Work with NIST 
-  History    -  NIST Digital Archives 
  -  NIST Museum 
  -  NIST and the Nobel 
-  Educational Resources 
 

Information Technology LaboratoryInformation Access Division

## Multimodal Information Group

-  Tools 
-  Past HLT Evaluation Projects 
-  Staff 

# NIST 2017 Language Recognition Evaluation

## Share

Facebook

Linkedin

Twitter

Email

The 2017 NIST language recognition evaluation (LRE17) is the 8th cycle in an on-going language recognition evaluation series that began in 1996. The objectives of the evaluation series are (1) to explore promising new ideas in language recognition, (2) to support the development of advanced technology incorporating these ideas, and (3) to measure the performance of the current state of technology. Targeting researchers working on the general problem of text-independent, speaker-independent language recognition, the evaluation is designed to focus on core technology issues and to be simple and accessible to those wishing to participate.

LRE17 will be organized in a similar manner as LRE15, with a few differences. A main difference is in the test data used in the evaluation. In addition to conversational telephone speech (CTS), speech excerpts extracted from video data (i.e., VAST corpus) will be used as test material. Samples of the VAST data will be distributed to participants for system training and development purposes. In addition, an alternative performance measure based on cross-entropy is introduced in LRE17. The alternative measure, which is called Normalized Cross-Entropy (aka confidence score), has been used by NIST since late 90's to evaluate performance of speech-to-text systems.

Normalized Cross-Entropy

There is no cost to participate in LRE17, but participating teams must be represented at the evaluation workshop to be held in Orlando, FL, December 12-13, 2017. More information about the evaluation and registration can be found in LRE17 plan.

LRE17 Evaluation Plan(updated September 29, 2017)

Send comments to lre_poc [at] nist.gov (lre_poc[at]nist[dot]gov). A notice will go out to the mailing list and the web page will be updated when the evaluation plan becomes available.	Send email address to lre_poc [at] nist.gov (lre_poc[at]nist[dot]gov) with request to be added to the mailing list to receive automatic updates.

BiometricsHuman language technologyInformation retrievalExperiment designImage and signal processingModeling and simulation researchNumerical methods and softwareStatistical analysis

## Contacts

                -  Craig Greenberg  craig.greenberg@nist.gov      (301) 975-3605   

### HEADQUARTERS

301-975-2000

Webmaster | Contact Us | Our Other Offices

TwitterFacebookLinkedInInstagramYouTubeGiphyRSS FeedMailing List

Feedback

            -  Site Privacy 
            -  Accessibility 
            -  Privacy Program 
            -  Copyrights 
            -  Vulnerability Disclosure 
            -  No Fear Act Policy 
            -  FOIA 
            -  Environmental Policy 
            -  Scientific Integrity 
            -  Information Quality Standards 
            -  Commerce.gov 
            -  Science.gov 
            -  USA.gov 
            -  Vote.gov