Skip to main content    

An official website of the United States government

Here’s how you know

**Official websites use .gov**              A **.gov** website belongs to an official government organization in the United States.            

**Secure .gov websites use HTTPS**              A **lock** (  LockA locked padlock) or **https://** means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.            

https://www.nist.gov/itl/iad/mig/metrics-machine-translation-2010-evaluation

            -  Topics  -  All Topics 
-  Advanced communications 
-  Artificial intelligence 
-  Bioscience 
-  Buildings and construction 
-  Chemistry 
-  Climate 
-  Cybersecurity 
-  Electronics 
-  Energy 
-  Environment 
-  Fire 
-  Forensic science 
-  Health 
-  Information technology 
-  Infrastructure 
-  Manufacturing 
-  Materials 
-  Mathematics and statistics 
-  Metrology 
-  Nanotechnology 
-  Neutron research 
-  Performance excellence 
-  Physics 
-  Public safety 
-  Resilience 
-  Standards 
-  Transportation 
 
            -  Publications 
            -  Labs & Major Programs  -  Laboratories    -  Communications Technology Laboratory 
  -  Engineering Laboratory 
  -  Information Technology Laboratory 
  -  Material Measurement Laboratory 
  -  Physical Measurement Laboratory 
-  User Facilities    -  NIST Center for Neutron Research 
  -  CNST NanoFab 
-  Research Test Beds 
-  Research Projects 
-  Tools & Instruments 
-  Major Programs    -  Baldrige Performance Excellence Program 
  -  CHIPS for America Initiative 
  -  Manufacturing Extension Partnership (MEP) 
  -  Office of Advanced Manufacturing 
  -  Special Programs Office 
  -  Technology Partnerships Office 
 
            -  Services & Resources  -  Standards and Measurements    -  Calibration Services 
  -  Laboratory Accreditation (NVLAP) 
  -  Quality System 
  -  Standard Reference Materials (SRMs) 
  -  Standards.gov 
  -  Time Services 
  -  Office of Weights and Measures 
-  Software 
-  Data    -  Chemistry WebBook 
  -  National Vulnerability Database 
  -  Physical Reference Data 
  -  Standard Reference Data (SRD) 
-  Storefront 
-  License & Patents 
-  Computer Security Resource Center (CSRC) 
-  NIST Research Library 
 
            -  News & Events  -  News 
-  Events 
-  Blogs 
-  Feature Stories 
-  Awards 
-  Video Gallery 
-  Image Gallery 
-  Media Contacts 
 
            -  About NIST  -  About Us    -  Leadership 
  -  Organization Structure 
  -  Budget & Planning 
-  Contact Us 
-  Visit 
-  Careers    -  Student programs 
-  Work with NIST 
-  History    -  NIST Digital Archives 
  -  NIST Museum 
  -  NIST and the Nobel 
-  Educational Resources 
 

Information Technology LaboratoryInformation Access Division

## Multimodal Information Group

-  Tools 
-  Past HLT Evaluation Projects 
-  Staff 

# Metrics for Machine Translation 2010 Evaluation

## Share

Facebook

Linkedin

Twitter

Email

## Metrics for Machine Translation 2010 Evaluation (MetricsMaTr10)

MetricsMaTr10 was implemented in accordance with the MetricsMaTr10 evaluation plan. It took place in the spring/summer of 2010 as part of the Joint Fifth Workshop on Statistical Machine Translation and MetricsMaTr10, a workshop of ACL 2010.

Please see the main MetricsMaTr page for a general description of the MetricsMaTr challenge series.

##### Documentation

                  - Evaluation plan , v1-3, updated April 19 2010
                  - NIST MetricsMaTr10 Official Release of Results , updated April 12 2011
                  - NIST WMT10/MetricsMaTr10 workshop slides , public v1-1, October 22 2010

##### Previous MetricsMaTr Resources

                  - MetricsMaTr08 development set automatic metric scores  (baseline and MetricsMaTr08 submitted metrics)
                  - WMT08 (ACL08 Third Workshop on Statistical Machine Translation) test set : machine translations, reference translations, and automatic metric scores (baseline and MetricsMATR08 submitted metrics)

##### Schedule

Please see the Joint Fifth Workshop on Statistical Machine Translation and MetricsMaTr10 website regarding dates for voluntary submissions of metric descriptions as short papers to ACL 2010.
                  - January 11 2010: MetricsMaTr08 development data set re-release for MetricsMaTr10
                  - March 26 2010: Metric submission commitment due at NIST
                  - March 26 - May 14 2010: Metric submission period, metrics must be installed and operational at NIST by May 14, 5pm EDT
                  - June 18 2010: Informal metric descriptions due at NIST
                  - July 15 - 16 2010: Joint Fifth Workshop on Statistical Machine Translation and MetricsMaTr10 (at ACL 2010 in Uppsala, Sweden)

##### Contact

mt_poc [at] nist.gov (mt_poc[at]nist[dot]gov)

You can subscribe to the MetricsMaTr mailing list hosted by NIST, metricsmt_list [at] nist.gov (metricsmt_list[at]nist[dot]gov), by sending e-mail to listproc [at] nist.gov (listproc[at]nist[dot]gov). Put "subscribe metricsmt_list" in the body.

Information technologyMetrologyMetrologyMetrology

### HEADQUARTERS

301-975-2000

Webmaster | Contact Us | Our Other Offices

TwitterFacebookLinkedInInstagramYouTubeGiphyRSS FeedMailing List

Feedback

            -  Site Privacy 
            -  Accessibility 
            -  Privacy Program 
            -  Copyrights 
            -  Vulnerability Disclosure 
            -  No Fear Act Policy 
            -  FOIA 
            -  Environmental Policy 
            -  Scientific Integrity 
            -  Information Quality Standards 
            -  Commerce.gov 
            -  Science.gov 
            -  USA.gov 
            -  Vote.gov