DOI: 10.5281/zenodo.1120378
title: CryoEM Maps and Associated Data Submitted to the 2015/2016 EMDataBank Map Challenge

description: Files and metadata associated with the EMDataBank/Unified Data Resource for 3DEM 2015/2016 Map Challenge hosted at challenges.emdatabank.org are deposited.

All members of the Scientific Community--at all levels of experience--were invited to participate as Challengers, and/or as Assessors.

Seven benchmark raw image datasets were selected for the challenge. Six are selected from recently described single particle structure determinations with image data collected as multi-frame movies; one is based on simulated (in silico) images. All of the raw image datasets are archived at pdbe.org/empiar.

27 Challengers created 66 single particle reconstructions from the targets, and then uploaded their results with associated details.  15 of the reconstructions were calculated using the SDSC Gordon supercomputer.

This map challenge was one of two community-wide challenges sponsored by EMDataBank in 2015/2016 to critically evaluate 3DEM methods that are coming into use, with the ultimate goal of developing validation criteria associated with every 3DEM map and map-derived model.
description: The 2015/2016 Map Challenge was supported by the US National Institutes of Health / National Institute for General Medical Sciences (NIH/NIGMS) Under Grant Number R01 GM079429 to Wah Chiu (PI).  A Directors Award from the UCSD Supercomputer Center provided supercomputer access that was used in 15 of the 66 submitted entries.
description: {"references": ["Henderson et al (2012) Outcome of the first electron microscopy validation task force meeting. doi:10.1016/j.str.2011.12.014", "Lawson et al (2016) EMDataBank unified data resource for 3DEM. doi:10.1093/nar/gkv1126", "Marabini et al (2016) The Electron Microscopy Exchange (EMX) Iniitiative doi:10.1016/j.jsb.2016.02.008", "Lawson and Chiu (2018) Comparing Cryo-EM Structures doi:10.1016/j.jsb.2018.10.004", "Stagg and Mendez (2018) Processing apoferritin with the Appion pipeline doi:10.1016/j.jsb.2018.06.009", "Heymann (2018) Single Particle reconstruction and validation using Bsoft for the map challenge doi:10.1016/j.jsb.2018.07.003", "Sorzano et al (2018) A new algorithm for high-resolution reconstruction of single particles by electron microscopy doi:10.1016/j.jsb.2018.08.002", "Bell et al (2018) New software tools in EMAN2 inspired by EMDatabank map challenge doi:10.1016/j.jsb.2018.09.002", "Donati et al (2018) Fast multiscale reconstruction for Cryo-EM doi:10.1016/j.jsb.2018.09.008", "Heymann (2018) Map Challenge assessment: Fair comparison of single particle cryoEM reconstructions doi:10.1016/j.jsb.2018.07.012", "Jonic (2018) A methodology using Gaussian-based density map approximation to assess sets of cryo-electron microscopy density maps doi:10.1016/j.jsb.2018.07.014", "Pintilie and Chiu (2018) Assessment of structural features in Cryo-EM density maps using SSE and side chain Z-scores doi:10.1016/j.jsb.2018.08.015", "Marabini et al (2018) Map challenge: Analysis using a pair comparison method based on Fourier shell correlation doi:10.1016/j.jsb.2018.09.009", "Mendez and Stagg (2018) Assessing the quality of single particle reconstructions by atomic model building doi:10.1016/j.jsb.2018.09.004", "Heymann et al (2018) The first single particle analysis Map Challenge: A summary of the assessments doi:10.1016/j.jsb.2018.08.010"]}