All 121 questions are scored in about one-half hour. This is a big improvement over our initial approach, which was to discuss each question and to be accurate on each score. We finally decided that we could not become experts on each project, but we could tell the project how our team saw the project based on the exposure time, which was close to how much exposure time a full SPA would have. It was also the case that in scoring homogenous projects we could rapidly see the similarities and differences between projects. We never pushed the results as being an accurate score.
Morning Interview the next three projects.
Six related projects were the most we felt comfortable handling in one week. Afternoon Score the last projects interviewed. Conduct Final Analysis Compare and contrast the findings between each individual project. For homogeneous projects, this was an incredibly useful activity. We discovered that our understanding of the projects from the first interview to the last grew, hence by the time we reviewed the last project, many of the uncertainties from the first few projects were cleared up.