As the number of completed @entity8085 (Critical Assessment of Protein Structure Prediction) experiments grows, so does the need for stable, standard methods for comparing performance in successive experiments. It is critical to develop methods for determining the areas in which there is progress and in which areas are static. We have added an analysis of the @entity2523 results to that previously published for @entity69627 . We again use a unified difficulty scale to permit comparison of performance as a function of target difficulty in the different CASPs. The scale is used to compare performance in aligning target sequences to a structural template. There was a clear improvement in alignment quality between @entity9302 (1994) and @entity15097 (1996). No change is apparent between @entity15097 and @entity522 (1998). There is a small barely detectable improvement between @entity522 and the latest experiment ( @entity2523 , 2000). Alignment remains the major source of error in all models based on less than about 30% sequence identity. Comparison of performance in the new fold modeling regime is complicated by issues in devising an objective target difficulty scale. We have found limited numerical support for significant progress between @entity522 and @entity2523 in this area. More subjectively, most observers are convinced that there has been substantial progress. Progress is dominated by a single group.

Comparison of performance in successive XXXX experiments.

@entity522 :: ('836', 'Gene') :: ['CASP3'] @entity8085 :: ('1523', 'Gene') :: ['CASP'] @entity69627 :: ('834;835;836', 'Gene') :: ['CASPs 1, 2, and 3'] @entity15097 :: ('835', 'Gene') :: ['CASP2'] @entity9302 :: ('834', 'Gene') :: ['CASP1'] @entity2523 :: ('837', 'Gene') :: ['CASP4']
@entity8085 :: (1523,Gene) :: ['CASP']
