3 Quick-Reference Criteria for Identifying Clinically Significant Multivariate Change in Older Adult Cognition: A NACC Study
Authors: Wisinger Amanda M. , Abel Hillary F. , Grant Jeremy G. , Smith Glenn E. 
Published: December 2023

Objective:

Accurately interpreting cognitive change is an essential aspect of clinical care for older adults. Several approaches to identifying 'true’ cognitive change in a single cognitive measure are available (e.g., reliable change methods, regression-based norms); however, neuropsychologists in clinical settings often rely on simple score differences rather than advanced statistics, especially since multiple scores compose a typical battery. This study sought to establish quick-reference normative criteria to help neuropsychologists identify how frequently significant change occurs across multiple measures in cognitively normal older adults.

Participants and Methods:

Data were obtained from the National Alzheimer’s Coordinating Center (NACC). Participants were 845 older adults who were classified as cognitively normal at baseline and at 24-month follow-up. In NACC, these clinical classifications are made separately from the assessment of cognitive performance, including cognitive change. The sample was 34.9% female, 83.5% White, 13.1% Black 2.3% Asian, and 1.1% other race with a mean age of 70.7 years (SD=10.2). Of the sample, 95.5% identified as non-Hispanic. Mean education was 16.1 years (SD=2.8). The cognitive battery entailed: Craft Story Immediate and Delayed Recall, Benson Copy and Delayed Recall, Number Span (Forward & Backward), Category Fluency (Animals & Vegetables), Trails A&B, Multilingual Naming Test, and Verbal Fluency (F&L). Change scores between baseline performance and follow-up were calculated for each measure. The natural distribution of change scores was examined for each measure and cut points representing the 5th and 10th percentile were applied to each distribution to classify participants who exhibited substantial declines in performance on each measure. We then examined the multivariate frequency of statistically rare change scores for each individual.

Results:

As expected in a normal sample, overall cognitive performance was generally stable between baseline and 24-month follow-up. Across cognitive measures, 81.9% of participants had at least one change score fall below the 10th percentile in the distribution of change scores, and 55.7% had at least one score below the 5th percentile, 49.3% of participants had two or more change scores that fell below the 10th percentile and 21.1% with two or more below the 5th percentile. There were 26.7% participants that had three or more change scores below the 10th percentile, and 6.4% of participants had three change scores below the 5th percentile.

Conclusions:

Among cognitively normal older adults assessed twice at a 24-month interval with a battery of 13 measures, it was not uncommon for an individual to have at least one score fall below the 10th percentile (82% of the sample) or even the 5th percentile (56%) in the natural distribution of change scores. There were 27% participants that had three or more declines in test performance below the 10th percentile; in comparison, only 6% of the sample had three or more change scores at the 5th percentile. This suggests that individuals who exhibit more multivariate changes in performance than these standards are likely experiencing an abnormal rate of cognitive decline. Our findings provide a preliminary quick-reference approach to identifying clinically significant cognitive change. Future studies will explore additional batteries and examine multivariate frequencies of change in clinical populations.