Robust cognitive change

J Int Neuropsychol Soc. 2012 Jul;18(4):749-56. doi: 10.1017/S1355617712000380. Epub 2012 May 18.

Abstract

Two major challenges facing researchers interested in cognitive change are that measures of change are often not very reliable, and they may reflect effects of prior test experience in addition to the factors of primary interest. One approach to dealing with these problems is to obtain multiple measures of change on parallel versions of the same tests in a measurement burst design. A total of 783 adults performed three parallel versions of cognitive tests on two occasions separated by an average of 2.6 years. Performance increased substantially across the three sessions within each occasion, and for all but vocabulary ability these within-occasion improvements were considerably larger than the between-occasion changes. Reliabilities of the changes in composite scores were low, but averages of the three changes had larger, albeit still quite modest, reliabilities. In some cognitive abilities individual differences were evident in the relation of prior test experience and the magnitude of longitudinal change. Although multiple assessments are more time consuming than traditional measurement procedures, the resulting estimates of change are more robust than those from conventional methods, and also allow the influence of practice on change to be systematically investigated.

Publication types

  • Research Support, N.I.H., Extramural

MeSH terms

  • Adolescent
  • Adult
  • Aged
  • Aged, 80 and over
  • Aging / psychology
  • Cognition / physiology*
  • Cognition Disorders / psychology*
  • Cognition Disorders / therapy*
  • Data Interpretation, Statistical
  • Educational Status
  • Female
  • Humans
  • Individuality
  • Longitudinal Studies
  • Male
  • Middle Aged
  • Neuropsychological Tests / standards*
  • Reproducibility of Results
  • Vocabulary
  • Young Adult