Evaluation and correction for a 'training effect' in the cognitive assessment of older adults

Mauro Di Bari, Marco Pahor, Marie Barnard, Naomi M Gades, Marshall Graney, Lonneke V. Franse, Brenda W J H Penninx, Niccolò Marchionni, William B. Applegate

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

Background: Repeated administration of psychometric instruments frequently results in a higher score on retesting, the so-called training effect. Yet, a training effect has been poorly considered in longitudinal studies of cognitive changes in older persons. Methods: We investigated the presence, magnitude and potential adjustments for training effect in the older participants of the Systolic Hypertension in the Elderly Program (SHEP). SHEP evaluated the cognitive status effects of a diuretic-based treatment of isolated systolic hypertension versus placebo. Changes in the short Comprehensive Assessment and Referral Evaluation (short-CARE) questionnaire score, from baseline through 4 years of follow-up, were assessed in 4,718 participants. In this study, we used two regression techniques to adjust data for the training effect. Results: In both study groups, a training effect was evident as a progressive improvement in the short-CARE score throughout year 1. Thereafter, cognitive scores tended to deteriorate, more in the placebo than in the active treatment group (p = 0.055). When follow-up scores were adjusted based upon baseline data, the difference between the study groups reached statistical significance (p = 0.019), but the apparent overall trend towards deterioration in cognitive score was no longer observed. Adjustment of baseline data preserved this apparent temporal course, but did not improve the discrimination between the two study groups (p = 0.165). Conclusions: In SHEP, repeated cognitive assessments were likely biased by a training effect which could be only partially corrected by statistical techniques. Studies of changes in the cognitive status of older persons should be designed appropriately to estimate and minimize the consequences of a training effect in follow-up data.

Original languageEnglish (US)
Pages (from-to)87-92
Number of pages6
JournalNeuroepidemiology
Volume21
Issue number2
DOIs
StatePublished - 2002
Externally publishedYes

Fingerprint

Hypertension
Referral and Consultation
Placebos
Diuretics
Psychometrics
Longitudinal Studies
Research Design
Therapeutics
Surveys and Questionnaires

Keywords

  • Cognitive assessment
  • Older adults
  • Regression methods
  • SHEP trial
  • Training effect

ASJC Scopus subject areas

  • Epidemiology
  • Clinical Neurology

Cite this

Di Bari, M., Pahor, M., Barnard, M., Gades, N. M., Graney, M., Franse, L. V., ... Applegate, W. B. (2002). Evaluation and correction for a 'training effect' in the cognitive assessment of older adults. Neuroepidemiology, 21(2), 87-92. https://doi.org/10.1159/000048622

Evaluation and correction for a 'training effect' in the cognitive assessment of older adults. / Di Bari, Mauro; Pahor, Marco; Barnard, Marie; Gades, Naomi M; Graney, Marshall; Franse, Lonneke V.; Penninx, Brenda W J H; Marchionni, Niccolò; Applegate, William B.

In: Neuroepidemiology, Vol. 21, No. 2, 2002, p. 87-92.

Research output: Contribution to journalArticle

Di Bari, M, Pahor, M, Barnard, M, Gades, NM, Graney, M, Franse, LV, Penninx, BWJH, Marchionni, N & Applegate, WB 2002, 'Evaluation and correction for a 'training effect' in the cognitive assessment of older adults', Neuroepidemiology, vol. 21, no. 2, pp. 87-92. https://doi.org/10.1159/000048622
Di Bari, Mauro ; Pahor, Marco ; Barnard, Marie ; Gades, Naomi M ; Graney, Marshall ; Franse, Lonneke V. ; Penninx, Brenda W J H ; Marchionni, Niccolò ; Applegate, William B. / Evaluation and correction for a 'training effect' in the cognitive assessment of older adults. In: Neuroepidemiology. 2002 ; Vol. 21, No. 2. pp. 87-92.
@article{93a0be67c6ad47ab9dc83d2bbb2b62d5,
title = "Evaluation and correction for a 'training effect' in the cognitive assessment of older adults",
abstract = "Background: Repeated administration of psychometric instruments frequently results in a higher score on retesting, the so-called training effect. Yet, a training effect has been poorly considered in longitudinal studies of cognitive changes in older persons. Methods: We investigated the presence, magnitude and potential adjustments for training effect in the older participants of the Systolic Hypertension in the Elderly Program (SHEP). SHEP evaluated the cognitive status effects of a diuretic-based treatment of isolated systolic hypertension versus placebo. Changes in the short Comprehensive Assessment and Referral Evaluation (short-CARE) questionnaire score, from baseline through 4 years of follow-up, were assessed in 4,718 participants. In this study, we used two regression techniques to adjust data for the training effect. Results: In both study groups, a training effect was evident as a progressive improvement in the short-CARE score throughout year 1. Thereafter, cognitive scores tended to deteriorate, more in the placebo than in the active treatment group (p = 0.055). When follow-up scores were adjusted based upon baseline data, the difference between the study groups reached statistical significance (p = 0.019), but the apparent overall trend towards deterioration in cognitive score was no longer observed. Adjustment of baseline data preserved this apparent temporal course, but did not improve the discrimination between the two study groups (p = 0.165). Conclusions: In SHEP, repeated cognitive assessments were likely biased by a training effect which could be only partially corrected by statistical techniques. Studies of changes in the cognitive status of older persons should be designed appropriately to estimate and minimize the consequences of a training effect in follow-up data.",
keywords = "Cognitive assessment, Older adults, Regression methods, SHEP trial, Training effect",
author = "{Di Bari}, Mauro and Marco Pahor and Marie Barnard and Gades, {Naomi M} and Marshall Graney and Franse, {Lonneke V.} and Penninx, {Brenda W J H} and Niccol{\`o} Marchionni and Applegate, {William B.}",
year = "2002",
doi = "10.1159/000048622",
language = "English (US)",
volume = "21",
pages = "87--92",
journal = "Neuroepidemiology",
issn = "0251-5350",
publisher = "S. Karger AG",
number = "2",

}

TY - JOUR

T1 - Evaluation and correction for a 'training effect' in the cognitive assessment of older adults

AU - Di Bari, Mauro

AU - Pahor, Marco

AU - Barnard, Marie

AU - Gades, Naomi M

AU - Graney, Marshall

AU - Franse, Lonneke V.

AU - Penninx, Brenda W J H

AU - Marchionni, Niccolò

AU - Applegate, William B.

PY - 2002

Y1 - 2002

N2 - Background: Repeated administration of psychometric instruments frequently results in a higher score on retesting, the so-called training effect. Yet, a training effect has been poorly considered in longitudinal studies of cognitive changes in older persons. Methods: We investigated the presence, magnitude and potential adjustments for training effect in the older participants of the Systolic Hypertension in the Elderly Program (SHEP). SHEP evaluated the cognitive status effects of a diuretic-based treatment of isolated systolic hypertension versus placebo. Changes in the short Comprehensive Assessment and Referral Evaluation (short-CARE) questionnaire score, from baseline through 4 years of follow-up, were assessed in 4,718 participants. In this study, we used two regression techniques to adjust data for the training effect. Results: In both study groups, a training effect was evident as a progressive improvement in the short-CARE score throughout year 1. Thereafter, cognitive scores tended to deteriorate, more in the placebo than in the active treatment group (p = 0.055). When follow-up scores were adjusted based upon baseline data, the difference between the study groups reached statistical significance (p = 0.019), but the apparent overall trend towards deterioration in cognitive score was no longer observed. Adjustment of baseline data preserved this apparent temporal course, but did not improve the discrimination between the two study groups (p = 0.165). Conclusions: In SHEP, repeated cognitive assessments were likely biased by a training effect which could be only partially corrected by statistical techniques. Studies of changes in the cognitive status of older persons should be designed appropriately to estimate and minimize the consequences of a training effect in follow-up data.

AB - Background: Repeated administration of psychometric instruments frequently results in a higher score on retesting, the so-called training effect. Yet, a training effect has been poorly considered in longitudinal studies of cognitive changes in older persons. Methods: We investigated the presence, magnitude and potential adjustments for training effect in the older participants of the Systolic Hypertension in the Elderly Program (SHEP). SHEP evaluated the cognitive status effects of a diuretic-based treatment of isolated systolic hypertension versus placebo. Changes in the short Comprehensive Assessment and Referral Evaluation (short-CARE) questionnaire score, from baseline through 4 years of follow-up, were assessed in 4,718 participants. In this study, we used two regression techniques to adjust data for the training effect. Results: In both study groups, a training effect was evident as a progressive improvement in the short-CARE score throughout year 1. Thereafter, cognitive scores tended to deteriorate, more in the placebo than in the active treatment group (p = 0.055). When follow-up scores were adjusted based upon baseline data, the difference between the study groups reached statistical significance (p = 0.019), but the apparent overall trend towards deterioration in cognitive score was no longer observed. Adjustment of baseline data preserved this apparent temporal course, but did not improve the discrimination between the two study groups (p = 0.165). Conclusions: In SHEP, repeated cognitive assessments were likely biased by a training effect which could be only partially corrected by statistical techniques. Studies of changes in the cognitive status of older persons should be designed appropriately to estimate and minimize the consequences of a training effect in follow-up data.

KW - Cognitive assessment

KW - Older adults

KW - Regression methods

KW - SHEP trial

KW - Training effect

UR - http://www.scopus.com/inward/record.url?scp=0036128248&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0036128248&partnerID=8YFLogxK

U2 - 10.1159/000048622

DO - 10.1159/000048622

M3 - Article

VL - 21

SP - 87

EP - 92

JO - Neuroepidemiology

JF - Neuroepidemiology

SN - 0251-5350

IS - 2

ER -