Composite scores for executive function items: Demographic heterogeneity and relationships with quantitative magnetic resonance imaging

Paul K. Crane, Kaavya Narasimhalu, Laura E. Gibbons, Otto D Pedraza, Kala M. Mehta, Yuxiao Tang, Jennifer J. Manly, Bruce R. Reed, Dan M. Mungas

Research output: Contribution to journalArticle

33 Citations (Scopus)

Abstract

Accurate neuropsychological assessment of older individuals from heterogeneous backgrounds is a major challenge. Education, ethnicity, language, and age are associated with scale level differences in test scores, but item level bias might contribute to these differences. We evaluated several strategies for dealing with item and scale level demographic influences on a measure of executive abilities defined by working memory and fluency tasks. We determined the impact of differential item functioning (DIF). We compared composite scoring strategies on the basis of their relationships with volumetric magnetic resonance imaging (MRI) measures of brain structure. Participants were 791 Hispanic, white, and African American older adults. DIF had a salient impact on test scores for 9% of the sample. MRI data were available on a subset of 153 participants. Validity in comparison with structural MRI was higher after scale level adjustment for education, ethnicity/language, and gender, but item level adjustment did not have a major impact on validity. Age adjustment at the scale level had a negative impact on relationships with MRI, most likely because age adjustment removes variance related to age-associated diseases.

Original languageEnglish (US)
Pages (from-to)746-759
Number of pages14
JournalJournal of the International Neuropsychological Society
Volume14
Issue number5
DOIs
StatePublished - 2008

Fingerprint

Executive Function
Social Adjustment
Magnetic Resonance Imaging
Demography
Language
Education
Aptitude
Short-Term Memory
Hispanic Americans
African Americans
Brain

Keywords

  • Composite scores
  • Dementia
  • Demographic-adjusted T scores
  • Item response theory
  • Ordinal logistic regression
  • Test bias

ASJC Scopus subject areas

  • Clinical Neurology
  • Neurology
  • Psychiatry and Mental health
  • Neuroscience(all)
  • Psychology(all)

Cite this

Composite scores for executive function items : Demographic heterogeneity and relationships with quantitative magnetic resonance imaging. / Crane, Paul K.; Narasimhalu, Kaavya; Gibbons, Laura E.; Pedraza, Otto D; Mehta, Kala M.; Tang, Yuxiao; Manly, Jennifer J.; Reed, Bruce R.; Mungas, Dan M.

In: Journal of the International Neuropsychological Society, Vol. 14, No. 5, 2008, p. 746-759.

Research output: Contribution to journalArticle

Crane, Paul K. ; Narasimhalu, Kaavya ; Gibbons, Laura E. ; Pedraza, Otto D ; Mehta, Kala M. ; Tang, Yuxiao ; Manly, Jennifer J. ; Reed, Bruce R. ; Mungas, Dan M. / Composite scores for executive function items : Demographic heterogeneity and relationships with quantitative magnetic resonance imaging. In: Journal of the International Neuropsychological Society. 2008 ; Vol. 14, No. 5. pp. 746-759.
@article{9d8fa32bc7284192882a449acec84480,
title = "Composite scores for executive function items: Demographic heterogeneity and relationships with quantitative magnetic resonance imaging",
abstract = "Accurate neuropsychological assessment of older individuals from heterogeneous backgrounds is a major challenge. Education, ethnicity, language, and age are associated with scale level differences in test scores, but item level bias might contribute to these differences. We evaluated several strategies for dealing with item and scale level demographic influences on a measure of executive abilities defined by working memory and fluency tasks. We determined the impact of differential item functioning (DIF). We compared composite scoring strategies on the basis of their relationships with volumetric magnetic resonance imaging (MRI) measures of brain structure. Participants were 791 Hispanic, white, and African American older adults. DIF had a salient impact on test scores for 9{\%} of the sample. MRI data were available on a subset of 153 participants. Validity in comparison with structural MRI was higher after scale level adjustment for education, ethnicity/language, and gender, but item level adjustment did not have a major impact on validity. Age adjustment at the scale level had a negative impact on relationships with MRI, most likely because age adjustment removes variance related to age-associated diseases.",
keywords = "Composite scores, Dementia, Demographic-adjusted T scores, Item response theory, Ordinal logistic regression, Test bias",
author = "Crane, {Paul K.} and Kaavya Narasimhalu and Gibbons, {Laura E.} and Pedraza, {Otto D} and Mehta, {Kala M.} and Yuxiao Tang and Manly, {Jennifer J.} and Reed, {Bruce R.} and Mungas, {Dan M.}",
year = "2008",
doi = "10.1017/S1355617708081162",
language = "English (US)",
volume = "14",
pages = "746--759",
journal = "Journal of the International Neuropsychological Society",
issn = "1355-6177",
publisher = "Cambridge University Press",
number = "5",

}

TY - JOUR

T1 - Composite scores for executive function items

T2 - Demographic heterogeneity and relationships with quantitative magnetic resonance imaging

AU - Crane, Paul K.

AU - Narasimhalu, Kaavya

AU - Gibbons, Laura E.

AU - Pedraza, Otto D

AU - Mehta, Kala M.

AU - Tang, Yuxiao

AU - Manly, Jennifer J.

AU - Reed, Bruce R.

AU - Mungas, Dan M.

PY - 2008

Y1 - 2008

N2 - Accurate neuropsychological assessment of older individuals from heterogeneous backgrounds is a major challenge. Education, ethnicity, language, and age are associated with scale level differences in test scores, but item level bias might contribute to these differences. We evaluated several strategies for dealing with item and scale level demographic influences on a measure of executive abilities defined by working memory and fluency tasks. We determined the impact of differential item functioning (DIF). We compared composite scoring strategies on the basis of their relationships with volumetric magnetic resonance imaging (MRI) measures of brain structure. Participants were 791 Hispanic, white, and African American older adults. DIF had a salient impact on test scores for 9% of the sample. MRI data were available on a subset of 153 participants. Validity in comparison with structural MRI was higher after scale level adjustment for education, ethnicity/language, and gender, but item level adjustment did not have a major impact on validity. Age adjustment at the scale level had a negative impact on relationships with MRI, most likely because age adjustment removes variance related to age-associated diseases.

AB - Accurate neuropsychological assessment of older individuals from heterogeneous backgrounds is a major challenge. Education, ethnicity, language, and age are associated with scale level differences in test scores, but item level bias might contribute to these differences. We evaluated several strategies for dealing with item and scale level demographic influences on a measure of executive abilities defined by working memory and fluency tasks. We determined the impact of differential item functioning (DIF). We compared composite scoring strategies on the basis of their relationships with volumetric magnetic resonance imaging (MRI) measures of brain structure. Participants were 791 Hispanic, white, and African American older adults. DIF had a salient impact on test scores for 9% of the sample. MRI data were available on a subset of 153 participants. Validity in comparison with structural MRI was higher after scale level adjustment for education, ethnicity/language, and gender, but item level adjustment did not have a major impact on validity. Age adjustment at the scale level had a negative impact on relationships with MRI, most likely because age adjustment removes variance related to age-associated diseases.

KW - Composite scores

KW - Dementia

KW - Demographic-adjusted T scores

KW - Item response theory

KW - Ordinal logistic regression

KW - Test bias

UR - http://www.scopus.com/inward/record.url?scp=51349160248&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=51349160248&partnerID=8YFLogxK

U2 - 10.1017/S1355617708081162

DO - 10.1017/S1355617708081162

M3 - Article

C2 - 18764970

AN - SCOPUS:51349160248

VL - 14

SP - 746

EP - 759

JO - Journal of the International Neuropsychological Society

JF - Journal of the International Neuropsychological Society

SN - 1355-6177

IS - 5

ER -