Measuring achievement goal motivation, mindsets and cognitive load

validation of three instruments’ scores

David Allan Cook, Richmond M. Castillo, Becca Gas, Anthony R. Artino

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

Objective: Measurement of motivation and cognitive load has potential value in health professions education. Our objective was to evaluate the validity of scores from Dweck's Implicit Theories of Intelligence Scale (ITIS), Elliot's Achievement Goal Questionnaire-Revised (AGQ-R) and Leppink's cognitive load index (CLI). Methods: This was a validity study evaluating internal structure using reliability and factor analysis, and relationships with other variables using the multitrait-multimethod matrix. Two hundred and thirty-two secondary school students participated in a medical simulation-based training activity at an academic medical center. Pre-activity ITIS (implicit theory [mindset] domains: incremental, entity) and AGQ-R (achievement goal domains: mastery-approach, mastery-avoidance, performance-approach, performance-avoidance), post-activity CLI (cognitive load domains: intrinsic, extrinsic, germane) and task persistence (self-directed repetitions on a laparoscopic surgery task) were measured. Results: Internal consistency reliability (Cronbach's alpha) was > 0.70 for all domain scores except AGQ-R performance-avoidance (alpha 0.68) and CLI extrinsic load (alpha 0.64). Confirmatory factor analysis of ITIS and CLI scores demonstrated acceptable model fit. Confirmatory factor analysis of AGQ-R scores demonstrated borderline fit, and exploratory factor analysis suggested a three-domain model for achievement goals (mastery-approach, performance and avoidance). Correlations among scores from conceptually-related domains generally aligned with expectations, as follows: ITIS incremental and entity, r = −0.52; AGQ-R mastery-avoidance and performance-avoidance, r = 0.71; mastery-approach and performance-approach, r = 0.55; performance-approach and performance-avoidance, r = 0.43; mastery-approach and mastery-avoidance, r = 0.36; CLI germane and extrinsic, r = −0.35; ITIS incremental and AGQ-R mastery-approach, r = 0.34; ITIS incremental and CLI germane, r = 0.44; AGQ-R mastery-approach and CLI germane, r = 0.48 (all p < 0.001). We found no correlation between the number of task repetitions (i.e. persistence) and mastery-approach scores, r = −0.01. Conclusions: ITIS and CLI scores had appropriate internal structures and relationships with other variables. AGQ-R scores fit a three-factor (not four-factor) model that collapsed avoidance into one domain, although relationships of other variables with the original four domain scores generally aligned with expectations. Mastery goals are positively correlated with germane cognitive load.

Original languageEnglish (US)
Pages (from-to)1061-1074
Number of pages14
JournalMedical Education
Volume51
Issue number10
DOIs
StatePublished - Oct 1 2017

Fingerprint

Motivation
Intelligence
intelligence
questionnaire
performance
factor analysis
Statistical Factor Analysis
persistence
Health Occupations
surgery
Surveys and Questionnaires
Health Education
Laparoscopy
secondary school
profession
Teaching
Students
simulation
health
education

ASJC Scopus subject areas

  • Medicine(all)
  • Education

Cite this

Measuring achievement goal motivation, mindsets and cognitive load : validation of three instruments’ scores. / Cook, David Allan; Castillo, Richmond M.; Gas, Becca; Artino, Anthony R.

In: Medical Education, Vol. 51, No. 10, 01.10.2017, p. 1061-1074.

Research output: Contribution to journalArticle

Cook, David Allan ; Castillo, Richmond M. ; Gas, Becca ; Artino, Anthony R. / Measuring achievement goal motivation, mindsets and cognitive load : validation of three instruments’ scores. In: Medical Education. 2017 ; Vol. 51, No. 10. pp. 1061-1074.
@article{0b850c57068b4cd79fc97bd059a1825c,
title = "Measuring achievement goal motivation, mindsets and cognitive load: validation of three instruments’ scores",
abstract = "Objective: Measurement of motivation and cognitive load has potential value in health professions education. Our objective was to evaluate the validity of scores from Dweck's Implicit Theories of Intelligence Scale (ITIS), Elliot's Achievement Goal Questionnaire-Revised (AGQ-R) and Leppink's cognitive load index (CLI). Methods: This was a validity study evaluating internal structure using reliability and factor analysis, and relationships with other variables using the multitrait-multimethod matrix. Two hundred and thirty-two secondary school students participated in a medical simulation-based training activity at an academic medical center. Pre-activity ITIS (implicit theory [mindset] domains: incremental, entity) and AGQ-R (achievement goal domains: mastery-approach, mastery-avoidance, performance-approach, performance-avoidance), post-activity CLI (cognitive load domains: intrinsic, extrinsic, germane) and task persistence (self-directed repetitions on a laparoscopic surgery task) were measured. Results: Internal consistency reliability (Cronbach's alpha) was > 0.70 for all domain scores except AGQ-R performance-avoidance (alpha 0.68) and CLI extrinsic load (alpha 0.64). Confirmatory factor analysis of ITIS and CLI scores demonstrated acceptable model fit. Confirmatory factor analysis of AGQ-R scores demonstrated borderline fit, and exploratory factor analysis suggested a three-domain model for achievement goals (mastery-approach, performance and avoidance). Correlations among scores from conceptually-related domains generally aligned with expectations, as follows: ITIS incremental and entity, r = −0.52; AGQ-R mastery-avoidance and performance-avoidance, r = 0.71; mastery-approach and performance-approach, r = 0.55; performance-approach and performance-avoidance, r = 0.43; mastery-approach and mastery-avoidance, r = 0.36; CLI germane and extrinsic, r = −0.35; ITIS incremental and AGQ-R mastery-approach, r = 0.34; ITIS incremental and CLI germane, r = 0.44; AGQ-R mastery-approach and CLI germane, r = 0.48 (all p < 0.001). We found no correlation between the number of task repetitions (i.e. persistence) and mastery-approach scores, r = −0.01. Conclusions: ITIS and CLI scores had appropriate internal structures and relationships with other variables. AGQ-R scores fit a three-factor (not four-factor) model that collapsed avoidance into one domain, although relationships of other variables with the original four domain scores generally aligned with expectations. Mastery goals are positively correlated with germane cognitive load.",
author = "Cook, {David Allan} and Castillo, {Richmond M.} and Becca Gas and Artino, {Anthony R.}",
year = "2017",
month = "10",
day = "1",
doi = "10.1111/medu.13405",
language = "English (US)",
volume = "51",
pages = "1061--1074",
journal = "Medical Education",
issn = "0308-0110",
publisher = "Wiley-Blackwell",
number = "10",

}

TY - JOUR

T1 - Measuring achievement goal motivation, mindsets and cognitive load

T2 - validation of three instruments’ scores

AU - Cook, David Allan

AU - Castillo, Richmond M.

AU - Gas, Becca

AU - Artino, Anthony R.

PY - 2017/10/1

Y1 - 2017/10/1

N2 - Objective: Measurement of motivation and cognitive load has potential value in health professions education. Our objective was to evaluate the validity of scores from Dweck's Implicit Theories of Intelligence Scale (ITIS), Elliot's Achievement Goal Questionnaire-Revised (AGQ-R) and Leppink's cognitive load index (CLI). Methods: This was a validity study evaluating internal structure using reliability and factor analysis, and relationships with other variables using the multitrait-multimethod matrix. Two hundred and thirty-two secondary school students participated in a medical simulation-based training activity at an academic medical center. Pre-activity ITIS (implicit theory [mindset] domains: incremental, entity) and AGQ-R (achievement goal domains: mastery-approach, mastery-avoidance, performance-approach, performance-avoidance), post-activity CLI (cognitive load domains: intrinsic, extrinsic, germane) and task persistence (self-directed repetitions on a laparoscopic surgery task) were measured. Results: Internal consistency reliability (Cronbach's alpha) was > 0.70 for all domain scores except AGQ-R performance-avoidance (alpha 0.68) and CLI extrinsic load (alpha 0.64). Confirmatory factor analysis of ITIS and CLI scores demonstrated acceptable model fit. Confirmatory factor analysis of AGQ-R scores demonstrated borderline fit, and exploratory factor analysis suggested a three-domain model for achievement goals (mastery-approach, performance and avoidance). Correlations among scores from conceptually-related domains generally aligned with expectations, as follows: ITIS incremental and entity, r = −0.52; AGQ-R mastery-avoidance and performance-avoidance, r = 0.71; mastery-approach and performance-approach, r = 0.55; performance-approach and performance-avoidance, r = 0.43; mastery-approach and mastery-avoidance, r = 0.36; CLI germane and extrinsic, r = −0.35; ITIS incremental and AGQ-R mastery-approach, r = 0.34; ITIS incremental and CLI germane, r = 0.44; AGQ-R mastery-approach and CLI germane, r = 0.48 (all p < 0.001). We found no correlation between the number of task repetitions (i.e. persistence) and mastery-approach scores, r = −0.01. Conclusions: ITIS and CLI scores had appropriate internal structures and relationships with other variables. AGQ-R scores fit a three-factor (not four-factor) model that collapsed avoidance into one domain, although relationships of other variables with the original four domain scores generally aligned with expectations. Mastery goals are positively correlated with germane cognitive load.

AB - Objective: Measurement of motivation and cognitive load has potential value in health professions education. Our objective was to evaluate the validity of scores from Dweck's Implicit Theories of Intelligence Scale (ITIS), Elliot's Achievement Goal Questionnaire-Revised (AGQ-R) and Leppink's cognitive load index (CLI). Methods: This was a validity study evaluating internal structure using reliability and factor analysis, and relationships with other variables using the multitrait-multimethod matrix. Two hundred and thirty-two secondary school students participated in a medical simulation-based training activity at an academic medical center. Pre-activity ITIS (implicit theory [mindset] domains: incremental, entity) and AGQ-R (achievement goal domains: mastery-approach, mastery-avoidance, performance-approach, performance-avoidance), post-activity CLI (cognitive load domains: intrinsic, extrinsic, germane) and task persistence (self-directed repetitions on a laparoscopic surgery task) were measured. Results: Internal consistency reliability (Cronbach's alpha) was > 0.70 for all domain scores except AGQ-R performance-avoidance (alpha 0.68) and CLI extrinsic load (alpha 0.64). Confirmatory factor analysis of ITIS and CLI scores demonstrated acceptable model fit. Confirmatory factor analysis of AGQ-R scores demonstrated borderline fit, and exploratory factor analysis suggested a three-domain model for achievement goals (mastery-approach, performance and avoidance). Correlations among scores from conceptually-related domains generally aligned with expectations, as follows: ITIS incremental and entity, r = −0.52; AGQ-R mastery-avoidance and performance-avoidance, r = 0.71; mastery-approach and performance-approach, r = 0.55; performance-approach and performance-avoidance, r = 0.43; mastery-approach and mastery-avoidance, r = 0.36; CLI germane and extrinsic, r = −0.35; ITIS incremental and AGQ-R mastery-approach, r = 0.34; ITIS incremental and CLI germane, r = 0.44; AGQ-R mastery-approach and CLI germane, r = 0.48 (all p < 0.001). We found no correlation between the number of task repetitions (i.e. persistence) and mastery-approach scores, r = −0.01. Conclusions: ITIS and CLI scores had appropriate internal structures and relationships with other variables. AGQ-R scores fit a three-factor (not four-factor) model that collapsed avoidance into one domain, although relationships of other variables with the original four domain scores generally aligned with expectations. Mastery goals are positively correlated with germane cognitive load.

UR - http://www.scopus.com/inward/record.url?scp=85029215733&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85029215733&partnerID=8YFLogxK

U2 - 10.1111/medu.13405

DO - 10.1111/medu.13405

M3 - Article

VL - 51

SP - 1061

EP - 1074

JO - Medical Education

JF - Medical Education

SN - 0308-0110

IS - 10

ER -