Scores from Riding's cognitive styles analysis have poor test-retest reliability

Research output: Contribution to journalArticle

4 Citations (Scopus)

Abstract

Background: The Cognitive Styles Analysis (CSA) purports to assess two cognitive style dimensions, wholist-analytic (WA) and verbalizer-imager (VI). CSA score reliability has not been studied in medical education. Purpose: The objective of this study was to evaluate test-retest reliability and learner-perceived accuracy of CSA scores. Method: CSA scores were measured twice and perceived accuracy of classifications once among 89 family medicine residents, internal medicine residents, and medical students. Results: Mean ± standard deviation interval between tests was 564 ± 136 days. Test-retest correlation for WA scores was 0.30, and for VI scores was 0.12. Upon retesting 44 learners (49%) were classified under a different WA style, and 56 learners (63%) were classified under a different VI style. There were 58 of 73 learners (79%) who agreed or strongly agreed with their WA classification, whereas 51 of 76 (67%) agreed with their VI classification. Conclusions: CSA scores have poor test-retest reliability. Educators may wish to avoid using the CSA and should exercise caution when interpreting CSA scores.

Original languageEnglish (US)
Pages (from-to)225-229
Number of pages5
JournalTeaching and Learning in Medicine
Volume20
Issue number3
DOIs
StatePublished - Jul 2008

Fingerprint

Reproducibility of Results
Internal Medicine
Medical Education
Medical Students
Medicine
Exercise
medicine
resident
medical student
educator
education

ASJC Scopus subject areas

  • Nursing(all)
  • Education

Cite this

Scores from Riding's cognitive styles analysis have poor test-retest reliability. / Cook, David Allan.

In: Teaching and Learning in Medicine, Vol. 20, No. 3, 07.2008, p. 225-229.

Research output: Contribution to journalArticle

@article{8042bef4444f48d58f627c07a46dcf7c,
title = "Scores from Riding's cognitive styles analysis have poor test-retest reliability",
abstract = "Background: The Cognitive Styles Analysis (CSA) purports to assess two cognitive style dimensions, wholist-analytic (WA) and verbalizer-imager (VI). CSA score reliability has not been studied in medical education. Purpose: The objective of this study was to evaluate test-retest reliability and learner-perceived accuracy of CSA scores. Method: CSA scores were measured twice and perceived accuracy of classifications once among 89 family medicine residents, internal medicine residents, and medical students. Results: Mean ± standard deviation interval between tests was 564 ± 136 days. Test-retest correlation for WA scores was 0.30, and for VI scores was 0.12. Upon retesting 44 learners (49{\%}) were classified under a different WA style, and 56 learners (63{\%}) were classified under a different VI style. There were 58 of 73 learners (79{\%}) who agreed or strongly agreed with their WA classification, whereas 51 of 76 (67{\%}) agreed with their VI classification. Conclusions: CSA scores have poor test-retest reliability. Educators may wish to avoid using the CSA and should exercise caution when interpreting CSA scores.",
author = "Cook, {David Allan}",
year = "2008",
month = "7",
doi = "10.1080/10401330802199492",
language = "English (US)",
volume = "20",
pages = "225--229",
journal = "Teaching and Learning in Medicine",
issn = "1040-1334",
publisher = "Routledge",
number = "3",

}

TY - JOUR

T1 - Scores from Riding's cognitive styles analysis have poor test-retest reliability

AU - Cook, David Allan

PY - 2008/7

Y1 - 2008/7

N2 - Background: The Cognitive Styles Analysis (CSA) purports to assess two cognitive style dimensions, wholist-analytic (WA) and verbalizer-imager (VI). CSA score reliability has not been studied in medical education. Purpose: The objective of this study was to evaluate test-retest reliability and learner-perceived accuracy of CSA scores. Method: CSA scores were measured twice and perceived accuracy of classifications once among 89 family medicine residents, internal medicine residents, and medical students. Results: Mean ± standard deviation interval between tests was 564 ± 136 days. Test-retest correlation for WA scores was 0.30, and for VI scores was 0.12. Upon retesting 44 learners (49%) were classified under a different WA style, and 56 learners (63%) were classified under a different VI style. There were 58 of 73 learners (79%) who agreed or strongly agreed with their WA classification, whereas 51 of 76 (67%) agreed with their VI classification. Conclusions: CSA scores have poor test-retest reliability. Educators may wish to avoid using the CSA and should exercise caution when interpreting CSA scores.

AB - Background: The Cognitive Styles Analysis (CSA) purports to assess two cognitive style dimensions, wholist-analytic (WA) and verbalizer-imager (VI). CSA score reliability has not been studied in medical education. Purpose: The objective of this study was to evaluate test-retest reliability and learner-perceived accuracy of CSA scores. Method: CSA scores were measured twice and perceived accuracy of classifications once among 89 family medicine residents, internal medicine residents, and medical students. Results: Mean ± standard deviation interval between tests was 564 ± 136 days. Test-retest correlation for WA scores was 0.30, and for VI scores was 0.12. Upon retesting 44 learners (49%) were classified under a different WA style, and 56 learners (63%) were classified under a different VI style. There were 58 of 73 learners (79%) who agreed or strongly agreed with their WA classification, whereas 51 of 76 (67%) agreed with their VI classification. Conclusions: CSA scores have poor test-retest reliability. Educators may wish to avoid using the CSA and should exercise caution when interpreting CSA scores.

UR - http://www.scopus.com/inward/record.url?scp=47049104894&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=47049104894&partnerID=8YFLogxK

U2 - 10.1080/10401330802199492

DO - 10.1080/10401330802199492

M3 - Article

C2 - 18615296

AN - SCOPUS:47049104894

VL - 20

SP - 225

EP - 229

JO - Teaching and Learning in Medicine

JF - Teaching and Learning in Medicine

SN - 1040-1334

IS - 3

ER -