The mayo high performance teamwork scale: Reliability and validity for evaluating key crew resource management skills

James F. Malec, Laurence C. Torsher, William F. Dunn, Douglas A. Wiegmann, Jacqueline J. Arnold, Dwight A. Brown, Vaishali Phatak

Research output: Contribution to journalArticle

141 Citations (Scopus)

Abstract

PURPOSE: To develop and evaluate a participant rating scale for assessing high performance teamwork skills in simulation medicine settings. METHODS: In all, 107 participants in crisis resource management (CRM) training in a multidisciplinary medical simulation center generated 273 ratings of key CRM skills after participating in two or three simulation exercises. These data were analyzed using Rasch and traditional psychometric approaches to develop the 16-item Mayo High Performance Teamwork Scale (MHPTS). Sensitivity to change as a result CRM training was also evaluated. RESULTS: The MHPTS showed satisfactory internal consistency and construct validity by Rasch (person reliability = 0.77; person separation = 1.85; item reliability = 0.96; item separation = 5.04) and traditional psychometric (Cronbach's alpha = 0.85) indicators. The scale demonstrated sensitivity to change as a result of CRM training (pretraining mean = 21.44 versus first posttraining rating mean = 24.37; paired t = -4.15, P < 0.0001; first posttraining mean = 24.63 versus second posttraining mean = 26.83; paired t = -4.31 P < 0.0001). CONCLUSIONS: The MHPTS provides a brief, reliable, practical measure of CRM skills that can be used by participants in CRM training to reflect on and evaluate their performance as a team. Further evaluation of validity and appropriateness in other simulation and medical settings is desirable.

Original languageEnglish (US)
Pages (from-to)4-10
Number of pages7
JournalSimulation in Healthcare
Volume2
Issue number1
DOIs
StatePublished - Mar 2007

Fingerprint

Team Work
teamwork
Resource Management
Psychometrics
Reproducibility of Results
High Performance
management
resources
performance
simulation
Medicine
psychometrics
Person
Simulation
rating
Construct Validity
Personnel rating
Internal Consistency
human being
Evaluate

ASJC Scopus subject areas

  • Medicine (miscellaneous)
  • Epidemiology
  • Education
  • Modeling and Simulation

Cite this

Malec, J. F., Torsher, L. C., Dunn, W. F., Wiegmann, D. A., Arnold, J. J., Brown, D. A., & Phatak, V. (2007). The mayo high performance teamwork scale: Reliability and validity for evaluating key crew resource management skills. Simulation in Healthcare, 2(1), 4-10. https://doi.org/10.1097/SIH.0b013e31802b68ee

The mayo high performance teamwork scale : Reliability and validity for evaluating key crew resource management skills. / Malec, James F.; Torsher, Laurence C.; Dunn, William F.; Wiegmann, Douglas A.; Arnold, Jacqueline J.; Brown, Dwight A.; Phatak, Vaishali.

In: Simulation in Healthcare, Vol. 2, No. 1, 03.2007, p. 4-10.

Research output: Contribution to journalArticle

Malec, James F. ; Torsher, Laurence C. ; Dunn, William F. ; Wiegmann, Douglas A. ; Arnold, Jacqueline J. ; Brown, Dwight A. ; Phatak, Vaishali. / The mayo high performance teamwork scale : Reliability and validity for evaluating key crew resource management skills. In: Simulation in Healthcare. 2007 ; Vol. 2, No. 1. pp. 4-10.
@article{44e7ab2a53e448c4a3c9420ff3d0f9b2,
title = "The mayo high performance teamwork scale: Reliability and validity for evaluating key crew resource management skills",
abstract = "PURPOSE: To develop and evaluate a participant rating scale for assessing high performance teamwork skills in simulation medicine settings. METHODS: In all, 107 participants in crisis resource management (CRM) training in a multidisciplinary medical simulation center generated 273 ratings of key CRM skills after participating in two or three simulation exercises. These data were analyzed using Rasch and traditional psychometric approaches to develop the 16-item Mayo High Performance Teamwork Scale (MHPTS). Sensitivity to change as a result CRM training was also evaluated. RESULTS: The MHPTS showed satisfactory internal consistency and construct validity by Rasch (person reliability = 0.77; person separation = 1.85; item reliability = 0.96; item separation = 5.04) and traditional psychometric (Cronbach's alpha = 0.85) indicators. The scale demonstrated sensitivity to change as a result of CRM training (pretraining mean = 21.44 versus first posttraining rating mean = 24.37; paired t = -4.15, P < 0.0001; first posttraining mean = 24.63 versus second posttraining mean = 26.83; paired t = -4.31 P < 0.0001). CONCLUSIONS: The MHPTS provides a brief, reliable, practical measure of CRM skills that can be used by participants in CRM training to reflect on and evaluate their performance as a team. Further evaluation of validity and appropriateness in other simulation and medical settings is desirable.",
author = "Malec, {James F.} and Torsher, {Laurence C.} and Dunn, {William F.} and Wiegmann, {Douglas A.} and Arnold, {Jacqueline J.} and Brown, {Dwight A.} and Vaishali Phatak",
year = "2007",
month = "3",
doi = "10.1097/SIH.0b013e31802b68ee",
language = "English (US)",
volume = "2",
pages = "4--10",
journal = "Simulation in Healthcare",
issn = "1559-2332",
publisher = "Lippincott Williams and Wilkins",
number = "1",

}

TY - JOUR

T1 - The mayo high performance teamwork scale

T2 - Reliability and validity for evaluating key crew resource management skills

AU - Malec, James F.

AU - Torsher, Laurence C.

AU - Dunn, William F.

AU - Wiegmann, Douglas A.

AU - Arnold, Jacqueline J.

AU - Brown, Dwight A.

AU - Phatak, Vaishali

PY - 2007/3

Y1 - 2007/3

N2 - PURPOSE: To develop and evaluate a participant rating scale for assessing high performance teamwork skills in simulation medicine settings. METHODS: In all, 107 participants in crisis resource management (CRM) training in a multidisciplinary medical simulation center generated 273 ratings of key CRM skills after participating in two or three simulation exercises. These data were analyzed using Rasch and traditional psychometric approaches to develop the 16-item Mayo High Performance Teamwork Scale (MHPTS). Sensitivity to change as a result CRM training was also evaluated. RESULTS: The MHPTS showed satisfactory internal consistency and construct validity by Rasch (person reliability = 0.77; person separation = 1.85; item reliability = 0.96; item separation = 5.04) and traditional psychometric (Cronbach's alpha = 0.85) indicators. The scale demonstrated sensitivity to change as a result of CRM training (pretraining mean = 21.44 versus first posttraining rating mean = 24.37; paired t = -4.15, P < 0.0001; first posttraining mean = 24.63 versus second posttraining mean = 26.83; paired t = -4.31 P < 0.0001). CONCLUSIONS: The MHPTS provides a brief, reliable, practical measure of CRM skills that can be used by participants in CRM training to reflect on and evaluate their performance as a team. Further evaluation of validity and appropriateness in other simulation and medical settings is desirable.

AB - PURPOSE: To develop and evaluate a participant rating scale for assessing high performance teamwork skills in simulation medicine settings. METHODS: In all, 107 participants in crisis resource management (CRM) training in a multidisciplinary medical simulation center generated 273 ratings of key CRM skills after participating in two or three simulation exercises. These data were analyzed using Rasch and traditional psychometric approaches to develop the 16-item Mayo High Performance Teamwork Scale (MHPTS). Sensitivity to change as a result CRM training was also evaluated. RESULTS: The MHPTS showed satisfactory internal consistency and construct validity by Rasch (person reliability = 0.77; person separation = 1.85; item reliability = 0.96; item separation = 5.04) and traditional psychometric (Cronbach's alpha = 0.85) indicators. The scale demonstrated sensitivity to change as a result of CRM training (pretraining mean = 21.44 versus first posttraining rating mean = 24.37; paired t = -4.15, P < 0.0001; first posttraining mean = 24.63 versus second posttraining mean = 26.83; paired t = -4.31 P < 0.0001). CONCLUSIONS: The MHPTS provides a brief, reliable, practical measure of CRM skills that can be used by participants in CRM training to reflect on and evaluate their performance as a team. Further evaluation of validity and appropriateness in other simulation and medical settings is desirable.

UR - http://www.scopus.com/inward/record.url?scp=34547532808&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=34547532808&partnerID=8YFLogxK

U2 - 10.1097/SIH.0b013e31802b68ee

DO - 10.1097/SIH.0b013e31802b68ee

M3 - Article

C2 - 19088602

AN - SCOPUS:34547532808

VL - 2

SP - 4

EP - 10

JO - Simulation in Healthcare

JF - Simulation in Healthcare

SN - 1559-2332

IS - 1

ER -