TY - JOUR
T1 - The mayo high performance teamwork scale
T2 - Reliability and validity for evaluating key crew resource management skills
AU - Malec, James F.
AU - Torsher, Laurence C.
AU - Dunn, William F.
AU - Wiegmann, Douglas A.
AU - Arnold, Jacqueline J.
AU - Brown, Dwight A.
AU - Phatak, Vaishali
PY - 2007/3
Y1 - 2007/3
N2 - PURPOSE: To develop and evaluate a participant rating scale for assessing high performance teamwork skills in simulation medicine settings. METHODS: In all, 107 participants in crisis resource management (CRM) training in a multidisciplinary medical simulation center generated 273 ratings of key CRM skills after participating in two or three simulation exercises. These data were analyzed using Rasch and traditional psychometric approaches to develop the 16-item Mayo High Performance Teamwork Scale (MHPTS). Sensitivity to change as a result CRM training was also evaluated. RESULTS: The MHPTS showed satisfactory internal consistency and construct validity by Rasch (person reliability = 0.77; person separation = 1.85; item reliability = 0.96; item separation = 5.04) and traditional psychometric (Cronbach's alpha = 0.85) indicators. The scale demonstrated sensitivity to change as a result of CRM training (pretraining mean = 21.44 versus first posttraining rating mean = 24.37; paired t = -4.15, P < 0.0001; first posttraining mean = 24.63 versus second posttraining mean = 26.83; paired t = -4.31 P < 0.0001). CONCLUSIONS: The MHPTS provides a brief, reliable, practical measure of CRM skills that can be used by participants in CRM training to reflect on and evaluate their performance as a team. Further evaluation of validity and appropriateness in other simulation and medical settings is desirable.
AB - PURPOSE: To develop and evaluate a participant rating scale for assessing high performance teamwork skills in simulation medicine settings. METHODS: In all, 107 participants in crisis resource management (CRM) training in a multidisciplinary medical simulation center generated 273 ratings of key CRM skills after participating in two or three simulation exercises. These data were analyzed using Rasch and traditional psychometric approaches to develop the 16-item Mayo High Performance Teamwork Scale (MHPTS). Sensitivity to change as a result CRM training was also evaluated. RESULTS: The MHPTS showed satisfactory internal consistency and construct validity by Rasch (person reliability = 0.77; person separation = 1.85; item reliability = 0.96; item separation = 5.04) and traditional psychometric (Cronbach's alpha = 0.85) indicators. The scale demonstrated sensitivity to change as a result of CRM training (pretraining mean = 21.44 versus first posttraining rating mean = 24.37; paired t = -4.15, P < 0.0001; first posttraining mean = 24.63 versus second posttraining mean = 26.83; paired t = -4.31 P < 0.0001). CONCLUSIONS: The MHPTS provides a brief, reliable, practical measure of CRM skills that can be used by participants in CRM training to reflect on and evaluate their performance as a team. Further evaluation of validity and appropriateness in other simulation and medical settings is desirable.
UR - http://www.scopus.com/inward/record.url?scp=34547532808&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=34547532808&partnerID=8YFLogxK
U2 - 10.1097/SIH.0b013e31802b68ee
DO - 10.1097/SIH.0b013e31802b68ee
M3 - Article
C2 - 19088602
AN - SCOPUS:34547532808
SN - 1559-2332
VL - 2
SP - 4
EP - 10
JO - Simulation in Healthcare
JF - Simulation in Healthcare
IS - 1
ER -