Proficiency in identifying, managing and communicating medical errors: Feasibility and validity study assessing two core competencies

Abd Moain Abu Dabrh, Mohammad H Murad, Richard D. Newcomb, William G. Buchta, Mark W. Steffen, Zhen Wang, Amanda K. Lovett, Lawrence W. Steinkraus

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Background: Communication skills and professionalism are two competencies in graduate medical education that are challenging to evaluate. We aimed to develop, test and validate a de novo instrument to evaluate these two competencies. Methods: Using an Objective Standardized Clinical Examination (OSCE) based on a medication error scenario, we developed an assessment instrument that focuses on distinctive domains [context of discussion, communication and detection of error, management of error, empathy, use of electronic medical record (EMR) and electronic medical information resources (EMIR), and global rating]. The aim was to test feasibility, acceptability, and reliability of the method. Results: Faculty and standardized patients (SPs) evaluated 56 trainees using the instrument. The inter-rater reliability of agreement between faculty was substantial (Fleiss k = 0.71) and intraclass correlation efficient was excellent (ICC = 0.80). The measured agreement between faculty and SPs evaluation of resident was lower (Fleiss k = 0.36). The instrument showed good conformity (ICC = 0.74). The majority of the trainees (75 %) had satisfactory or higher performance in all six assessed domains and 86 % found the OSCE to be realistic. Sixty percent reported not receiving feedback on EMR use and asked for subsequent training. Conclusion: An OSCE-based instrument using a medical error scenario can be used to assess competency in professionalism, communication, using EMRs and managing medical errors.

Original languageEnglish (US)
Article number233
JournalBMC Medical Education
Volume16
Issue number1
DOIs
StatePublished - Sep 2 2016

Fingerprint

Medical Errors
Feasibility Studies
Electronic Health Records
Communication
Medical Electronics
Graduate Medical Education
electronics
Medication Errors
trainee
examination
scenario
communication
conformity
communication skills
empathy
medication
rating
graduate
resident
evaluation

Keywords

  • ACGME
  • Communication skills
  • Core competencies
  • Medical errors
  • Medical training
  • Professionalism

ASJC Scopus subject areas

  • Medicine(all)
  • Education

Cite this

Proficiency in identifying, managing and communicating medical errors : Feasibility and validity study assessing two core competencies. / Abu Dabrh, Abd Moain; Murad, Mohammad H; Newcomb, Richard D.; Buchta, William G.; Steffen, Mark W.; Wang, Zhen; Lovett, Amanda K.; Steinkraus, Lawrence W.

In: BMC Medical Education, Vol. 16, No. 1, 233, 02.09.2016.

Research output: Contribution to journalArticle

Abu Dabrh, Abd Moain ; Murad, Mohammad H ; Newcomb, Richard D. ; Buchta, William G. ; Steffen, Mark W. ; Wang, Zhen ; Lovett, Amanda K. ; Steinkraus, Lawrence W. / Proficiency in identifying, managing and communicating medical errors : Feasibility and validity study assessing two core competencies. In: BMC Medical Education. 2016 ; Vol. 16, No. 1.
@article{ff22319663ee4cccb7940a34dd79bdd3,
title = "Proficiency in identifying, managing and communicating medical errors: Feasibility and validity study assessing two core competencies",
abstract = "Background: Communication skills and professionalism are two competencies in graduate medical education that are challenging to evaluate. We aimed to develop, test and validate a de novo instrument to evaluate these two competencies. Methods: Using an Objective Standardized Clinical Examination (OSCE) based on a medication error scenario, we developed an assessment instrument that focuses on distinctive domains [context of discussion, communication and detection of error, management of error, empathy, use of electronic medical record (EMR) and electronic medical information resources (EMIR), and global rating]. The aim was to test feasibility, acceptability, and reliability of the method. Results: Faculty and standardized patients (SPs) evaluated 56 trainees using the instrument. The inter-rater reliability of agreement between faculty was substantial (Fleiss k = 0.71) and intraclass correlation efficient was excellent (ICC = 0.80). The measured agreement between faculty and SPs evaluation of resident was lower (Fleiss k = 0.36). The instrument showed good conformity (ICC = 0.74). The majority of the trainees (75 {\%}) had satisfactory or higher performance in all six assessed domains and 86 {\%} found the OSCE to be realistic. Sixty percent reported not receiving feedback on EMR use and asked for subsequent training. Conclusion: An OSCE-based instrument using a medical error scenario can be used to assess competency in professionalism, communication, using EMRs and managing medical errors.",
keywords = "ACGME, Communication skills, Core competencies, Medical errors, Medical training, Professionalism",
author = "{Abu Dabrh}, {Abd Moain} and Murad, {Mohammad H} and Newcomb, {Richard D.} and Buchta, {William G.} and Steffen, {Mark W.} and Zhen Wang and Lovett, {Amanda K.} and Steinkraus, {Lawrence W.}",
year = "2016",
month = "9",
day = "2",
doi = "10.1186/s12909-016-0755-5",
language = "English (US)",
volume = "16",
journal = "BMC Medical Education",
issn = "1472-6920",
publisher = "BioMed Central",
number = "1",

}

TY - JOUR

T1 - Proficiency in identifying, managing and communicating medical errors

T2 - Feasibility and validity study assessing two core competencies

AU - Abu Dabrh, Abd Moain

AU - Murad, Mohammad H

AU - Newcomb, Richard D.

AU - Buchta, William G.

AU - Steffen, Mark W.

AU - Wang, Zhen

AU - Lovett, Amanda K.

AU - Steinkraus, Lawrence W.

PY - 2016/9/2

Y1 - 2016/9/2

N2 - Background: Communication skills and professionalism are two competencies in graduate medical education that are challenging to evaluate. We aimed to develop, test and validate a de novo instrument to evaluate these two competencies. Methods: Using an Objective Standardized Clinical Examination (OSCE) based on a medication error scenario, we developed an assessment instrument that focuses on distinctive domains [context of discussion, communication and detection of error, management of error, empathy, use of electronic medical record (EMR) and electronic medical information resources (EMIR), and global rating]. The aim was to test feasibility, acceptability, and reliability of the method. Results: Faculty and standardized patients (SPs) evaluated 56 trainees using the instrument. The inter-rater reliability of agreement between faculty was substantial (Fleiss k = 0.71) and intraclass correlation efficient was excellent (ICC = 0.80). The measured agreement between faculty and SPs evaluation of resident was lower (Fleiss k = 0.36). The instrument showed good conformity (ICC = 0.74). The majority of the trainees (75 %) had satisfactory or higher performance in all six assessed domains and 86 % found the OSCE to be realistic. Sixty percent reported not receiving feedback on EMR use and asked for subsequent training. Conclusion: An OSCE-based instrument using a medical error scenario can be used to assess competency in professionalism, communication, using EMRs and managing medical errors.

AB - Background: Communication skills and professionalism are two competencies in graduate medical education that are challenging to evaluate. We aimed to develop, test and validate a de novo instrument to evaluate these two competencies. Methods: Using an Objective Standardized Clinical Examination (OSCE) based on a medication error scenario, we developed an assessment instrument that focuses on distinctive domains [context of discussion, communication and detection of error, management of error, empathy, use of electronic medical record (EMR) and electronic medical information resources (EMIR), and global rating]. The aim was to test feasibility, acceptability, and reliability of the method. Results: Faculty and standardized patients (SPs) evaluated 56 trainees using the instrument. The inter-rater reliability of agreement between faculty was substantial (Fleiss k = 0.71) and intraclass correlation efficient was excellent (ICC = 0.80). The measured agreement between faculty and SPs evaluation of resident was lower (Fleiss k = 0.36). The instrument showed good conformity (ICC = 0.74). The majority of the trainees (75 %) had satisfactory or higher performance in all six assessed domains and 86 % found the OSCE to be realistic. Sixty percent reported not receiving feedback on EMR use and asked for subsequent training. Conclusion: An OSCE-based instrument using a medical error scenario can be used to assess competency in professionalism, communication, using EMRs and managing medical errors.

KW - ACGME

KW - Communication skills

KW - Core competencies

KW - Medical errors

KW - Medical training

KW - Professionalism

UR - http://www.scopus.com/inward/record.url?scp=84985032701&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84985032701&partnerID=8YFLogxK

U2 - 10.1186/s12909-016-0755-5

DO - 10.1186/s12909-016-0755-5

M3 - Article

C2 - 27589949

AN - SCOPUS:84985032701

VL - 16

JO - BMC Medical Education

JF - BMC Medical Education

SN - 1472-6920

IS - 1

M1 - 233

ER -