Feasibility of patient and peer surveys for Maintenance of Certification among diplomates of the American Board of Anesthesiology

David Oman Warner, Huaping Sun, Ann E. Harman, Deborah J. Culley

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

Study objective The initial developmental standards for Maintenance of Certification programs proposed by the American Board of Medical Specialties included the administration of patient and peer surveys by the diplomate every 5 years. The aim of this pilot study was to determine the feasibility of Maintenance of Certification in Anesthesiology Program (MOCA) patient and peer surveys in a selected group of American Board of Anesthesiology (ABA) diplomates. Design The design was a pilot test of survey instruments - MOCA Patient Care Survey and MOCA Peer Survey. Setting The setting was the ABA, Raleigh, NC. Subjects The subjects were ABA-certified anesthesiologists who were active examiners for the primary certification oral examination as of January 2013. Measurements Fifty-one participating physicians in the patient survey group distributed brochures, which included a link to the MOCA Patient Care Survey, to up to 100 consecutive patients at the point of care. Fifty-one participating physicians in the peer survey group distributed invitations to MOCA Peer Survey via e-mail to 20 peers in a variety of roles. Participants developed and evaluated a practice improvement plan based on survey results. Participants were also surveyed on their opinions on the feasibility of implementing the piloted survey instrument in their practices. Main results Response rates for the patient care and the peer surveys were 15% and 75%, respectively. Both surveys indicated a high level of satisfaction with the diplomates; approximately two-thirds of physicians could not identify practice areas in need of improvement. Conclusions These results suggest that threats to the validity of these surveys include distribution bias for peer surveys and response bias for patient surveys and that surveys often do not provide actionable information useful for practice improvement. Alternative approaches, such as including anesthesiologists within an integrated institutional evaluation system, could be explored to maximize the benefits of physician assessments provided by peers and patients.

Original languageEnglish (US)
Pages (from-to)290-295
Number of pages6
JournalJournal of Clinical Anesthesia
Volume27
Issue number4
DOIs
StatePublished - Jun 1 2015

Fingerprint

Anesthesiology
Certification
Maintenance
Physicians
Patient Care
Surveys and Questionnaires
Point-of-Care Systems
Peer Group
Oral Diagnosis
Pamphlets
Postal Service

Keywords

  • American Board of Anesthesiology (ABA)
  • Maintenance of Certification in Anesthesiology Program (MOCA)
  • MOCA Patient Care Survey
  • MOCA Peer Survey

ASJC Scopus subject areas

  • Anesthesiology and Pain Medicine

Cite this

Feasibility of patient and peer surveys for Maintenance of Certification among diplomates of the American Board of Anesthesiology. / Warner, David Oman; Sun, Huaping; Harman, Ann E.; Culley, Deborah J.

In: Journal of Clinical Anesthesia, Vol. 27, No. 4, 01.06.2015, p. 290-295.

Research output: Contribution to journalArticle

@article{646ad6750822417bad7a1d6610943169,
title = "Feasibility of patient and peer surveys for Maintenance of Certification among diplomates of the American Board of Anesthesiology",
abstract = "Study objective The initial developmental standards for Maintenance of Certification programs proposed by the American Board of Medical Specialties included the administration of patient and peer surveys by the diplomate every 5 years. The aim of this pilot study was to determine the feasibility of Maintenance of Certification in Anesthesiology Program (MOCA) patient and peer surveys in a selected group of American Board of Anesthesiology (ABA) diplomates. Design The design was a pilot test of survey instruments - MOCA Patient Care Survey and MOCA Peer Survey. Setting The setting was the ABA, Raleigh, NC. Subjects The subjects were ABA-certified anesthesiologists who were active examiners for the primary certification oral examination as of January 2013. Measurements Fifty-one participating physicians in the patient survey group distributed brochures, which included a link to the MOCA Patient Care Survey, to up to 100 consecutive patients at the point of care. Fifty-one participating physicians in the peer survey group distributed invitations to MOCA Peer Survey via e-mail to 20 peers in a variety of roles. Participants developed and evaluated a practice improvement plan based on survey results. Participants were also surveyed on their opinions on the feasibility of implementing the piloted survey instrument in their practices. Main results Response rates for the patient care and the peer surveys were 15{\%} and 75{\%}, respectively. Both surveys indicated a high level of satisfaction with the diplomates; approximately two-thirds of physicians could not identify practice areas in need of improvement. Conclusions These results suggest that threats to the validity of these surveys include distribution bias for peer surveys and response bias for patient surveys and that surveys often do not provide actionable information useful for practice improvement. Alternative approaches, such as including anesthesiologists within an integrated institutional evaluation system, could be explored to maximize the benefits of physician assessments provided by peers and patients.",
keywords = "American Board of Anesthesiology (ABA), Maintenance of Certification in Anesthesiology Program (MOCA), MOCA Patient Care Survey, MOCA Peer Survey",
author = "Warner, {David Oman} and Huaping Sun and Harman, {Ann E.} and Culley, {Deborah J.}",
year = "2015",
month = "6",
day = "1",
doi = "10.1016/j.jclinane.2015.03.002",
language = "English (US)",
volume = "27",
pages = "290--295",
journal = "Journal of Clinical Anesthesia",
issn = "0952-8180",
publisher = "Elsevier Inc.",
number = "4",

}

TY - JOUR

T1 - Feasibility of patient and peer surveys for Maintenance of Certification among diplomates of the American Board of Anesthesiology

AU - Warner, David Oman

AU - Sun, Huaping

AU - Harman, Ann E.

AU - Culley, Deborah J.

PY - 2015/6/1

Y1 - 2015/6/1

N2 - Study objective The initial developmental standards for Maintenance of Certification programs proposed by the American Board of Medical Specialties included the administration of patient and peer surveys by the diplomate every 5 years. The aim of this pilot study was to determine the feasibility of Maintenance of Certification in Anesthesiology Program (MOCA) patient and peer surveys in a selected group of American Board of Anesthesiology (ABA) diplomates. Design The design was a pilot test of survey instruments - MOCA Patient Care Survey and MOCA Peer Survey. Setting The setting was the ABA, Raleigh, NC. Subjects The subjects were ABA-certified anesthesiologists who were active examiners for the primary certification oral examination as of January 2013. Measurements Fifty-one participating physicians in the patient survey group distributed brochures, which included a link to the MOCA Patient Care Survey, to up to 100 consecutive patients at the point of care. Fifty-one participating physicians in the peer survey group distributed invitations to MOCA Peer Survey via e-mail to 20 peers in a variety of roles. Participants developed and evaluated a practice improvement plan based on survey results. Participants were also surveyed on their opinions on the feasibility of implementing the piloted survey instrument in their practices. Main results Response rates for the patient care and the peer surveys were 15% and 75%, respectively. Both surveys indicated a high level of satisfaction with the diplomates; approximately two-thirds of physicians could not identify practice areas in need of improvement. Conclusions These results suggest that threats to the validity of these surveys include distribution bias for peer surveys and response bias for patient surveys and that surveys often do not provide actionable information useful for practice improvement. Alternative approaches, such as including anesthesiologists within an integrated institutional evaluation system, could be explored to maximize the benefits of physician assessments provided by peers and patients.

AB - Study objective The initial developmental standards for Maintenance of Certification programs proposed by the American Board of Medical Specialties included the administration of patient and peer surveys by the diplomate every 5 years. The aim of this pilot study was to determine the feasibility of Maintenance of Certification in Anesthesiology Program (MOCA) patient and peer surveys in a selected group of American Board of Anesthesiology (ABA) diplomates. Design The design was a pilot test of survey instruments - MOCA Patient Care Survey and MOCA Peer Survey. Setting The setting was the ABA, Raleigh, NC. Subjects The subjects were ABA-certified anesthesiologists who were active examiners for the primary certification oral examination as of January 2013. Measurements Fifty-one participating physicians in the patient survey group distributed brochures, which included a link to the MOCA Patient Care Survey, to up to 100 consecutive patients at the point of care. Fifty-one participating physicians in the peer survey group distributed invitations to MOCA Peer Survey via e-mail to 20 peers in a variety of roles. Participants developed and evaluated a practice improvement plan based on survey results. Participants were also surveyed on their opinions on the feasibility of implementing the piloted survey instrument in their practices. Main results Response rates for the patient care and the peer surveys were 15% and 75%, respectively. Both surveys indicated a high level of satisfaction with the diplomates; approximately two-thirds of physicians could not identify practice areas in need of improvement. Conclusions These results suggest that threats to the validity of these surveys include distribution bias for peer surveys and response bias for patient surveys and that surveys often do not provide actionable information useful for practice improvement. Alternative approaches, such as including anesthesiologists within an integrated institutional evaluation system, could be explored to maximize the benefits of physician assessments provided by peers and patients.

KW - American Board of Anesthesiology (ABA)

KW - Maintenance of Certification in Anesthesiology Program (MOCA)

KW - MOCA Patient Care Survey

KW - MOCA Peer Survey

UR - http://www.scopus.com/inward/record.url?scp=84930083007&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84930083007&partnerID=8YFLogxK

U2 - 10.1016/j.jclinane.2015.03.002

DO - 10.1016/j.jclinane.2015.03.002

M3 - Article

VL - 27

SP - 290

EP - 295

JO - Journal of Clinical Anesthesia

JF - Journal of Clinical Anesthesia

SN - 0952-8180

IS - 4

ER -