Competency in esophagogastroduodenoscopy: a validated tool for assessment and generalizable benchmarks for gastroenterology fellows

ACE Research Group

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Background and Aims: The Assessment of Competency in Endoscopy (ACE) tools for colonoscopy and EGD were both put forth by the Training Committee of the American Society for Gastrointestinal Endoscopy (ASGE), with the intent of providing teachers and programs a means to continuously assess fellow skills in these procedures throughout their years of training. Despite the availability of the tools, there are no data that define when competency in EGD has been reached. The goal of this study is to validate the EGD ACE tool (ACE-E) and for the first time describe learning curves and competency benchmarks for EGD by examining a large national cohort of trainees. Methods: In a prospective, multicenter trial, gastroenterology fellows at all stages of training had their core cognitive and motor skills in EGDs assessed by staff using the ACE-E tool. Evaluations occurred at set intervals of every 50 procedures over an academic year. Like the previously reported and validated ACE tool for colonoscopy, the ACE-E tool uses a 4-point grading scale to define a skills continuum from novice to competent. At each assessment interval, average scores for each skill were computed and overall competency benchmarks for each skill were established using the contrasting groups method. Results: Ninety-six GI fellows at 10 U.S. academic institutions had 1002 EGDs assessed using the ACE-E tool. Average ACE-E scores of 3.5 were found to be inclusive of all minimal competency thresholds identified for each core skill. In addition, independent intubation of the second part of the duodenum (D2) at rates of ≥95% as well as D2 intubation times of ≤4.75 minutes and average total procedure times of ≤12.5 minutes were identified as the points separating competent from non-competent groups. Although the average fellow achieves the D2 intubation rates and time criteria by 100 and 150 procedures, respectively, achieving ACE-E threshold scores on the remaining metrics was typically not achieved until 200 to 250 procedures. Conclusions: Nationally generalizable learning curves for EGD skills in GI fellows are described. Average ACE-E scores of 3.5, independent D2 intubation rates of 95%, and D2 intubation times of ≤4.75 minutes are recommended as minimum competency criteria. On average, it takes GI fellows only 150 procedures to simply drive the scope adequately but 250 procedures to achieve minimum competence in the remaining cognitive and motor skills. The D2 intubation rate threshold and learning curve found in this multicenter cohort using the ACE-E tool are similar to those recently described by researchers in the United Kingdom; however, development of cognitive and overall competence requires a higher procedure threshold than previously described.

Original languageEnglish (US)
Pages (from-to)613-620.e1
JournalGastrointestinal endoscopy
Volume90
Issue number4
DOIs
StatePublished - Oct 2019

Fingerprint

Digestive System Endoscopy
Benchmarking
Gastroenterology
Endoscopy
Intubation
Learning Curve
Motor Skills
Colonoscopy
Mental Competency
Gastrointestinal Endoscopy
Duodenum
Multicenter Studies

ASJC Scopus subject areas

  • Radiology Nuclear Medicine and imaging
  • Gastroenterology

Cite this

Competency in esophagogastroduodenoscopy : a validated tool for assessment and generalizable benchmarks for gastroenterology fellows. / ACE Research Group.

In: Gastrointestinal endoscopy, Vol. 90, No. 4, 10.2019, p. 613-620.e1.

Research output: Contribution to journalArticle

@article{848d51d2bf9f41e6852539baf949c07e,
title = "Competency in esophagogastroduodenoscopy: a validated tool for assessment and generalizable benchmarks for gastroenterology fellows",
abstract = "Background and Aims: The Assessment of Competency in Endoscopy (ACE) tools for colonoscopy and EGD were both put forth by the Training Committee of the American Society for Gastrointestinal Endoscopy (ASGE), with the intent of providing teachers and programs a means to continuously assess fellow skills in these procedures throughout their years of training. Despite the availability of the tools, there are no data that define when competency in EGD has been reached. The goal of this study is to validate the EGD ACE tool (ACE-E) and for the first time describe learning curves and competency benchmarks for EGD by examining a large national cohort of trainees. Methods: In a prospective, multicenter trial, gastroenterology fellows at all stages of training had their core cognitive and motor skills in EGDs assessed by staff using the ACE-E tool. Evaluations occurred at set intervals of every 50 procedures over an academic year. Like the previously reported and validated ACE tool for colonoscopy, the ACE-E tool uses a 4-point grading scale to define a skills continuum from novice to competent. At each assessment interval, average scores for each skill were computed and overall competency benchmarks for each skill were established using the contrasting groups method. Results: Ninety-six GI fellows at 10 U.S. academic institutions had 1002 EGDs assessed using the ACE-E tool. Average ACE-E scores of 3.5 were found to be inclusive of all minimal competency thresholds identified for each core skill. In addition, independent intubation of the second part of the duodenum (D2) at rates of ≥95{\%} as well as D2 intubation times of ≤4.75 minutes and average total procedure times of ≤12.5 minutes were identified as the points separating competent from non-competent groups. Although the average fellow achieves the D2 intubation rates and time criteria by 100 and 150 procedures, respectively, achieving ACE-E threshold scores on the remaining metrics was typically not achieved until 200 to 250 procedures. Conclusions: Nationally generalizable learning curves for EGD skills in GI fellows are described. Average ACE-E scores of 3.5, independent D2 intubation rates of 95{\%}, and D2 intubation times of ≤4.75 minutes are recommended as minimum competency criteria. On average, it takes GI fellows only 150 procedures to simply drive the scope adequately but 250 procedures to achieve minimum competence in the remaining cognitive and motor skills. The D2 intubation rate threshold and learning curve found in this multicenter cohort using the ACE-E tool are similar to those recently described by researchers in the United Kingdom; however, development of cognitive and overall competence requires a higher procedure threshold than previously described.",
author = "{ACE Research Group} and Miller, {Alexander T.} and Sedlack, {Robert E.} and Coyle, {Walter J.} and Obstein, {Keith L.} and Poles, {Michael A.} and Ramirez, {Francisco C.} and Lukens, {Frank J.} and Gyawali, {C. Prakash} and Christie, {Jennifer A.} and Denise Kalmaz and Burke, {Carol A.} and Felicity Enders and Larson, {Joseph J.} and Oxentenko, {Amy S.}",
year = "2019",
month = "10",
doi = "10.1016/j.gie.2019.05.024",
language = "English (US)",
volume = "90",
pages = "613--620.e1",
journal = "Gastrointestinal Endoscopy",
issn = "0016-5107",
publisher = "Mosby Inc.",
number = "4",

}

TY - JOUR

T1 - Competency in esophagogastroduodenoscopy

T2 - a validated tool for assessment and generalizable benchmarks for gastroenterology fellows

AU - ACE Research Group

AU - Miller, Alexander T.

AU - Sedlack, Robert E.

AU - Coyle, Walter J.

AU - Obstein, Keith L.

AU - Poles, Michael A.

AU - Ramirez, Francisco C.

AU - Lukens, Frank J.

AU - Gyawali, C. Prakash

AU - Christie, Jennifer A.

AU - Kalmaz, Denise

AU - Burke, Carol A.

AU - Enders, Felicity

AU - Larson, Joseph J.

AU - Oxentenko, Amy S.

PY - 2019/10

Y1 - 2019/10

N2 - Background and Aims: The Assessment of Competency in Endoscopy (ACE) tools for colonoscopy and EGD were both put forth by the Training Committee of the American Society for Gastrointestinal Endoscopy (ASGE), with the intent of providing teachers and programs a means to continuously assess fellow skills in these procedures throughout their years of training. Despite the availability of the tools, there are no data that define when competency in EGD has been reached. The goal of this study is to validate the EGD ACE tool (ACE-E) and for the first time describe learning curves and competency benchmarks for EGD by examining a large national cohort of trainees. Methods: In a prospective, multicenter trial, gastroenterology fellows at all stages of training had their core cognitive and motor skills in EGDs assessed by staff using the ACE-E tool. Evaluations occurred at set intervals of every 50 procedures over an academic year. Like the previously reported and validated ACE tool for colonoscopy, the ACE-E tool uses a 4-point grading scale to define a skills continuum from novice to competent. At each assessment interval, average scores for each skill were computed and overall competency benchmarks for each skill were established using the contrasting groups method. Results: Ninety-six GI fellows at 10 U.S. academic institutions had 1002 EGDs assessed using the ACE-E tool. Average ACE-E scores of 3.5 were found to be inclusive of all minimal competency thresholds identified for each core skill. In addition, independent intubation of the second part of the duodenum (D2) at rates of ≥95% as well as D2 intubation times of ≤4.75 minutes and average total procedure times of ≤12.5 minutes were identified as the points separating competent from non-competent groups. Although the average fellow achieves the D2 intubation rates and time criteria by 100 and 150 procedures, respectively, achieving ACE-E threshold scores on the remaining metrics was typically not achieved until 200 to 250 procedures. Conclusions: Nationally generalizable learning curves for EGD skills in GI fellows are described. Average ACE-E scores of 3.5, independent D2 intubation rates of 95%, and D2 intubation times of ≤4.75 minutes are recommended as minimum competency criteria. On average, it takes GI fellows only 150 procedures to simply drive the scope adequately but 250 procedures to achieve minimum competence in the remaining cognitive and motor skills. The D2 intubation rate threshold and learning curve found in this multicenter cohort using the ACE-E tool are similar to those recently described by researchers in the United Kingdom; however, development of cognitive and overall competence requires a higher procedure threshold than previously described.

AB - Background and Aims: The Assessment of Competency in Endoscopy (ACE) tools for colonoscopy and EGD were both put forth by the Training Committee of the American Society for Gastrointestinal Endoscopy (ASGE), with the intent of providing teachers and programs a means to continuously assess fellow skills in these procedures throughout their years of training. Despite the availability of the tools, there are no data that define when competency in EGD has been reached. The goal of this study is to validate the EGD ACE tool (ACE-E) and for the first time describe learning curves and competency benchmarks for EGD by examining a large national cohort of trainees. Methods: In a prospective, multicenter trial, gastroenterology fellows at all stages of training had their core cognitive and motor skills in EGDs assessed by staff using the ACE-E tool. Evaluations occurred at set intervals of every 50 procedures over an academic year. Like the previously reported and validated ACE tool for colonoscopy, the ACE-E tool uses a 4-point grading scale to define a skills continuum from novice to competent. At each assessment interval, average scores for each skill were computed and overall competency benchmarks for each skill were established using the contrasting groups method. Results: Ninety-six GI fellows at 10 U.S. academic institutions had 1002 EGDs assessed using the ACE-E tool. Average ACE-E scores of 3.5 were found to be inclusive of all minimal competency thresholds identified for each core skill. In addition, independent intubation of the second part of the duodenum (D2) at rates of ≥95% as well as D2 intubation times of ≤4.75 minutes and average total procedure times of ≤12.5 minutes were identified as the points separating competent from non-competent groups. Although the average fellow achieves the D2 intubation rates and time criteria by 100 and 150 procedures, respectively, achieving ACE-E threshold scores on the remaining metrics was typically not achieved until 200 to 250 procedures. Conclusions: Nationally generalizable learning curves for EGD skills in GI fellows are described. Average ACE-E scores of 3.5, independent D2 intubation rates of 95%, and D2 intubation times of ≤4.75 minutes are recommended as minimum competency criteria. On average, it takes GI fellows only 150 procedures to simply drive the scope adequately but 250 procedures to achieve minimum competence in the remaining cognitive and motor skills. The D2 intubation rate threshold and learning curve found in this multicenter cohort using the ACE-E tool are similar to those recently described by researchers in the United Kingdom; however, development of cognitive and overall competence requires a higher procedure threshold than previously described.

UR - http://www.scopus.com/inward/record.url?scp=85069838346&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85069838346&partnerID=8YFLogxK

U2 - 10.1016/j.gie.2019.05.024

DO - 10.1016/j.gie.2019.05.024

M3 - Article

C2 - 31121154

AN - SCOPUS:85069838346

VL - 90

SP - 613-620.e1

JO - Gastrointestinal Endoscopy

JF - Gastrointestinal Endoscopy

SN - 0016-5107

IS - 4

ER -