Interobserver agreement for EUS findings in familial pancreatic-cancer kindreds

Mark Topazian, Felicity T Enders, Michael Kimmey, Randall Brand, Amitabh Chak, Jonathan Clain, John Cunningham, Mohamad Eloubeidi, Hans Gerdes, Frank Gress, Sanjay Jagannath, Sergey Kantsevoy, Julia Kim LeBlanc, Michael Levy, Charles Lightdale, Joseph Romagnuolo, John R. Saltzman, Thomas Savides, Maurits Wiersema, Timothy Woodward & 2 others Gloria M Petersen, Marcia Canto

Research output: Contribution to journalArticle

54 Citations (Scopus)

Abstract

Background: EUS is a promising modality for pancreatic-cancer screening in high-risk persons, including familial pancreatic-cancer (FPC) kindreds. Objective: To assess interobserver agreement for interpretation of EUS in persons at high risk for pancreatic cancer. Design: Seventeen expert endosonographers blinded to patients' clinical history rated a "training set" of pancreatic EUS video clips for the presence of a normal examination, masses, cysts, and features of chronic pancreatitis. Clips included high-risk persons and controls (normal and various pancreatic diseases). The endosonographers then participated in a workshop on EUS findings in high-risk persons and drafted a consensus statement. Three months later, they blindly rated a "test set" composed of the same video clips. Main Outcome Measurements: Interobserver agreement at baseline (training set) and after a consensus process (test set). Results: For the training set, interobserver agreement was good (kappa ≥ 0.4) for the presence of cysts and was fair to poor for all other rated EUS features and diagnosis of normal. There was no overall improvement in the test set. In both the training and test sets, agreement was worse for clips from FPC kindreds (kappa ≥0.4 for cysts and <0.4 for all other features) than for controls (kappa ≥0.4 for normal, cysts, masses, echogenic strands, and lobularity). Limitations: Video clips were not of identical image quality and duration as a clinical EUS examination. Conclusions: There was fair to poor interobserver agreement for the interpretation of pancreatic EUS video clips from members of FPC kindreds. Agreement was not improved by a consensus process.

Original languageEnglish (US)
Pages (from-to)62-67
Number of pages6
JournalGastrointestinal Endoscopy
Volume66
Issue number1
DOIs
StatePublished - Jul 2007

Fingerprint

Pancreatic Neoplasms
Surgical Instruments
Cysts
Pancreatic Diseases
Chronic Pancreatitis
Early Detection of Cancer
Education

ASJC Scopus subject areas

  • Gastroenterology

Cite this

Interobserver agreement for EUS findings in familial pancreatic-cancer kindreds. / Topazian, Mark; Enders, Felicity T; Kimmey, Michael; Brand, Randall; Chak, Amitabh; Clain, Jonathan; Cunningham, John; Eloubeidi, Mohamad; Gerdes, Hans; Gress, Frank; Jagannath, Sanjay; Kantsevoy, Sergey; LeBlanc, Julia Kim; Levy, Michael; Lightdale, Charles; Romagnuolo, Joseph; Saltzman, John R.; Savides, Thomas; Wiersema, Maurits; Woodward, Timothy; Petersen, Gloria M; Canto, Marcia.

In: Gastrointestinal Endoscopy, Vol. 66, No. 1, 07.2007, p. 62-67.

Research output: Contribution to journalArticle

Topazian, M, Enders, FT, Kimmey, M, Brand, R, Chak, A, Clain, J, Cunningham, J, Eloubeidi, M, Gerdes, H, Gress, F, Jagannath, S, Kantsevoy, S, LeBlanc, JK, Levy, M, Lightdale, C, Romagnuolo, J, Saltzman, JR, Savides, T, Wiersema, M, Woodward, T, Petersen, GM & Canto, M 2007, 'Interobserver agreement for EUS findings in familial pancreatic-cancer kindreds', Gastrointestinal Endoscopy, vol. 66, no. 1, pp. 62-67. https://doi.org/10.1016/j.gie.2006.09.018
Topazian, Mark ; Enders, Felicity T ; Kimmey, Michael ; Brand, Randall ; Chak, Amitabh ; Clain, Jonathan ; Cunningham, John ; Eloubeidi, Mohamad ; Gerdes, Hans ; Gress, Frank ; Jagannath, Sanjay ; Kantsevoy, Sergey ; LeBlanc, Julia Kim ; Levy, Michael ; Lightdale, Charles ; Romagnuolo, Joseph ; Saltzman, John R. ; Savides, Thomas ; Wiersema, Maurits ; Woodward, Timothy ; Petersen, Gloria M ; Canto, Marcia. / Interobserver agreement for EUS findings in familial pancreatic-cancer kindreds. In: Gastrointestinal Endoscopy. 2007 ; Vol. 66, No. 1. pp. 62-67.
@article{56492097aa444aef9915857f7bf5574a,
title = "Interobserver agreement for EUS findings in familial pancreatic-cancer kindreds",
abstract = "Background: EUS is a promising modality for pancreatic-cancer screening in high-risk persons, including familial pancreatic-cancer (FPC) kindreds. Objective: To assess interobserver agreement for interpretation of EUS in persons at high risk for pancreatic cancer. Design: Seventeen expert endosonographers blinded to patients' clinical history rated a {"}training set{"} of pancreatic EUS video clips for the presence of a normal examination, masses, cysts, and features of chronic pancreatitis. Clips included high-risk persons and controls (normal and various pancreatic diseases). The endosonographers then participated in a workshop on EUS findings in high-risk persons and drafted a consensus statement. Three months later, they blindly rated a {"}test set{"} composed of the same video clips. Main Outcome Measurements: Interobserver agreement at baseline (training set) and after a consensus process (test set). Results: For the training set, interobserver agreement was good (kappa ≥ 0.4) for the presence of cysts and was fair to poor for all other rated EUS features and diagnosis of normal. There was no overall improvement in the test set. In both the training and test sets, agreement was worse for clips from FPC kindreds (kappa ≥0.4 for cysts and <0.4 for all other features) than for controls (kappa ≥0.4 for normal, cysts, masses, echogenic strands, and lobularity). Limitations: Video clips were not of identical image quality and duration as a clinical EUS examination. Conclusions: There was fair to poor interobserver agreement for the interpretation of pancreatic EUS video clips from members of FPC kindreds. Agreement was not improved by a consensus process.",
author = "Mark Topazian and Enders, {Felicity T} and Michael Kimmey and Randall Brand and Amitabh Chak and Jonathan Clain and John Cunningham and Mohamad Eloubeidi and Hans Gerdes and Frank Gress and Sanjay Jagannath and Sergey Kantsevoy and LeBlanc, {Julia Kim} and Michael Levy and Charles Lightdale and Joseph Romagnuolo and Saltzman, {John R.} and Thomas Savides and Maurits Wiersema and Timothy Woodward and Petersen, {Gloria M} and Marcia Canto",
year = "2007",
month = "7",
doi = "10.1016/j.gie.2006.09.018",
language = "English (US)",
volume = "66",
pages = "62--67",
journal = "Gastrointestinal Endoscopy",
issn = "0016-5107",
publisher = "Mosby Inc.",
number = "1",

}

TY - JOUR

T1 - Interobserver agreement for EUS findings in familial pancreatic-cancer kindreds

AU - Topazian, Mark

AU - Enders, Felicity T

AU - Kimmey, Michael

AU - Brand, Randall

AU - Chak, Amitabh

AU - Clain, Jonathan

AU - Cunningham, John

AU - Eloubeidi, Mohamad

AU - Gerdes, Hans

AU - Gress, Frank

AU - Jagannath, Sanjay

AU - Kantsevoy, Sergey

AU - LeBlanc, Julia Kim

AU - Levy, Michael

AU - Lightdale, Charles

AU - Romagnuolo, Joseph

AU - Saltzman, John R.

AU - Savides, Thomas

AU - Wiersema, Maurits

AU - Woodward, Timothy

AU - Petersen, Gloria M

AU - Canto, Marcia

PY - 2007/7

Y1 - 2007/7

N2 - Background: EUS is a promising modality for pancreatic-cancer screening in high-risk persons, including familial pancreatic-cancer (FPC) kindreds. Objective: To assess interobserver agreement for interpretation of EUS in persons at high risk for pancreatic cancer. Design: Seventeen expert endosonographers blinded to patients' clinical history rated a "training set" of pancreatic EUS video clips for the presence of a normal examination, masses, cysts, and features of chronic pancreatitis. Clips included high-risk persons and controls (normal and various pancreatic diseases). The endosonographers then participated in a workshop on EUS findings in high-risk persons and drafted a consensus statement. Three months later, they blindly rated a "test set" composed of the same video clips. Main Outcome Measurements: Interobserver agreement at baseline (training set) and after a consensus process (test set). Results: For the training set, interobserver agreement was good (kappa ≥ 0.4) for the presence of cysts and was fair to poor for all other rated EUS features and diagnosis of normal. There was no overall improvement in the test set. In both the training and test sets, agreement was worse for clips from FPC kindreds (kappa ≥0.4 for cysts and <0.4 for all other features) than for controls (kappa ≥0.4 for normal, cysts, masses, echogenic strands, and lobularity). Limitations: Video clips were not of identical image quality and duration as a clinical EUS examination. Conclusions: There was fair to poor interobserver agreement for the interpretation of pancreatic EUS video clips from members of FPC kindreds. Agreement was not improved by a consensus process.

AB - Background: EUS is a promising modality for pancreatic-cancer screening in high-risk persons, including familial pancreatic-cancer (FPC) kindreds. Objective: To assess interobserver agreement for interpretation of EUS in persons at high risk for pancreatic cancer. Design: Seventeen expert endosonographers blinded to patients' clinical history rated a "training set" of pancreatic EUS video clips for the presence of a normal examination, masses, cysts, and features of chronic pancreatitis. Clips included high-risk persons and controls (normal and various pancreatic diseases). The endosonographers then participated in a workshop on EUS findings in high-risk persons and drafted a consensus statement. Three months later, they blindly rated a "test set" composed of the same video clips. Main Outcome Measurements: Interobserver agreement at baseline (training set) and after a consensus process (test set). Results: For the training set, interobserver agreement was good (kappa ≥ 0.4) for the presence of cysts and was fair to poor for all other rated EUS features and diagnosis of normal. There was no overall improvement in the test set. In both the training and test sets, agreement was worse for clips from FPC kindreds (kappa ≥0.4 for cysts and <0.4 for all other features) than for controls (kappa ≥0.4 for normal, cysts, masses, echogenic strands, and lobularity). Limitations: Video clips were not of identical image quality and duration as a clinical EUS examination. Conclusions: There was fair to poor interobserver agreement for the interpretation of pancreatic EUS video clips from members of FPC kindreds. Agreement was not improved by a consensus process.

UR - http://www.scopus.com/inward/record.url?scp=34250756480&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=34250756480&partnerID=8YFLogxK

U2 - 10.1016/j.gie.2006.09.018

DO - 10.1016/j.gie.2006.09.018

M3 - Article

VL - 66

SP - 62

EP - 67

JO - Gastrointestinal Endoscopy

JF - Gastrointestinal Endoscopy

SN - 0016-5107

IS - 1

ER -