Interobserver variability in endoscopic ultrasonography: A prospective evaluation

L. D. Roubein, P. Lynch, G. Glober, Frank A Sinicrope

Research output: Contribution to journalArticle

29 Citations (Scopus)

Abstract

Background: Endoscopic ultrasonography (EUS) is an imaging modality that is now widely used to stage gastrointestinal malignancies. Few studies have addressed the issue of interobserver variability in the interpretation of EUS, particularly as it pertains to the staging of rectal carcinoma. Methods: Twenty-six patients with a diagnosis of rectal carcinoma were evaluated prospectively by three endoscopists. One performed sigmoidoscopy, the second (primary endosonographer) performed an EUS staging examination with full knowledge of the patient history and sigmoidoscopic appearance of the lesion, and the third endoscopist (secondary endosonographer) performed EUS blinded to this information. The results of the respective examinations were then compared. Results: When the EUS findings of the endosonographers were compared, T stage agreed in 88% of patients, with the following kappa coefficients: T1 (κ = 0.00); T2 (κ = -0.04); T3 (κ = -0.05); T4 (κ = 0.00). Interrator N stage agreed in 73% of patients (κ = 0.42). Conclusion: Our study prospectively evaluated interobserver variation in staging rectal carcinoma by EUS. The protocol that was followed provides a useful template that eliminated potential observer bias. Fair agreement was demonstrated regarding lymph node assessment. Although the raters agreed in 88% of the patients, kappa statistic analysis did not reach significant agreement, due to this institution's preponderence of UT3 lesions. Thus, validation of our findings in a setting where a broader spectrum of disease is encountered is required.

Original languageEnglish (US)
Pages (from-to)573-577
Number of pages5
JournalGastrointestinal Endoscopy
Volume44
Issue number5
DOIs
StatePublished - 1996
Externally publishedYes

Fingerprint

Endosonography
Observer Variation
Carcinoma
Sigmoidoscopy
Lymph Nodes
Neoplasms

ASJC Scopus subject areas

  • Gastroenterology

Cite this

Interobserver variability in endoscopic ultrasonography : A prospective evaluation. / Roubein, L. D.; Lynch, P.; Glober, G.; Sinicrope, Frank A.

In: Gastrointestinal Endoscopy, Vol. 44, No. 5, 1996, p. 573-577.

Research output: Contribution to journalArticle

Roubein, L. D. ; Lynch, P. ; Glober, G. ; Sinicrope, Frank A. / Interobserver variability in endoscopic ultrasonography : A prospective evaluation. In: Gastrointestinal Endoscopy. 1996 ; Vol. 44, No. 5. pp. 573-577.
@article{e5bd313daa814c7e9909054a725ad58e,
title = "Interobserver variability in endoscopic ultrasonography: A prospective evaluation",
abstract = "Background: Endoscopic ultrasonography (EUS) is an imaging modality that is now widely used to stage gastrointestinal malignancies. Few studies have addressed the issue of interobserver variability in the interpretation of EUS, particularly as it pertains to the staging of rectal carcinoma. Methods: Twenty-six patients with a diagnosis of rectal carcinoma were evaluated prospectively by three endoscopists. One performed sigmoidoscopy, the second (primary endosonographer) performed an EUS staging examination with full knowledge of the patient history and sigmoidoscopic appearance of the lesion, and the third endoscopist (secondary endosonographer) performed EUS blinded to this information. The results of the respective examinations were then compared. Results: When the EUS findings of the endosonographers were compared, T stage agreed in 88{\%} of patients, with the following kappa coefficients: T1 (κ = 0.00); T2 (κ = -0.04); T3 (κ = -0.05); T4 (κ = 0.00). Interrator N stage agreed in 73{\%} of patients (κ = 0.42). Conclusion: Our study prospectively evaluated interobserver variation in staging rectal carcinoma by EUS. The protocol that was followed provides a useful template that eliminated potential observer bias. Fair agreement was demonstrated regarding lymph node assessment. Although the raters agreed in 88{\%} of the patients, kappa statistic analysis did not reach significant agreement, due to this institution's preponderence of UT3 lesions. Thus, validation of our findings in a setting where a broader spectrum of disease is encountered is required.",
author = "Roubein, {L. D.} and P. Lynch and G. Glober and Sinicrope, {Frank A}",
year = "1996",
doi = "10.1016/S0016-5107(96)70011-1",
language = "English (US)",
volume = "44",
pages = "573--577",
journal = "Gastrointestinal Endoscopy",
issn = "0016-5107",
publisher = "Mosby Inc.",
number = "5",

}

TY - JOUR

T1 - Interobserver variability in endoscopic ultrasonography

T2 - A prospective evaluation

AU - Roubein, L. D.

AU - Lynch, P.

AU - Glober, G.

AU - Sinicrope, Frank A

PY - 1996

Y1 - 1996

N2 - Background: Endoscopic ultrasonography (EUS) is an imaging modality that is now widely used to stage gastrointestinal malignancies. Few studies have addressed the issue of interobserver variability in the interpretation of EUS, particularly as it pertains to the staging of rectal carcinoma. Methods: Twenty-six patients with a diagnosis of rectal carcinoma were evaluated prospectively by three endoscopists. One performed sigmoidoscopy, the second (primary endosonographer) performed an EUS staging examination with full knowledge of the patient history and sigmoidoscopic appearance of the lesion, and the third endoscopist (secondary endosonographer) performed EUS blinded to this information. The results of the respective examinations were then compared. Results: When the EUS findings of the endosonographers were compared, T stage agreed in 88% of patients, with the following kappa coefficients: T1 (κ = 0.00); T2 (κ = -0.04); T3 (κ = -0.05); T4 (κ = 0.00). Interrator N stage agreed in 73% of patients (κ = 0.42). Conclusion: Our study prospectively evaluated interobserver variation in staging rectal carcinoma by EUS. The protocol that was followed provides a useful template that eliminated potential observer bias. Fair agreement was demonstrated regarding lymph node assessment. Although the raters agreed in 88% of the patients, kappa statistic analysis did not reach significant agreement, due to this institution's preponderence of UT3 lesions. Thus, validation of our findings in a setting where a broader spectrum of disease is encountered is required.

AB - Background: Endoscopic ultrasonography (EUS) is an imaging modality that is now widely used to stage gastrointestinal malignancies. Few studies have addressed the issue of interobserver variability in the interpretation of EUS, particularly as it pertains to the staging of rectal carcinoma. Methods: Twenty-six patients with a diagnosis of rectal carcinoma were evaluated prospectively by three endoscopists. One performed sigmoidoscopy, the second (primary endosonographer) performed an EUS staging examination with full knowledge of the patient history and sigmoidoscopic appearance of the lesion, and the third endoscopist (secondary endosonographer) performed EUS blinded to this information. The results of the respective examinations were then compared. Results: When the EUS findings of the endosonographers were compared, T stage agreed in 88% of patients, with the following kappa coefficients: T1 (κ = 0.00); T2 (κ = -0.04); T3 (κ = -0.05); T4 (κ = 0.00). Interrator N stage agreed in 73% of patients (κ = 0.42). Conclusion: Our study prospectively evaluated interobserver variation in staging rectal carcinoma by EUS. The protocol that was followed provides a useful template that eliminated potential observer bias. Fair agreement was demonstrated regarding lymph node assessment. Although the raters agreed in 88% of the patients, kappa statistic analysis did not reach significant agreement, due to this institution's preponderence of UT3 lesions. Thus, validation of our findings in a setting where a broader spectrum of disease is encountered is required.

UR - http://www.scopus.com/inward/record.url?scp=0029857967&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0029857967&partnerID=8YFLogxK

U2 - 10.1016/S0016-5107(96)70011-1

DO - 10.1016/S0016-5107(96)70011-1

M3 - Article

C2 - 8934164

AN - SCOPUS:0029857967

VL - 44

SP - 573

EP - 577

JO - Gastrointestinal Endoscopy

JF - Gastrointestinal Endoscopy

SN - 0016-5107

IS - 5

ER -