Substantial Interobserver Agreement in the Diagnosis of Dysplasia in Barrett Esophagus Upon Review of a Patient's Entire Set of Biopsies

Marcela A. Salomao, Dora Lam-Himlin, Rish Pai

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

The pathologic diagnosis of dysplasia in Barrett esophagus (BE) suffers from interobserver disagreement. Many of the studies demonstrating disagreement in the diagnosis of dysplasia have pathologists review individual biopsy slides in isolation. To more closely mimic daily practice, 3 pathologists reviewed hematoxylin and eosin slides made from 549 individual biopsy jars obtained from 129 unique patients with a diagnosis of BE. Each pathologist reviewed the entirety of a given patient's biopsy material. The grade of dysplasia present in each biopsy jar was given as well as an overall highest grade of dysplasia from the patient's entire set of biopsies. The interobserver agreement in the diagnosis of dysplasia per biopsy jar and per patient's set of biopsies was measured by Fleiss κ statistic for multiple raters. The κ values for each diagnosis was higher in the per patient analysis compared with the per biopsy jar analysis indicating that pathologists are more likely to agree on the overall grade of dysplasia compared with the grade in an individual biopsy jar. In the per patient analysis, the interobserver agreement in the diagnosis of nondysplastic BE and high-grade dysplasia were substantial (κ=0.66; 95% confidence interval [CI], 0.56-0.76 and κ=0.76; 95% CI, 0.66-0.86, respectively). The interobserver agreement in the diagnosis of low-grade dysplasia (LGD) was fair (κ=0.31; 95% CI, 0.21-0.42). When LGD and high-grade dysplasia were collapsed into 1 category of positive for dysplasia, the interobserver agreement in the per patient analysis remained substantial (κ=0.70; 95% CI, 0.60-0.80), suggesting that much of the disagreement in LGD is not due to lack of recognition of dysplastic Barrett's mucosa, but rather the degree of dysplasia. These results indicate that pathologists can reliably distinguish between nondysplastic BE and dysplastic BE when a patient's entire set of biopsies is reviewed as a group. When second opinions are obtained, all available slides from that endoscopic procedure should be sent for review.

Original languageEnglish (US)
Pages (from-to)376-381
Number of pages6
JournalAmerican Journal of Surgical Pathology
Volume42
Issue number3
DOIs
StatePublished - Jan 1 2018

Fingerprint

Barrett Esophagus
Biopsy
Confidence Intervals
Hematoxylin
Eosine Yellowish-(YS)
Mucous Membrane
Referral and Consultation
Pathologists

Keywords

  • Barrett esophagus
  • high-grade dysplasia
  • interobserver agreement
  • low-grade dysplasia

ASJC Scopus subject areas

  • Anatomy
  • Surgery
  • Pathology and Forensic Medicine

Cite this

Substantial Interobserver Agreement in the Diagnosis of Dysplasia in Barrett Esophagus Upon Review of a Patient's Entire Set of Biopsies. / Salomao, Marcela A.; Lam-Himlin, Dora; Pai, Rish.

In: American Journal of Surgical Pathology, Vol. 42, No. 3, 01.01.2018, p. 376-381.

Research output: Contribution to journalArticle

@article{2acfcd7d2d16469cbd7c96f3b84cbc33,
title = "Substantial Interobserver Agreement in the Diagnosis of Dysplasia in Barrett Esophagus Upon Review of a Patient's Entire Set of Biopsies",
abstract = "The pathologic diagnosis of dysplasia in Barrett esophagus (BE) suffers from interobserver disagreement. Many of the studies demonstrating disagreement in the diagnosis of dysplasia have pathologists review individual biopsy slides in isolation. To more closely mimic daily practice, 3 pathologists reviewed hematoxylin and eosin slides made from 549 individual biopsy jars obtained from 129 unique patients with a diagnosis of BE. Each pathologist reviewed the entirety of a given patient's biopsy material. The grade of dysplasia present in each biopsy jar was given as well as an overall highest grade of dysplasia from the patient's entire set of biopsies. The interobserver agreement in the diagnosis of dysplasia per biopsy jar and per patient's set of biopsies was measured by Fleiss κ statistic for multiple raters. The κ values for each diagnosis was higher in the per patient analysis compared with the per biopsy jar analysis indicating that pathologists are more likely to agree on the overall grade of dysplasia compared with the grade in an individual biopsy jar. In the per patient analysis, the interobserver agreement in the diagnosis of nondysplastic BE and high-grade dysplasia were substantial (κ=0.66; 95{\%} confidence interval [CI], 0.56-0.76 and κ=0.76; 95{\%} CI, 0.66-0.86, respectively). The interobserver agreement in the diagnosis of low-grade dysplasia (LGD) was fair (κ=0.31; 95{\%} CI, 0.21-0.42). When LGD and high-grade dysplasia were collapsed into 1 category of positive for dysplasia, the interobserver agreement in the per patient analysis remained substantial (κ=0.70; 95{\%} CI, 0.60-0.80), suggesting that much of the disagreement in LGD is not due to lack of recognition of dysplastic Barrett's mucosa, but rather the degree of dysplasia. These results indicate that pathologists can reliably distinguish between nondysplastic BE and dysplastic BE when a patient's entire set of biopsies is reviewed as a group. When second opinions are obtained, all available slides from that endoscopic procedure should be sent for review.",
keywords = "Barrett esophagus, high-grade dysplasia, interobserver agreement, low-grade dysplasia",
author = "Salomao, {Marcela A.} and Dora Lam-Himlin and Rish Pai",
year = "2018",
month = "1",
day = "1",
doi = "10.1097/PAS.0000000000000988",
language = "English (US)",
volume = "42",
pages = "376--381",
journal = "American Journal of Surgical Pathology",
issn = "0147-5185",
publisher = "Lippincott Williams and Wilkins",
number = "3",

}

TY - JOUR

T1 - Substantial Interobserver Agreement in the Diagnosis of Dysplasia in Barrett Esophagus Upon Review of a Patient's Entire Set of Biopsies

AU - Salomao, Marcela A.

AU - Lam-Himlin, Dora

AU - Pai, Rish

PY - 2018/1/1

Y1 - 2018/1/1

N2 - The pathologic diagnosis of dysplasia in Barrett esophagus (BE) suffers from interobserver disagreement. Many of the studies demonstrating disagreement in the diagnosis of dysplasia have pathologists review individual biopsy slides in isolation. To more closely mimic daily practice, 3 pathologists reviewed hematoxylin and eosin slides made from 549 individual biopsy jars obtained from 129 unique patients with a diagnosis of BE. Each pathologist reviewed the entirety of a given patient's biopsy material. The grade of dysplasia present in each biopsy jar was given as well as an overall highest grade of dysplasia from the patient's entire set of biopsies. The interobserver agreement in the diagnosis of dysplasia per biopsy jar and per patient's set of biopsies was measured by Fleiss κ statistic for multiple raters. The κ values for each diagnosis was higher in the per patient analysis compared with the per biopsy jar analysis indicating that pathologists are more likely to agree on the overall grade of dysplasia compared with the grade in an individual biopsy jar. In the per patient analysis, the interobserver agreement in the diagnosis of nondysplastic BE and high-grade dysplasia were substantial (κ=0.66; 95% confidence interval [CI], 0.56-0.76 and κ=0.76; 95% CI, 0.66-0.86, respectively). The interobserver agreement in the diagnosis of low-grade dysplasia (LGD) was fair (κ=0.31; 95% CI, 0.21-0.42). When LGD and high-grade dysplasia were collapsed into 1 category of positive for dysplasia, the interobserver agreement in the per patient analysis remained substantial (κ=0.70; 95% CI, 0.60-0.80), suggesting that much of the disagreement in LGD is not due to lack of recognition of dysplastic Barrett's mucosa, but rather the degree of dysplasia. These results indicate that pathologists can reliably distinguish between nondysplastic BE and dysplastic BE when a patient's entire set of biopsies is reviewed as a group. When second opinions are obtained, all available slides from that endoscopic procedure should be sent for review.

AB - The pathologic diagnosis of dysplasia in Barrett esophagus (BE) suffers from interobserver disagreement. Many of the studies demonstrating disagreement in the diagnosis of dysplasia have pathologists review individual biopsy slides in isolation. To more closely mimic daily practice, 3 pathologists reviewed hematoxylin and eosin slides made from 549 individual biopsy jars obtained from 129 unique patients with a diagnosis of BE. Each pathologist reviewed the entirety of a given patient's biopsy material. The grade of dysplasia present in each biopsy jar was given as well as an overall highest grade of dysplasia from the patient's entire set of biopsies. The interobserver agreement in the diagnosis of dysplasia per biopsy jar and per patient's set of biopsies was measured by Fleiss κ statistic for multiple raters. The κ values for each diagnosis was higher in the per patient analysis compared with the per biopsy jar analysis indicating that pathologists are more likely to agree on the overall grade of dysplasia compared with the grade in an individual biopsy jar. In the per patient analysis, the interobserver agreement in the diagnosis of nondysplastic BE and high-grade dysplasia were substantial (κ=0.66; 95% confidence interval [CI], 0.56-0.76 and κ=0.76; 95% CI, 0.66-0.86, respectively). The interobserver agreement in the diagnosis of low-grade dysplasia (LGD) was fair (κ=0.31; 95% CI, 0.21-0.42). When LGD and high-grade dysplasia were collapsed into 1 category of positive for dysplasia, the interobserver agreement in the per patient analysis remained substantial (κ=0.70; 95% CI, 0.60-0.80), suggesting that much of the disagreement in LGD is not due to lack of recognition of dysplastic Barrett's mucosa, but rather the degree of dysplasia. These results indicate that pathologists can reliably distinguish between nondysplastic BE and dysplastic BE when a patient's entire set of biopsies is reviewed as a group. When second opinions are obtained, all available slides from that endoscopic procedure should be sent for review.

KW - Barrett esophagus

KW - high-grade dysplasia

KW - interobserver agreement

KW - low-grade dysplasia

UR - http://www.scopus.com/inward/record.url?scp=85042818658&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85042818658&partnerID=8YFLogxK

U2 - 10.1097/PAS.0000000000000988

DO - 10.1097/PAS.0000000000000988

M3 - Article

C2 - 29135518

AN - SCOPUS:85042818658

VL - 42

SP - 376

EP - 381

JO - American Journal of Surgical Pathology

JF - American Journal of Surgical Pathology

SN - 0147-5185

IS - 3

ER -