Stereology and computer-based image analysis quantifies heterogeneity and improves reproducibility for grading reticulin in myeloproliferative neoplasms

Mohamed Salama, Erik Hagendorn, Sherrie L. Perkins, Jeff L. Kutok, A. Etman, Josef T. Prchal, Steven J. Potts

Research output: Contribution to journalArticle

Abstract

Evaluation of bone marrow fibrosis in myeloproliferative neoplasms (MPN) is subject to interobserver inconsistency, and cutpoints for determination of therapy are dependent on manual pathologist grading of reticulin. To provide a more consistent approach to cutpoint determination, we developed a stereologybased method of calculating length fiber density (the length of the fiber network divided by the volume of bone marrow hematopoietic tissue). Forty-eight thin needle core bone marrow biopsy samples from patients with MPN were obtained from the University of Utah archives after institutional review board approval and stained for reticulin and then scanned using whole slide imaging. To determine interpathologist concordance, the blinded cases were scored according to the European consensus system by four pathologists. Two pathologists scored twice with a 1-month washout period to determine intrapathologist concordance. Using systematic uniform random sampling and line counting, two techniques adapted from the stereology field, the length density of the reticulin network was measured as well as a measure of heterogeneity across the bone marrow sample. Image analysis was used to measure the area of the reticulin fiber as a two-dimensional profile. To build a model for predicting scoring by stereology, 16 samples were chosen randomly and a linear regression relationship determined. This score was then rounded to 0, 1, 2, or 3, and concordance rates between pathologists and between pathologist and the computer stereology score determined. Results: In the 48 patient cohort, stereology assessment was well correlated with the average of manual pathologist scoring (linear regression, R2=0.7038). While the European consensus scoring system ranges from 0 to 3, the cutpoint between 0/1 and 2/3 is generally used for guiding therapeutic decision as myelofibrosis. In 7 of the 48 cases (15%), pathologists had differing scores across this cutpoint, meaning that the ultimate therapeutic outcome would have been impacted. The stereology score differed with the average of the pathologist scores in only 5 of the 48 cases across this cutpoint (10%). Precision rates for the stereology analysis were 92%, compared with interpathologist concordance ranging from 54.2 to 65.2% and intrapathologist at 60.9%. Computer-based stereology proved to be more reproducible at predicting therapeutic cutpoint than manual scoring. The new technique can be run using standard histochemistry and provides both a nonbiased systematic measure of reticulin and a new measure of reticulin heterogeneity.

Original languageEnglish (US)
Pages (from-to)117-126
Number of pages10
JournalMethods in Pharmacology and Toxicology
Volume20
DOIs
StatePublished - Jan 1 2015
Externally publishedYes

Fingerprint

Reticulin
Neoplasms
Primary Myelofibrosis
Bone Marrow
Linear Models
Pathologists
Research Ethics Committees
Therapeutics
Needles
Biopsy

Keywords

  • Bone marrow fibrosis
  • Digital imaging
  • Myelofibrosis
  • Myeloproliferative Neoplasms
  • Reticulin scoring

ASJC Scopus subject areas

  • Molecular Medicine
  • Pharmacology, Toxicology and Pharmaceutics(all)
  • Pharmacology (medical)

Cite this

Stereology and computer-based image analysis quantifies heterogeneity and improves reproducibility for grading reticulin in myeloproliferative neoplasms. / Salama, Mohamed; Hagendorn, Erik; Perkins, Sherrie L.; Kutok, Jeff L.; Etman, A.; Prchal, Josef T.; Potts, Steven J.

In: Methods in Pharmacology and Toxicology, Vol. 20, 01.01.2015, p. 117-126.

Research output: Contribution to journalArticle

Salama, Mohamed ; Hagendorn, Erik ; Perkins, Sherrie L. ; Kutok, Jeff L. ; Etman, A. ; Prchal, Josef T. ; Potts, Steven J. / Stereology and computer-based image analysis quantifies heterogeneity and improves reproducibility for grading reticulin in myeloproliferative neoplasms. In: Methods in Pharmacology and Toxicology. 2015 ; Vol. 20. pp. 117-126.
@article{8530a41d344e4461a80e880d87e45c0b,
title = "Stereology and computer-based image analysis quantifies heterogeneity and improves reproducibility for grading reticulin in myeloproliferative neoplasms",
abstract = "Evaluation of bone marrow fibrosis in myeloproliferative neoplasms (MPN) is subject to interobserver inconsistency, and cutpoints for determination of therapy are dependent on manual pathologist grading of reticulin. To provide a more consistent approach to cutpoint determination, we developed a stereologybased method of calculating length fiber density (the length of the fiber network divided by the volume of bone marrow hematopoietic tissue). Forty-eight thin needle core bone marrow biopsy samples from patients with MPN were obtained from the University of Utah archives after institutional review board approval and stained for reticulin and then scanned using whole slide imaging. To determine interpathologist concordance, the blinded cases were scored according to the European consensus system by four pathologists. Two pathologists scored twice with a 1-month washout period to determine intrapathologist concordance. Using systematic uniform random sampling and line counting, two techniques adapted from the stereology field, the length density of the reticulin network was measured as well as a measure of heterogeneity across the bone marrow sample. Image analysis was used to measure the area of the reticulin fiber as a two-dimensional profile. To build a model for predicting scoring by stereology, 16 samples were chosen randomly and a linear regression relationship determined. This score was then rounded to 0, 1, 2, or 3, and concordance rates between pathologists and between pathologist and the computer stereology score determined. Results: In the 48 patient cohort, stereology assessment was well correlated with the average of manual pathologist scoring (linear regression, R2=0.7038). While the European consensus scoring system ranges from 0 to 3, the cutpoint between 0/1 and 2/3 is generally used for guiding therapeutic decision as myelofibrosis. In 7 of the 48 cases (15{\%}), pathologists had differing scores across this cutpoint, meaning that the ultimate therapeutic outcome would have been impacted. The stereology score differed with the average of the pathologist scores in only 5 of the 48 cases across this cutpoint (10{\%}). Precision rates for the stereology analysis were 92{\%}, compared with interpathologist concordance ranging from 54.2 to 65.2{\%} and intrapathologist at 60.9{\%}. Computer-based stereology proved to be more reproducible at predicting therapeutic cutpoint than manual scoring. The new technique can be run using standard histochemistry and provides both a nonbiased systematic measure of reticulin and a new measure of reticulin heterogeneity.",
keywords = "Bone marrow fibrosis, Digital imaging, Myelofibrosis, Myeloproliferative Neoplasms, Reticulin scoring",
author = "Mohamed Salama and Erik Hagendorn and Perkins, {Sherrie L.} and Kutok, {Jeff L.} and A. Etman and Prchal, {Josef T.} and Potts, {Steven J.}",
year = "2015",
month = "1",
day = "1",
doi = "10.1007/7653_2014_36",
language = "English (US)",
volume = "20",
pages = "117--126",
journal = "Methods in Pharmacology and Toxicology",
issn = "1557-2153",
publisher = "Humana Press",

}

TY - JOUR

T1 - Stereology and computer-based image analysis quantifies heterogeneity and improves reproducibility for grading reticulin in myeloproliferative neoplasms

AU - Salama, Mohamed

AU - Hagendorn, Erik

AU - Perkins, Sherrie L.

AU - Kutok, Jeff L.

AU - Etman, A.

AU - Prchal, Josef T.

AU - Potts, Steven J.

PY - 2015/1/1

Y1 - 2015/1/1

N2 - Evaluation of bone marrow fibrosis in myeloproliferative neoplasms (MPN) is subject to interobserver inconsistency, and cutpoints for determination of therapy are dependent on manual pathologist grading of reticulin. To provide a more consistent approach to cutpoint determination, we developed a stereologybased method of calculating length fiber density (the length of the fiber network divided by the volume of bone marrow hematopoietic tissue). Forty-eight thin needle core bone marrow biopsy samples from patients with MPN were obtained from the University of Utah archives after institutional review board approval and stained for reticulin and then scanned using whole slide imaging. To determine interpathologist concordance, the blinded cases were scored according to the European consensus system by four pathologists. Two pathologists scored twice with a 1-month washout period to determine intrapathologist concordance. Using systematic uniform random sampling and line counting, two techniques adapted from the stereology field, the length density of the reticulin network was measured as well as a measure of heterogeneity across the bone marrow sample. Image analysis was used to measure the area of the reticulin fiber as a two-dimensional profile. To build a model for predicting scoring by stereology, 16 samples were chosen randomly and a linear regression relationship determined. This score was then rounded to 0, 1, 2, or 3, and concordance rates between pathologists and between pathologist and the computer stereology score determined. Results: In the 48 patient cohort, stereology assessment was well correlated with the average of manual pathologist scoring (linear regression, R2=0.7038). While the European consensus scoring system ranges from 0 to 3, the cutpoint between 0/1 and 2/3 is generally used for guiding therapeutic decision as myelofibrosis. In 7 of the 48 cases (15%), pathologists had differing scores across this cutpoint, meaning that the ultimate therapeutic outcome would have been impacted. The stereology score differed with the average of the pathologist scores in only 5 of the 48 cases across this cutpoint (10%). Precision rates for the stereology analysis were 92%, compared with interpathologist concordance ranging from 54.2 to 65.2% and intrapathologist at 60.9%. Computer-based stereology proved to be more reproducible at predicting therapeutic cutpoint than manual scoring. The new technique can be run using standard histochemistry and provides both a nonbiased systematic measure of reticulin and a new measure of reticulin heterogeneity.

AB - Evaluation of bone marrow fibrosis in myeloproliferative neoplasms (MPN) is subject to interobserver inconsistency, and cutpoints for determination of therapy are dependent on manual pathologist grading of reticulin. To provide a more consistent approach to cutpoint determination, we developed a stereologybased method of calculating length fiber density (the length of the fiber network divided by the volume of bone marrow hematopoietic tissue). Forty-eight thin needle core bone marrow biopsy samples from patients with MPN were obtained from the University of Utah archives after institutional review board approval and stained for reticulin and then scanned using whole slide imaging. To determine interpathologist concordance, the blinded cases were scored according to the European consensus system by four pathologists. Two pathologists scored twice with a 1-month washout period to determine intrapathologist concordance. Using systematic uniform random sampling and line counting, two techniques adapted from the stereology field, the length density of the reticulin network was measured as well as a measure of heterogeneity across the bone marrow sample. Image analysis was used to measure the area of the reticulin fiber as a two-dimensional profile. To build a model for predicting scoring by stereology, 16 samples were chosen randomly and a linear regression relationship determined. This score was then rounded to 0, 1, 2, or 3, and concordance rates between pathologists and between pathologist and the computer stereology score determined. Results: In the 48 patient cohort, stereology assessment was well correlated with the average of manual pathologist scoring (linear regression, R2=0.7038). While the European consensus scoring system ranges from 0 to 3, the cutpoint between 0/1 and 2/3 is generally used for guiding therapeutic decision as myelofibrosis. In 7 of the 48 cases (15%), pathologists had differing scores across this cutpoint, meaning that the ultimate therapeutic outcome would have been impacted. The stereology score differed with the average of the pathologist scores in only 5 of the 48 cases across this cutpoint (10%). Precision rates for the stereology analysis were 92%, compared with interpathologist concordance ranging from 54.2 to 65.2% and intrapathologist at 60.9%. Computer-based stereology proved to be more reproducible at predicting therapeutic cutpoint than manual scoring. The new technique can be run using standard histochemistry and provides both a nonbiased systematic measure of reticulin and a new measure of reticulin heterogeneity.

KW - Bone marrow fibrosis

KW - Digital imaging

KW - Myelofibrosis

KW - Myeloproliferative Neoplasms

KW - Reticulin scoring

UR - http://www.scopus.com/inward/record.url?scp=84935909301&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84935909301&partnerID=8YFLogxK

U2 - 10.1007/7653_2014_36

DO - 10.1007/7653_2014_36

M3 - Article

AN - SCOPUS:84935909301

VL - 20

SP - 117

EP - 126

JO - Methods in Pharmacology and Toxicology

JF - Methods in Pharmacology and Toxicology

SN - 1557-2153

ER -