Reliability of histopathologic and radiologic grading of cartilaginous neoplasms in long bones

Kevin B. Jones, Joseph A. Buckwalter, Edward F. McCarthy, Barry R. DeYoung, Georges Y. El-Khoury, Lou Dolan, Francis H. Gannon, Carrie Y. Inwards, Michael J. Klein, Michael Kyriakus, Andrew E. Rosenberg, Gene P. Siegal, K. Krishnan Unni, Laura Fayad, Mark J. Kransdorf, Mark D. Murphey, David M. Panicek, David A. Rubin, Murali Sundararri, Daniel Vanel

Research output: Contribution to journalArticle

101 Citations (Scopus)

Abstract

Background: Providing the best treatment options and appropriate prognostic information to patients with cartilaginous neoplasms of long bones depends on distinguishing benign from malignant lesions. Correlative interpretation of imaging, histopathology, and clinical information is the current method for making this distinction, yet the reliability of this approach has not been critically evaluated. This study quantifies the interobserver reliability of the determination of grade for cartilaginous neoplasms among a group of experienced musculoskeletal pathologists and radiologists. Methods: Nine recognized musculoskeletal pathologists and eight recognized musculoskeletal radiologists reviewed forty-six consecutive cases of cartilaginous lesions in long bones that underwent open biopsy or intralesional curettage. All diagnosticians had a bulleted history and preoperative conventional radiographs for review. Pathologists reviewed the original hematoxylin and eosin-stained glass slides from each case. Radiologists reviewed any additional imaging that was available, variably including serial radiographs, magnetic resonance imaging, and computed tomography scans. Each diagnostician classified a lesion as benign, low-grade malignant, or high-grade malignant. Kappa coefficients were calculated as a measure of reliability. Results: Kappa coefficients for interrater reliability were 0.443 for the pathologists and 0.345 for the radiologists (p < 0.0001 for both). Kappa coefficients for a subgroup of cases determined to be high risk by subsequent clinical course were poorer at 0.236 and 0.206, respectively (p < 0.0001 for both). Slightly improved agreement among radiologists was noted for the twenty lesions that had magnetic resonance imaging available (Kappa = 0.437, p < 0.0001), but not for the lesions analyzed with serial plain radiographs or computed tomography scans. Conclusions: This study demonstrates low reliability for the grading of cartilaginous lesions in long bones, even among specialized and experienced pathologists and radiologists. This included low reliability both in differentiating benign from malignant lesions and in differentiating high-grade from low-grade malignant lesions, both of which are critical to the safe treatment of these neoplasms. This may explain in part the wide variation in outcomes reported for chondrosarcomas treated in different medical centers. New diagnostic and grading strategies linked to protocoldriven treatments are needed, but they must be measured against the long-term gold standard of patient outcomes.

Original languageEnglish (US)
Pages (from-to)2113-2123
Number of pages11
JournalJournal of Bone and Joint Surgery - Series A
Volume89
Issue number10
DOIs
StatePublished - Oct 2007

Fingerprint

Neoplasm Grading
Bone and Bones
Tomography
Magnetic Resonance Imaging
Bone Neoplasms
Chondrosarcoma
Curettage
Hematoxylin
Eosine Yellowish-(YS)
Glass
Radiologists
Neoplasms
Therapeutics
History
Pathologists
Biopsy

ASJC Scopus subject areas

  • Surgery
  • Orthopedics and Sports Medicine

Cite this

Jones, K. B., Buckwalter, J. A., McCarthy, E. F., DeYoung, B. R., El-Khoury, G. Y., Dolan, L., ... Vanel, D. (2007). Reliability of histopathologic and radiologic grading of cartilaginous neoplasms in long bones. Journal of Bone and Joint Surgery - Series A, 89(10), 2113-2123. https://doi.org/10.2106/JBJS.F.01530

Reliability of histopathologic and radiologic grading of cartilaginous neoplasms in long bones. / Jones, Kevin B.; Buckwalter, Joseph A.; McCarthy, Edward F.; DeYoung, Barry R.; El-Khoury, Georges Y.; Dolan, Lou; Gannon, Francis H.; Inwards, Carrie Y.; Klein, Michael J.; Kyriakus, Michael; Rosenberg, Andrew E.; Siegal, Gene P.; Unni, K. Krishnan; Fayad, Laura; Kransdorf, Mark J.; Murphey, Mark D.; Panicek, David M.; Rubin, David A.; Sundararri, Murali; Vanel, Daniel.

In: Journal of Bone and Joint Surgery - Series A, Vol. 89, No. 10, 10.2007, p. 2113-2123.

Research output: Contribution to journalArticle

Jones, KB, Buckwalter, JA, McCarthy, EF, DeYoung, BR, El-Khoury, GY, Dolan, L, Gannon, FH, Inwards, CY, Klein, MJ, Kyriakus, M, Rosenberg, AE, Siegal, GP, Unni, KK, Fayad, L, Kransdorf, MJ, Murphey, MD, Panicek, DM, Rubin, DA, Sundararri, M & Vanel, D 2007, 'Reliability of histopathologic and radiologic grading of cartilaginous neoplasms in long bones', Journal of Bone and Joint Surgery - Series A, vol. 89, no. 10, pp. 2113-2123. https://doi.org/10.2106/JBJS.F.01530
Jones, Kevin B. ; Buckwalter, Joseph A. ; McCarthy, Edward F. ; DeYoung, Barry R. ; El-Khoury, Georges Y. ; Dolan, Lou ; Gannon, Francis H. ; Inwards, Carrie Y. ; Klein, Michael J. ; Kyriakus, Michael ; Rosenberg, Andrew E. ; Siegal, Gene P. ; Unni, K. Krishnan ; Fayad, Laura ; Kransdorf, Mark J. ; Murphey, Mark D. ; Panicek, David M. ; Rubin, David A. ; Sundararri, Murali ; Vanel, Daniel. / Reliability of histopathologic and radiologic grading of cartilaginous neoplasms in long bones. In: Journal of Bone and Joint Surgery - Series A. 2007 ; Vol. 89, No. 10. pp. 2113-2123.
@article{b739d5134a8a44cdbf3e65c3f09027dd,
title = "Reliability of histopathologic and radiologic grading of cartilaginous neoplasms in long bones",
abstract = "Background: Providing the best treatment options and appropriate prognostic information to patients with cartilaginous neoplasms of long bones depends on distinguishing benign from malignant lesions. Correlative interpretation of imaging, histopathology, and clinical information is the current method for making this distinction, yet the reliability of this approach has not been critically evaluated. This study quantifies the interobserver reliability of the determination of grade for cartilaginous neoplasms among a group of experienced musculoskeletal pathologists and radiologists. Methods: Nine recognized musculoskeletal pathologists and eight recognized musculoskeletal radiologists reviewed forty-six consecutive cases of cartilaginous lesions in long bones that underwent open biopsy or intralesional curettage. All diagnosticians had a bulleted history and preoperative conventional radiographs for review. Pathologists reviewed the original hematoxylin and eosin-stained glass slides from each case. Radiologists reviewed any additional imaging that was available, variably including serial radiographs, magnetic resonance imaging, and computed tomography scans. Each diagnostician classified a lesion as benign, low-grade malignant, or high-grade malignant. Kappa coefficients were calculated as a measure of reliability. Results: Kappa coefficients for interrater reliability were 0.443 for the pathologists and 0.345 for the radiologists (p < 0.0001 for both). Kappa coefficients for a subgroup of cases determined to be high risk by subsequent clinical course were poorer at 0.236 and 0.206, respectively (p < 0.0001 for both). Slightly improved agreement among radiologists was noted for the twenty lesions that had magnetic resonance imaging available (Kappa = 0.437, p < 0.0001), but not for the lesions analyzed with serial plain radiographs or computed tomography scans. Conclusions: This study demonstrates low reliability for the grading of cartilaginous lesions in long bones, even among specialized and experienced pathologists and radiologists. This included low reliability both in differentiating benign from malignant lesions and in differentiating high-grade from low-grade malignant lesions, both of which are critical to the safe treatment of these neoplasms. This may explain in part the wide variation in outcomes reported for chondrosarcomas treated in different medical centers. New diagnostic and grading strategies linked to protocoldriven treatments are needed, but they must be measured against the long-term gold standard of patient outcomes.",
author = "Jones, {Kevin B.} and Buckwalter, {Joseph A.} and McCarthy, {Edward F.} and DeYoung, {Barry R.} and El-Khoury, {Georges Y.} and Lou Dolan and Gannon, {Francis H.} and Inwards, {Carrie Y.} and Klein, {Michael J.} and Michael Kyriakus and Rosenberg, {Andrew E.} and Siegal, {Gene P.} and Unni, {K. Krishnan} and Laura Fayad and Kransdorf, {Mark J.} and Murphey, {Mark D.} and Panicek, {David M.} and Rubin, {David A.} and Murali Sundararri and Daniel Vanel",
year = "2007",
month = "10",
doi = "10.2106/JBJS.F.01530",
language = "English (US)",
volume = "89",
pages = "2113--2123",
journal = "Journal of Bone and Joint Surgery - American Volume",
issn = "0021-9355",
publisher = "Journal of Bone and Joint Surgery Inc.",
number = "10",

}

TY - JOUR

T1 - Reliability of histopathologic and radiologic grading of cartilaginous neoplasms in long bones

AU - Jones, Kevin B.

AU - Buckwalter, Joseph A.

AU - McCarthy, Edward F.

AU - DeYoung, Barry R.

AU - El-Khoury, Georges Y.

AU - Dolan, Lou

AU - Gannon, Francis H.

AU - Inwards, Carrie Y.

AU - Klein, Michael J.

AU - Kyriakus, Michael

AU - Rosenberg, Andrew E.

AU - Siegal, Gene P.

AU - Unni, K. Krishnan

AU - Fayad, Laura

AU - Kransdorf, Mark J.

AU - Murphey, Mark D.

AU - Panicek, David M.

AU - Rubin, David A.

AU - Sundararri, Murali

AU - Vanel, Daniel

PY - 2007/10

Y1 - 2007/10

N2 - Background: Providing the best treatment options and appropriate prognostic information to patients with cartilaginous neoplasms of long bones depends on distinguishing benign from malignant lesions. Correlative interpretation of imaging, histopathology, and clinical information is the current method for making this distinction, yet the reliability of this approach has not been critically evaluated. This study quantifies the interobserver reliability of the determination of grade for cartilaginous neoplasms among a group of experienced musculoskeletal pathologists and radiologists. Methods: Nine recognized musculoskeletal pathologists and eight recognized musculoskeletal radiologists reviewed forty-six consecutive cases of cartilaginous lesions in long bones that underwent open biopsy or intralesional curettage. All diagnosticians had a bulleted history and preoperative conventional radiographs for review. Pathologists reviewed the original hematoxylin and eosin-stained glass slides from each case. Radiologists reviewed any additional imaging that was available, variably including serial radiographs, magnetic resonance imaging, and computed tomography scans. Each diagnostician classified a lesion as benign, low-grade malignant, or high-grade malignant. Kappa coefficients were calculated as a measure of reliability. Results: Kappa coefficients for interrater reliability were 0.443 for the pathologists and 0.345 for the radiologists (p < 0.0001 for both). Kappa coefficients for a subgroup of cases determined to be high risk by subsequent clinical course were poorer at 0.236 and 0.206, respectively (p < 0.0001 for both). Slightly improved agreement among radiologists was noted for the twenty lesions that had magnetic resonance imaging available (Kappa = 0.437, p < 0.0001), but not for the lesions analyzed with serial plain radiographs or computed tomography scans. Conclusions: This study demonstrates low reliability for the grading of cartilaginous lesions in long bones, even among specialized and experienced pathologists and radiologists. This included low reliability both in differentiating benign from malignant lesions and in differentiating high-grade from low-grade malignant lesions, both of which are critical to the safe treatment of these neoplasms. This may explain in part the wide variation in outcomes reported for chondrosarcomas treated in different medical centers. New diagnostic and grading strategies linked to protocoldriven treatments are needed, but they must be measured against the long-term gold standard of patient outcomes.

AB - Background: Providing the best treatment options and appropriate prognostic information to patients with cartilaginous neoplasms of long bones depends on distinguishing benign from malignant lesions. Correlative interpretation of imaging, histopathology, and clinical information is the current method for making this distinction, yet the reliability of this approach has not been critically evaluated. This study quantifies the interobserver reliability of the determination of grade for cartilaginous neoplasms among a group of experienced musculoskeletal pathologists and radiologists. Methods: Nine recognized musculoskeletal pathologists and eight recognized musculoskeletal radiologists reviewed forty-six consecutive cases of cartilaginous lesions in long bones that underwent open biopsy or intralesional curettage. All diagnosticians had a bulleted history and preoperative conventional radiographs for review. Pathologists reviewed the original hematoxylin and eosin-stained glass slides from each case. Radiologists reviewed any additional imaging that was available, variably including serial radiographs, magnetic resonance imaging, and computed tomography scans. Each diagnostician classified a lesion as benign, low-grade malignant, or high-grade malignant. Kappa coefficients were calculated as a measure of reliability. Results: Kappa coefficients for interrater reliability were 0.443 for the pathologists and 0.345 for the radiologists (p < 0.0001 for both). Kappa coefficients for a subgroup of cases determined to be high risk by subsequent clinical course were poorer at 0.236 and 0.206, respectively (p < 0.0001 for both). Slightly improved agreement among radiologists was noted for the twenty lesions that had magnetic resonance imaging available (Kappa = 0.437, p < 0.0001), but not for the lesions analyzed with serial plain radiographs or computed tomography scans. Conclusions: This study demonstrates low reliability for the grading of cartilaginous lesions in long bones, even among specialized and experienced pathologists and radiologists. This included low reliability both in differentiating benign from malignant lesions and in differentiating high-grade from low-grade malignant lesions, both of which are critical to the safe treatment of these neoplasms. This may explain in part the wide variation in outcomes reported for chondrosarcomas treated in different medical centers. New diagnostic and grading strategies linked to protocoldriven treatments are needed, but they must be measured against the long-term gold standard of patient outcomes.

UR - http://www.scopus.com/inward/record.url?scp=35348959857&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=35348959857&partnerID=8YFLogxK

U2 - 10.2106/JBJS.F.01530

DO - 10.2106/JBJS.F.01530

M3 - Article

C2 - 17908885

AN - SCOPUS:35348959857

VL - 89

SP - 2113

EP - 2123

JO - Journal of Bone and Joint Surgery - American Volume

JF - Journal of Bone and Joint Surgery - American Volume

SN - 0021-9355

IS - 10

ER -