TY - JOUR
T1 - The RSNA International COVID-19 Open Radiology Database (RICORD)
AU - Tsai, Emily B.
AU - Simpson, Scott
AU - Lungren, Matthew P.
AU - Hershman, Michelle
AU - Roshkovan, Leonid
AU - Colak, Errol
AU - Erickson, Bradley J.
AU - Shih, George
AU - Stein, Anouk
AU - Kalpathy-Cramer, Jayashree
AU - Shen, Jody
AU - Hafez, Mona
AU - John, Susan
AU - Rajiah, Prabhakar
AU - Pogatchnik, Brian P.
AU - Mongan, John
AU - Altinmakas, Emre
AU - Ranschaert, Erik R.
AU - Kitamura, Felipe C.
AU - Topff, Laurens
AU - Moy, Linda
AU - Kanne, Jeffrey P.
AU - Wu, Carol C.
N1 - Funding Information:
disclosed no relevant relationships. M.P.L. Activities related to the present article: disclosed no relevant relationships. Activities not related to the present article: received compensation for board membership from Nines Radiology, Segmed, BunkerHill, and Carestream; received compensation from Bayer for consulting work; has stock or stock options in Nines Radiology, Segmed, BunkerHill, and Centaur. Other relationships: disclosed no relevant relationships. M. Hershman disclosed no relevant relationships. L.R. disclosed no relevant relationships. E.C. disclosed no relevant relationships. B.J.E. disclosed no relevant relationships. G.S. Activities related to the present article: disclosed no relevant relationships. Activities not related to the present article: is a board member and consultant for MD.ai (no compensation received to date); has stock or stock options in MD.ai. Other relationships: disclosed no relevant relationships. A.S. disclosed no relevant relationships. J.K.C. Activities related to the present article: institution received a grant from the National Institutes of Health. Activities not related to the present article: institution received or will receive grants from the National Institutes of Health, National Science Foundation, and GE; received reimbursement for travel and meeting expenses from IBM; serves as deputy editor of Radiology: Artificial Intelligence. Other relationships: disclosed no relevant relationships. J.S. disclosed no relevant relationships. M. Hafez disclosed no relevant relationships. S.J. disclosed no relevant relationships. P.R. Activities related to the present article: disclosed no relevant relationships. Activities not related to the present article: receives royalties from Elsevier/Amirsys. Other relationships: disclosed no relevant relationships. B.P.P. disclosed no relevant relationships. J.M. Activities related to the present article: disclosed no relevant relationships. Activities not related to the present article: institution received or will receive grants from GE and Nuance. Other relationships: disclosed no relevant relationships. E.A. disclosed no relevant relationships. E.R.R. disclosed no relevant relationships. F.C.K. Activities related to the present article: disclosed no relevant relationships. Activities not related to the present article: received compensation from MD.ai for consulting; is employed by Diagnósticos da América. Other relationships: disclosed no relevant relationships. L.T. disclosed no relevant relationships. L.M. Activities related to the present article: disclosed no relevant relationships. Activities not related to the present article: received compensation from Lunit and iCAD for board membership; institution received or will receive grant(s) from Siemens; has stock or stock options in Lunit. Other relationships: disclosed no relevant relationships. J.P.K. Activities related to the present article: disclosed no relevant relationships. Activities not related to the present article: received compensation from Parexel International for consulting. Other relationships: disclosed no relevant relationships. C.C.W. Activities related to the present article: disclosed no relevant relationships.
Publisher Copyright:
© RSNA, 2021
PY - 2021/4
Y1 - 2021/4
N2 - The coronavirus disease 2019 (COVID-19) pandemic is a global health care emergency. Although reverse-transcription polymerase chain reaction testing is the reference standard method to identify patients with COVID-19 infection, chest radiography and CT play a vital role in the detection and management of these patients. Prediction models for COVID-19 imaging are rapidly being developed to support medical decision making. However, inadequate availability of a diverse annotated data set has limited the performance and generalizability of existing models. To address this unmet need, the RSNA and Society of Thoracic Radiology collaborated to develop the RSNA International COVID-19 Open Radiology Database (RICORD). This database is the first multi-institutional, multinational, expert-annotated COVID-19 imaging data set. It is made freely available to the machine learning community as a research and educational resource for COVID-19 chest imaging. Pixel-level volumetric segmentation with clinical annotations was performed by thoracic radiology subspecialists for all COVID-19–positive thoracic CT scans. The labeling schema was coordinated with other international consensus panels and COVID-19 data annotation efforts, the European Society of Medical Imaging Informatics, the American College of Radiology, and the American Association of Physicists in Medicine. Study-level COVID-19 classification labels for chest radiographs were annotated by three radiologists, with majority vote adjudication by board-certified radiologists. RICORD consists of 240 thoracic CT scans and 1000 chest radiographs contributed from four international sites. It is anticipated that RICORD will ideally lead to prediction models that can demonstrate sustained performance across populations and health care systems.
AB - The coronavirus disease 2019 (COVID-19) pandemic is a global health care emergency. Although reverse-transcription polymerase chain reaction testing is the reference standard method to identify patients with COVID-19 infection, chest radiography and CT play a vital role in the detection and management of these patients. Prediction models for COVID-19 imaging are rapidly being developed to support medical decision making. However, inadequate availability of a diverse annotated data set has limited the performance and generalizability of existing models. To address this unmet need, the RSNA and Society of Thoracic Radiology collaborated to develop the RSNA International COVID-19 Open Radiology Database (RICORD). This database is the first multi-institutional, multinational, expert-annotated COVID-19 imaging data set. It is made freely available to the machine learning community as a research and educational resource for COVID-19 chest imaging. Pixel-level volumetric segmentation with clinical annotations was performed by thoracic radiology subspecialists for all COVID-19–positive thoracic CT scans. The labeling schema was coordinated with other international consensus panels and COVID-19 data annotation efforts, the European Society of Medical Imaging Informatics, the American College of Radiology, and the American Association of Physicists in Medicine. Study-level COVID-19 classification labels for chest radiographs were annotated by three radiologists, with majority vote adjudication by board-certified radiologists. RICORD consists of 240 thoracic CT scans and 1000 chest radiographs contributed from four international sites. It is anticipated that RICORD will ideally lead to prediction models that can demonstrate sustained performance across populations and health care systems.
UR - http://www.scopus.com/inward/record.url?scp=85103473822&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85103473822&partnerID=8YFLogxK
U2 - 10.1148/RADIOL.2021203957
DO - 10.1148/RADIOL.2021203957
M3 - Article
C2 - 33399506
AN - SCOPUS:85103473822
SN - 0033-8419
VL - 299
SP - E204-E213
JO - Radiology
JF - Radiology
IS - 1
ER -