TY - JOUR
T1 - Creating High Fidelity Synthetic Pelvis Radiographs Using Generative Adversarial Networks
T2 - Unlocking the Potential of Deep Learning Models Without Patient Privacy Concerns
AU - Khosravi, Bardia
AU - Rouzrokh, Pouria
AU - Mickley, John P.
AU - Faghani, Shahriar
AU - Larson, Annalise Noelle
AU - Garner, Hillary W.
AU - Howe, Benjamin M.
AU - Erickson, Bradley J.
AU - Taunton, Michael J.
AU - Wyles, Cody C.
N1 - Funding Information:
Funding: This work was supported by the Mayo Foundation Presidential fund , United States and the National Institutes of Health (NIH), United States [grant numbers R01AR73147 and P30AR76312 ].
Publisher Copyright:
© 2022 Elsevier Inc.
PY - 2023
Y1 - 2023
N2 - Background: In this work, we applied and validated an artificial intelligence technique known as generative adversarial networks (GANs) to create large volumes of high-fidelity synthetic anteroposterior (AP) pelvis radiographs that can enable deep learning (DL)-based image analyses, while ensuring patient privacy. Methods: AP pelvis radiographs with native hips were gathered from an institutional registry between 1998 and 2018. The data was used to train a model to create 512 × 512 pixel synthetic AP pelvis images. The network was trained on 25 million images produced through augmentation. A set of 100 random images (50/50 real/synthetic) was evaluated by 3 orthopaedic surgeons and 2 radiologists to discern real versus synthetic images. Two models (joint localization and segmentation) were trained using synthetic images and tested on real images. Results: The final model was trained on 37,640 real radiographs (16,782 patients). In a computer assessment of image fidelity, the final model achieved an “excellent” rating. In a blinded review of paired images (1 real, 1 synthetic), orthopaedic surgeon reviewers were unable to correctly identify which image was synthetic (accuracy = 55%, Kappa = 0.11), highlighting synthetic image fidelity. The synthetic and real images showed equivalent performance when they were assessed by established DL models. Conclusion: This work shows the ability to use a DL technique to generate a large volume of high-fidelity synthetic pelvis images not discernible from real imaging by computers or experts. These images can be used for cross-institutional sharing and model pretraining, further advancing the performance of DL models without risk to patient data safety. Level of Evidence: Level III.
AB - Background: In this work, we applied and validated an artificial intelligence technique known as generative adversarial networks (GANs) to create large volumes of high-fidelity synthetic anteroposterior (AP) pelvis radiographs that can enable deep learning (DL)-based image analyses, while ensuring patient privacy. Methods: AP pelvis radiographs with native hips were gathered from an institutional registry between 1998 and 2018. The data was used to train a model to create 512 × 512 pixel synthetic AP pelvis images. The network was trained on 25 million images produced through augmentation. A set of 100 random images (50/50 real/synthetic) was evaluated by 3 orthopaedic surgeons and 2 radiologists to discern real versus synthetic images. Two models (joint localization and segmentation) were trained using synthetic images and tested on real images. Results: The final model was trained on 37,640 real radiographs (16,782 patients). In a computer assessment of image fidelity, the final model achieved an “excellent” rating. In a blinded review of paired images (1 real, 1 synthetic), orthopaedic surgeon reviewers were unable to correctly identify which image was synthetic (accuracy = 55%, Kappa = 0.11), highlighting synthetic image fidelity. The synthetic and real images showed equivalent performance when they were assessed by established DL models. Conclusion: This work shows the ability to use a DL technique to generate a large volume of high-fidelity synthetic pelvis images not discernible from real imaging by computers or experts. These images can be used for cross-institutional sharing and model pretraining, further advancing the performance of DL models without risk to patient data safety. Level of Evidence: Level III.
KW - artificial intelligence
KW - deep learning
KW - generative adversarial networks
KW - patient privacy
KW - pelvis radiographs
KW - synthetic imaging
UR - http://www.scopus.com/inward/record.url?scp=85146019521&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85146019521&partnerID=8YFLogxK
U2 - 10.1016/j.arth.2022.12.013
DO - 10.1016/j.arth.2022.12.013
M3 - Article
C2 - 36535448
AN - SCOPUS:85146019521
SN - 0883-5403
JO - Journal of Arthroplasty
JF - Journal of Arthroplasty
ER -