Medical imaging and virtual reality: A personal perspective

Richard A. Robb

Research output: Contribution to journalArticle

5 Citations (Scopus)

Abstract

The evolution of medical imaging, and concomitantly virtual reality (VR) technology, especially over the past 2-3 decades, has significantly accelerated the use of multi-modality images and VR instrumentation in guiding medical procedures, including surgery. The imaging capabilities have not only increased in variety of modalities (CT, MRI, PET, ultrasound, etc.), but also in dimensions and resolution. It is becoming more common to talk about 3D, 4D and even 5D images produced by modern imaging modalities. However, a relatively unexploited potential and capability of this increase in multimodality, multidimensional image data is the synergistic fusion of these datasets into a unified form that describes more accurately and extensively the complex nature of human anatomy, physiology, biology and pathology. The assist in achieving this potential, through realistic simulation, training, rehearsal and delivery of surgery and other interventional procedures by use of VR technology, has been increasingly evident, particularly in education. This paper attempts an overview of this potential, describing the evolution of medical imaging systems and VR that has lead to development of powerful computational techniques to fuse, visualize, analyze and use these images for advanced use in medical practice. This overview is based primarily on the author's experience, opinion and perspective, explaining the preponderance of citations to his own work. A brief history of medical imaging and VR, a description of current imaging systems, and a summary of important image processing methods used in image-guided interventions will be given. Examples of use of these methods on several types of multidimensional image datasets will be illustrated, and several examples of real clinical applications described using 3D, 4D and 5D fused image datasets and VR technology for image-guided interventions, image-guided surgery, and image-guided therapy. Finally, the paper will discuss some barriers to progress and provide some prognostic views on the promising future of image-guided medical procedures and surgical interventions.

Original languageEnglish (US)
Pages (from-to)235-257
Number of pages23
JournalVirtual Reality
Volume12
Issue number4
DOIs
StatePublished - 2008

Fingerprint

Medical imaging
Virtual reality
Surgery
Imaging systems
Imaging techniques
Physiology
Pathology
Electric fuses
Magnetic resonance imaging
Image processing
Fusion reactions
Education
Ultrasonics

Keywords

  • Evolution of imaging
  • Image fusion
  • Image modeling
  • Image visualization
  • Multi-dimensional imaging
  • Multi-modality imaging
  • Virtual reality technology

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Human-Computer Interaction
  • Software

Cite this

Medical imaging and virtual reality : A personal perspective. / Robb, Richard A.

In: Virtual Reality, Vol. 12, No. 4, 2008, p. 235-257.

Research output: Contribution to journalArticle

Robb, Richard A. / Medical imaging and virtual reality : A personal perspective. In: Virtual Reality. 2008 ; Vol. 12, No. 4. pp. 235-257.
@article{9fba288688cd459e96e02a3d5ef193e2,
title = "Medical imaging and virtual reality: A personal perspective",
abstract = "The evolution of medical imaging, and concomitantly virtual reality (VR) technology, especially over the past 2-3 decades, has significantly accelerated the use of multi-modality images and VR instrumentation in guiding medical procedures, including surgery. The imaging capabilities have not only increased in variety of modalities (CT, MRI, PET, ultrasound, etc.), but also in dimensions and resolution. It is becoming more common to talk about 3D, 4D and even 5D images produced by modern imaging modalities. However, a relatively unexploited potential and capability of this increase in multimodality, multidimensional image data is the synergistic fusion of these datasets into a unified form that describes more accurately and extensively the complex nature of human anatomy, physiology, biology and pathology. The assist in achieving this potential, through realistic simulation, training, rehearsal and delivery of surgery and other interventional procedures by use of VR technology, has been increasingly evident, particularly in education. This paper attempts an overview of this potential, describing the evolution of medical imaging systems and VR that has lead to development of powerful computational techniques to fuse, visualize, analyze and use these images for advanced use in medical practice. This overview is based primarily on the author's experience, opinion and perspective, explaining the preponderance of citations to his own work. A brief history of medical imaging and VR, a description of current imaging systems, and a summary of important image processing methods used in image-guided interventions will be given. Examples of use of these methods on several types of multidimensional image datasets will be illustrated, and several examples of real clinical applications described using 3D, 4D and 5D fused image datasets and VR technology for image-guided interventions, image-guided surgery, and image-guided therapy. Finally, the paper will discuss some barriers to progress and provide some prognostic views on the promising future of image-guided medical procedures and surgical interventions.",
keywords = "Evolution of imaging, Image fusion, Image modeling, Image visualization, Multi-dimensional imaging, Multi-modality imaging, Virtual reality technology",
author = "Robb, {Richard A.}",
year = "2008",
doi = "10.1007/s10055-008-0104-z",
language = "English (US)",
volume = "12",
pages = "235--257",
journal = "Virtual Reality",
issn = "1359-4338",
publisher = "Springer London",
number = "4",

}

TY - JOUR

T1 - Medical imaging and virtual reality

T2 - A personal perspective

AU - Robb, Richard A.

PY - 2008

Y1 - 2008

N2 - The evolution of medical imaging, and concomitantly virtual reality (VR) technology, especially over the past 2-3 decades, has significantly accelerated the use of multi-modality images and VR instrumentation in guiding medical procedures, including surgery. The imaging capabilities have not only increased in variety of modalities (CT, MRI, PET, ultrasound, etc.), but also in dimensions and resolution. It is becoming more common to talk about 3D, 4D and even 5D images produced by modern imaging modalities. However, a relatively unexploited potential and capability of this increase in multimodality, multidimensional image data is the synergistic fusion of these datasets into a unified form that describes more accurately and extensively the complex nature of human anatomy, physiology, biology and pathology. The assist in achieving this potential, through realistic simulation, training, rehearsal and delivery of surgery and other interventional procedures by use of VR technology, has been increasingly evident, particularly in education. This paper attempts an overview of this potential, describing the evolution of medical imaging systems and VR that has lead to development of powerful computational techniques to fuse, visualize, analyze and use these images for advanced use in medical practice. This overview is based primarily on the author's experience, opinion and perspective, explaining the preponderance of citations to his own work. A brief history of medical imaging and VR, a description of current imaging systems, and a summary of important image processing methods used in image-guided interventions will be given. Examples of use of these methods on several types of multidimensional image datasets will be illustrated, and several examples of real clinical applications described using 3D, 4D and 5D fused image datasets and VR technology for image-guided interventions, image-guided surgery, and image-guided therapy. Finally, the paper will discuss some barriers to progress and provide some prognostic views on the promising future of image-guided medical procedures and surgical interventions.

AB - The evolution of medical imaging, and concomitantly virtual reality (VR) technology, especially over the past 2-3 decades, has significantly accelerated the use of multi-modality images and VR instrumentation in guiding medical procedures, including surgery. The imaging capabilities have not only increased in variety of modalities (CT, MRI, PET, ultrasound, etc.), but also in dimensions and resolution. It is becoming more common to talk about 3D, 4D and even 5D images produced by modern imaging modalities. However, a relatively unexploited potential and capability of this increase in multimodality, multidimensional image data is the synergistic fusion of these datasets into a unified form that describes more accurately and extensively the complex nature of human anatomy, physiology, biology and pathology. The assist in achieving this potential, through realistic simulation, training, rehearsal and delivery of surgery and other interventional procedures by use of VR technology, has been increasingly evident, particularly in education. This paper attempts an overview of this potential, describing the evolution of medical imaging systems and VR that has lead to development of powerful computational techniques to fuse, visualize, analyze and use these images for advanced use in medical practice. This overview is based primarily on the author's experience, opinion and perspective, explaining the preponderance of citations to his own work. A brief history of medical imaging and VR, a description of current imaging systems, and a summary of important image processing methods used in image-guided interventions will be given. Examples of use of these methods on several types of multidimensional image datasets will be illustrated, and several examples of real clinical applications described using 3D, 4D and 5D fused image datasets and VR technology for image-guided interventions, image-guided surgery, and image-guided therapy. Finally, the paper will discuss some barriers to progress and provide some prognostic views on the promising future of image-guided medical procedures and surgical interventions.

KW - Evolution of imaging

KW - Image fusion

KW - Image modeling

KW - Image visualization

KW - Multi-dimensional imaging

KW - Multi-modality imaging

KW - Virtual reality technology

UR - http://www.scopus.com/inward/record.url?scp=57749085430&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=57749085430&partnerID=8YFLogxK

U2 - 10.1007/s10055-008-0104-z

DO - 10.1007/s10055-008-0104-z

M3 - Article

AN - SCOPUS:57749085430

VL - 12

SP - 235

EP - 257

JO - Virtual Reality

JF - Virtual Reality

SN - 1359-4338

IS - 4

ER -