New approach to 3-D registration of multimodality medical images by surface matching

Hongjian Jiang, Richard A. Robb, Kerrie S. Holton

Research output: Chapter in Book/Report/Conference proceedingConference contribution

153 Citations (Scopus)

Abstract

Multimodality images obtained from medical imaging systems such as computed tomography (CT), magnetic resonance (MR) imaging, positron emission tomography (PET), and single photon emission computed tomography (SPECT), generally provide complementary characteristic and diagnostic information. Synthesis of these image data sets into a single composite image containing these complementary attributes in accurate registration and congruence would provide truly synergistic information about the object(s) under examination. We have developed a new method which produces such correlation using parametric Chamfer matching. The method is fast, accurate, and reproducible. Surfaces ar initially extracted from two different images to be matched using semi-automatic segmentation techniques. These surfaces are represented as contours with common features to be matched. A distance transformation is performed for one surface image, and a cost function for the matching process is developed using the distance image. The geometric transformation includes three- dimensional translation, rotation, and scaling to accommodate images of different position, orientation, and size. The matching process involves searching this multi-parameter space to find the best fit which minimizes the cost function. The local minima problem is addressed by using a large number of starting points. A pyramid multi-resolution approach is employed to speed up both the distance transformation and the multi-parameter minimization processes. Robustness in noise handling is accomplished using multiple thresholds embedded in the multi- resolution search. The algorithm can register both partially overlapped and fragmented surfaces. Manual intervention is generally not necessary. Preliminary results suggest registration accuracy on the order of the voxel size used in the registration process. Computational time scales with the number of matching elements used, with about five minutes typical for 256 3 images using a modern desktop workstation.

Original languageEnglish (US)
Title of host publicationProceedings of SPIE - The International Society for Optical Engineering
Place of PublicationBellingham, WA, United States
PublisherPubl by Int Soc for Optical Engineering
Pages196-213
Number of pages18
Volume1808
ISBN (Print)081941008X
StatePublished - 1992
EventVisualization in Biomedical Computing '92 - Chapel Hill, NC, USA
Duration: Oct 13 1992Oct 16 1992

Other

OtherVisualization in Biomedical Computing '92
CityChapel Hill, NC, USA
Period10/13/9210/16/92

Fingerprint

Cost functions
Single photon emission computed tomography
Positron emission tomography
tomography
Medical imaging
Magnetic resonance
Imaging systems
Tomography
costs
Imaging techniques
congruences
workstations
registers
Composite materials
pyramids
magnetic resonance
positrons
examination
scaling
optimization

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Condensed Matter Physics

Cite this

Jiang, H., Robb, R. A., & Holton, K. S. (1992). New approach to 3-D registration of multimodality medical images by surface matching. In Proceedings of SPIE - The International Society for Optical Engineering (Vol. 1808, pp. 196-213). Bellingham, WA, United States: Publ by Int Soc for Optical Engineering.

New approach to 3-D registration of multimodality medical images by surface matching. / Jiang, Hongjian; Robb, Richard A.; Holton, Kerrie S.

Proceedings of SPIE - The International Society for Optical Engineering. Vol. 1808 Bellingham, WA, United States : Publ by Int Soc for Optical Engineering, 1992. p. 196-213.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Jiang, H, Robb, RA & Holton, KS 1992, New approach to 3-D registration of multimodality medical images by surface matching. in Proceedings of SPIE - The International Society for Optical Engineering. vol. 1808, Publ by Int Soc for Optical Engineering, Bellingham, WA, United States, pp. 196-213, Visualization in Biomedical Computing '92, Chapel Hill, NC, USA, 10/13/92.
Jiang H, Robb RA, Holton KS. New approach to 3-D registration of multimodality medical images by surface matching. In Proceedings of SPIE - The International Society for Optical Engineering. Vol. 1808. Bellingham, WA, United States: Publ by Int Soc for Optical Engineering. 1992. p. 196-213
Jiang, Hongjian ; Robb, Richard A. ; Holton, Kerrie S. / New approach to 3-D registration of multimodality medical images by surface matching. Proceedings of SPIE - The International Society for Optical Engineering. Vol. 1808 Bellingham, WA, United States : Publ by Int Soc for Optical Engineering, 1992. pp. 196-213
@inproceedings{a43f8afee4d647c59d0593656429c5f3,
title = "New approach to 3-D registration of multimodality medical images by surface matching",
abstract = "Multimodality images obtained from medical imaging systems such as computed tomography (CT), magnetic resonance (MR) imaging, positron emission tomography (PET), and single photon emission computed tomography (SPECT), generally provide complementary characteristic and diagnostic information. Synthesis of these image data sets into a single composite image containing these complementary attributes in accurate registration and congruence would provide truly synergistic information about the object(s) under examination. We have developed a new method which produces such correlation using parametric Chamfer matching. The method is fast, accurate, and reproducible. Surfaces ar initially extracted from two different images to be matched using semi-automatic segmentation techniques. These surfaces are represented as contours with common features to be matched. A distance transformation is performed for one surface image, and a cost function for the matching process is developed using the distance image. The geometric transformation includes three- dimensional translation, rotation, and scaling to accommodate images of different position, orientation, and size. The matching process involves searching this multi-parameter space to find the best fit which minimizes the cost function. The local minima problem is addressed by using a large number of starting points. A pyramid multi-resolution approach is employed to speed up both the distance transformation and the multi-parameter minimization processes. Robustness in noise handling is accomplished using multiple thresholds embedded in the multi- resolution search. The algorithm can register both partially overlapped and fragmented surfaces. Manual intervention is generally not necessary. Preliminary results suggest registration accuracy on the order of the voxel size used in the registration process. Computational time scales with the number of matching elements used, with about five minutes typical for 256 3 images using a modern desktop workstation.",
author = "Hongjian Jiang and Robb, {Richard A.} and Holton, {Kerrie S.}",
year = "1992",
language = "English (US)",
isbn = "081941008X",
volume = "1808",
pages = "196--213",
booktitle = "Proceedings of SPIE - The International Society for Optical Engineering",
publisher = "Publ by Int Soc for Optical Engineering",

}

TY - GEN

T1 - New approach to 3-D registration of multimodality medical images by surface matching

AU - Jiang, Hongjian

AU - Robb, Richard A.

AU - Holton, Kerrie S.

PY - 1992

Y1 - 1992

N2 - Multimodality images obtained from medical imaging systems such as computed tomography (CT), magnetic resonance (MR) imaging, positron emission tomography (PET), and single photon emission computed tomography (SPECT), generally provide complementary characteristic and diagnostic information. Synthesis of these image data sets into a single composite image containing these complementary attributes in accurate registration and congruence would provide truly synergistic information about the object(s) under examination. We have developed a new method which produces such correlation using parametric Chamfer matching. The method is fast, accurate, and reproducible. Surfaces ar initially extracted from two different images to be matched using semi-automatic segmentation techniques. These surfaces are represented as contours with common features to be matched. A distance transformation is performed for one surface image, and a cost function for the matching process is developed using the distance image. The geometric transformation includes three- dimensional translation, rotation, and scaling to accommodate images of different position, orientation, and size. The matching process involves searching this multi-parameter space to find the best fit which minimizes the cost function. The local minima problem is addressed by using a large number of starting points. A pyramid multi-resolution approach is employed to speed up both the distance transformation and the multi-parameter minimization processes. Robustness in noise handling is accomplished using multiple thresholds embedded in the multi- resolution search. The algorithm can register both partially overlapped and fragmented surfaces. Manual intervention is generally not necessary. Preliminary results suggest registration accuracy on the order of the voxel size used in the registration process. Computational time scales with the number of matching elements used, with about five minutes typical for 256 3 images using a modern desktop workstation.

AB - Multimodality images obtained from medical imaging systems such as computed tomography (CT), magnetic resonance (MR) imaging, positron emission tomography (PET), and single photon emission computed tomography (SPECT), generally provide complementary characteristic and diagnostic information. Synthesis of these image data sets into a single composite image containing these complementary attributes in accurate registration and congruence would provide truly synergistic information about the object(s) under examination. We have developed a new method which produces such correlation using parametric Chamfer matching. The method is fast, accurate, and reproducible. Surfaces ar initially extracted from two different images to be matched using semi-automatic segmentation techniques. These surfaces are represented as contours with common features to be matched. A distance transformation is performed for one surface image, and a cost function for the matching process is developed using the distance image. The geometric transformation includes three- dimensional translation, rotation, and scaling to accommodate images of different position, orientation, and size. The matching process involves searching this multi-parameter space to find the best fit which minimizes the cost function. The local minima problem is addressed by using a large number of starting points. A pyramid multi-resolution approach is employed to speed up both the distance transformation and the multi-parameter minimization processes. Robustness in noise handling is accomplished using multiple thresholds embedded in the multi- resolution search. The algorithm can register both partially overlapped and fragmented surfaces. Manual intervention is generally not necessary. Preliminary results suggest registration accuracy on the order of the voxel size used in the registration process. Computational time scales with the number of matching elements used, with about five minutes typical for 256 3 images using a modern desktop workstation.

UR - http://www.scopus.com/inward/record.url?scp=0026994610&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0026994610&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:0026994610

SN - 081941008X

VL - 1808

SP - 196

EP - 213

BT - Proceedings of SPIE - The International Society for Optical Engineering

PB - Publ by Int Soc for Optical Engineering

CY - Bellingham, WA, United States

ER -