TY - GEN
T1 - Introducing space and time in local feature-based endomicroscopic image retrieval
AU - André, Barbara
AU - Vercauteren, Tom
AU - Perchant, Aymeric
AU - Buchner, Anna M.
AU - Wallace, Michael B.
AU - Ayache, Nicholas
PY - 2010
Y1 - 2010
N2 - Interpreting endomicroscopic images is still a significant challenge, especially since one single still image may not always contain enough information to make a robust diagnosis. To aid the physicians, we investigated some local feature-based retrieval methods that provide, given a query image, similar annotated images from a database of endomicroscopic images combined with high-level diagnosis represented as textual information. Local feature-based methods may be limited by the small field of view (FOV) of endomicroscopy and the fact that they do not take into account the spatial relationship between the local features, and the time relationship between successive images of the video sequences. To extract discriminative information over the entire image field, our proposed method collects local features in a dense manner instead of using a standard salient region detector. After the retrieval process, we introduce a verification step driven by the textual information in the database and in which spatial relationship between the local features is used. A spatial criterion is built from the co-occurence matrix of local features and used to remove outliers by thresholding on this criterion. To overcome the small-FOV problem and take advantage of the video sequence, we propose to combine image retrieval and mosaicing. Mosaicing essentially projects the temporal dimension onto a large field of view image. In this framework, videos, represented by mosaics, and single images can be retrieved with the same tools. With a leave-n-out cross-validation, our results show that taking into account the spatial relationship between local features and the temporal information of endomicroscopic videos by image mosaicing improves the retrieval accuracy.
AB - Interpreting endomicroscopic images is still a significant challenge, especially since one single still image may not always contain enough information to make a robust diagnosis. To aid the physicians, we investigated some local feature-based retrieval methods that provide, given a query image, similar annotated images from a database of endomicroscopic images combined with high-level diagnosis represented as textual information. Local feature-based methods may be limited by the small field of view (FOV) of endomicroscopy and the fact that they do not take into account the spatial relationship between the local features, and the time relationship between successive images of the video sequences. To extract discriminative information over the entire image field, our proposed method collects local features in a dense manner instead of using a standard salient region detector. After the retrieval process, we introduce a verification step driven by the textual information in the database and in which spatial relationship between the local features is used. A spatial criterion is built from the co-occurence matrix of local features and used to remove outliers by thresholding on this criterion. To overcome the small-FOV problem and take advantage of the video sequence, we propose to combine image retrieval and mosaicing. Mosaicing essentially projects the temporal dimension onto a large field of view image. In this framework, videos, represented by mosaics, and single images can be retrieved with the same tools. With a leave-n-out cross-validation, our results show that taking into account the spatial relationship between local features and the temporal information of endomicroscopic videos by image mosaicing improves the retrieval accuracy.
UR - http://www.scopus.com/inward/record.url?scp=77951102932&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=77951102932&partnerID=8YFLogxK
U2 - 10.1007/978-3-642-11769-5_2
DO - 10.1007/978-3-642-11769-5_2
M3 - Conference contribution
AN - SCOPUS:77951102932
SN - 3642117686
SN - 9783642117688
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 18
EP - 30
BT - Medical Content-Based Retrieval for Clinical Decision Support - First MICCAI International Workshop, MCBR-CDS 2009, Revised Selected Papers
T2 - 1st MICCAI International Workshop on Medical Content-Based Retrieval for Clinical Decision Support, MCBR-CDS 2009
Y2 - 20 September 2009 through 20 September 2009
ER -