Introducing space and time in local feature-based endomicroscopic image retrieval

Barbara André, Tom Vercauteren, Aymeric Perchant, Anna M. Buchner, Michael B. Wallace, Nicholas Ayache

Research output: Chapter in Book/Report/Conference proceedingConference contribution

16 Scopus citations

Abstract

Interpreting endomicroscopic images is still a significant challenge, especially since one single still image may not always contain enough information to make a robust diagnosis. To aid the physicians, we investigated some local feature-based retrieval methods that provide, given a query image, similar annotated images from a database of endomicroscopic images combined with high-level diagnosis represented as textual information. Local feature-based methods may be limited by the small field of view (FOV) of endomicroscopy and the fact that they do not take into account the spatial relationship between the local features, and the time relationship between successive images of the video sequences. To extract discriminative information over the entire image field, our proposed method collects local features in a dense manner instead of using a standard salient region detector. After the retrieval process, we introduce a verification step driven by the textual information in the database and in which spatial relationship between the local features is used. A spatial criterion is built from the co-occurence matrix of local features and used to remove outliers by thresholding on this criterion. To overcome the small-FOV problem and take advantage of the video sequence, we propose to combine image retrieval and mosaicing. Mosaicing essentially projects the temporal dimension onto a large field of view image. In this framework, videos, represented by mosaics, and single images can be retrieved with the same tools. With a leave-n-out cross-validation, our results show that taking into account the spatial relationship between local features and the temporal information of endomicroscopic videos by image mosaicing improves the retrieval accuracy.

Original languageEnglish (US)
Title of host publicationMedical Content-Based Retrieval for Clinical Decision Support - First MICCAI International Workshop, MCBR-CDS 2009, Revised Selected Papers
Pages18-30
Number of pages13
DOIs
StatePublished - 2010
Event1st MICCAI International Workshop on Medical Content-Based Retrieval for Clinical Decision Support, MCBR-CDS 2009 - London, United Kingdom
Duration: Sep 20 2009Sep 20 2009

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume5853 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other1st MICCAI International Workshop on Medical Content-Based Retrieval for Clinical Decision Support, MCBR-CDS 2009
CountryUnited Kingdom
CityLondon
Period9/20/099/20/09

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'Introducing space and time in local feature-based endomicroscopic image retrieval'. Together they form a unique fingerprint.

Cite this