Computer-aided detection of diagnostic and therapeutic operations in colonoscopy videos

Yu Cao, Danyu Liu, Wallapak Tavanapong, Johnny Wong, JungHwan Oh, Piet C. De Groen

Research output: Contribution to journalArticle

34 Citations (Scopus)

Abstract

Colonoscopy is an endoscopic technique that allows a physician to inspect the inside of the human colon and to perform if deemed necessaryat the same time a number of diagnostic and therapeutic operations. In order to see the inside of the colon, a video signal of the internal mucosa of the colon is generated by a tiny video camera at the tip of the endoscope and displayed on a monitor for real-time analysis by the physician. We have captured and stored these videos in digital format and call these colonoscopy videos. Based on new algorithms for instrument detection and shot segmentation, we introduce new spatio-temporal analysis techniques to automatically identify an operation shota segment of visual data in a colonoscopy video that corresponds to a diagnostic or therapeutic operation. Our experiments on real colonoscopy videos demonstrate the effectiveness of the proposed approach. The proposed techniques and software are useful for 1) postprocedure review for causes of complications due to diagnostic or therapeutic operations; 2) establishment of an effective content-based retrieval system to facilitate endoscopic research and education; 3) development of a systematic approach to assess and improve the procedural skills of endoscopists.

Original languageEnglish (US)
Pages (from-to)1268-1279
Number of pages12
JournalIEEE Transactions on Biomedical Engineering
Volume54
Issue number7
DOIs
StatePublished - Jul 2007

Fingerprint

Content based retrieval
Endoscopy
Video cameras
Education
Experiments
Mucous Membrane

Keywords

  • Colonoscopy
  • Instrument detection
  • Medical video analysis
  • Video segmentation

ASJC Scopus subject areas

  • Biomedical Engineering

Cite this

Computer-aided detection of diagnostic and therapeutic operations in colonoscopy videos. / Cao, Yu; Liu, Danyu; Tavanapong, Wallapak; Wong, Johnny; Oh, JungHwan; De Groen, Piet C.

In: IEEE Transactions on Biomedical Engineering, Vol. 54, No. 7, 07.2007, p. 1268-1279.

Research output: Contribution to journalArticle

Cao, Yu ; Liu, Danyu ; Tavanapong, Wallapak ; Wong, Johnny ; Oh, JungHwan ; De Groen, Piet C. / Computer-aided detection of diagnostic and therapeutic operations in colonoscopy videos. In: IEEE Transactions on Biomedical Engineering. 2007 ; Vol. 54, No. 7. pp. 1268-1279.
@article{f149e48faf5d46d2a6fa221548025fc9,
title = "Computer-aided detection of diagnostic and therapeutic operations in colonoscopy videos",
abstract = "Colonoscopy is an endoscopic technique that allows a physician to inspect the inside of the human colon and to perform if deemed necessaryat the same time a number of diagnostic and therapeutic operations. In order to see the inside of the colon, a video signal of the internal mucosa of the colon is generated by a tiny video camera at the tip of the endoscope and displayed on a monitor for real-time analysis by the physician. We have captured and stored these videos in digital format and call these colonoscopy videos. Based on new algorithms for instrument detection and shot segmentation, we introduce new spatio-temporal analysis techniques to automatically identify an operation shota segment of visual data in a colonoscopy video that corresponds to a diagnostic or therapeutic operation. Our experiments on real colonoscopy videos demonstrate the effectiveness of the proposed approach. The proposed techniques and software are useful for 1) postprocedure review for causes of complications due to diagnostic or therapeutic operations; 2) establishment of an effective content-based retrieval system to facilitate endoscopic research and education; 3) development of a systematic approach to assess and improve the procedural skills of endoscopists.",
keywords = "Colonoscopy, Instrument detection, Medical video analysis, Video segmentation",
author = "Yu Cao and Danyu Liu and Wallapak Tavanapong and Johnny Wong and JungHwan Oh and {De Groen}, {Piet C.}",
year = "2007",
month = "7",
doi = "10.1109/TBME.2007.890734",
language = "English (US)",
volume = "54",
pages = "1268--1279",
journal = "IEEE Transactions on Biomedical Engineering",
issn = "0018-9294",
publisher = "IEEE Computer Society",
number = "7",

}

TY - JOUR

T1 - Computer-aided detection of diagnostic and therapeutic operations in colonoscopy videos

AU - Cao, Yu

AU - Liu, Danyu

AU - Tavanapong, Wallapak

AU - Wong, Johnny

AU - Oh, JungHwan

AU - De Groen, Piet C.

PY - 2007/7

Y1 - 2007/7

N2 - Colonoscopy is an endoscopic technique that allows a physician to inspect the inside of the human colon and to perform if deemed necessaryat the same time a number of diagnostic and therapeutic operations. In order to see the inside of the colon, a video signal of the internal mucosa of the colon is generated by a tiny video camera at the tip of the endoscope and displayed on a monitor for real-time analysis by the physician. We have captured and stored these videos in digital format and call these colonoscopy videos. Based on new algorithms for instrument detection and shot segmentation, we introduce new spatio-temporal analysis techniques to automatically identify an operation shota segment of visual data in a colonoscopy video that corresponds to a diagnostic or therapeutic operation. Our experiments on real colonoscopy videos demonstrate the effectiveness of the proposed approach. The proposed techniques and software are useful for 1) postprocedure review for causes of complications due to diagnostic or therapeutic operations; 2) establishment of an effective content-based retrieval system to facilitate endoscopic research and education; 3) development of a systematic approach to assess and improve the procedural skills of endoscopists.

AB - Colonoscopy is an endoscopic technique that allows a physician to inspect the inside of the human colon and to perform if deemed necessaryat the same time a number of diagnostic and therapeutic operations. In order to see the inside of the colon, a video signal of the internal mucosa of the colon is generated by a tiny video camera at the tip of the endoscope and displayed on a monitor for real-time analysis by the physician. We have captured and stored these videos in digital format and call these colonoscopy videos. Based on new algorithms for instrument detection and shot segmentation, we introduce new spatio-temporal analysis techniques to automatically identify an operation shota segment of visual data in a colonoscopy video that corresponds to a diagnostic or therapeutic operation. Our experiments on real colonoscopy videos demonstrate the effectiveness of the proposed approach. The proposed techniques and software are useful for 1) postprocedure review for causes of complications due to diagnostic or therapeutic operations; 2) establishment of an effective content-based retrieval system to facilitate endoscopic research and education; 3) development of a systematic approach to assess and improve the procedural skills of endoscopists.

KW - Colonoscopy

KW - Instrument detection

KW - Medical video analysis

KW - Video segmentation

UR - http://www.scopus.com/inward/record.url?scp=34250743528&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=34250743528&partnerID=8YFLogxK

U2 - 10.1109/TBME.2007.890734

DO - 10.1109/TBME.2007.890734

M3 - Article

C2 - 17605358

AN - SCOPUS:34250743528

VL - 54

SP - 1268

EP - 1279

JO - IEEE Transactions on Biomedical Engineering

JF - IEEE Transactions on Biomedical Engineering

SN - 0018-9294

IS - 7

ER -