A Visual Model Approach for Parsing Colonoscopy Videos

Yu Cao, Wallapak Tavanapong, Dalei Li, Junghwan Oh, Piet C. De Groen, Johnny Wong

Research output: Contribution to journalArticle

8 Citations (Scopus)

Abstract

Colonoscopy is an important screening procedure for colorectal cancer. During this procedure, the endoscopist visually inspects the colon. Currently, there is no content-based analysis and retrieval system that automatically analyzes videos captured from colonoscopic procedures and provides a user-friendly and efficient access to important content. Such a system will be valuable as an educational resource for endoscopic research, a platform to assess procedural skills for endoscopists, and a platform for mining for unknown abnormality patterns that may lead to colorectal cancer. The first necessary step for the analysis is parsing for semantic units. In this paper, we propose a new visual model approach that employs visual features extracted directly from compressed videos together with audio analysis to discover important semantic units called scenes. Our experimental results show average precision and recall of 93% and 85%, respectively.

Original languageEnglish (US)
Pages (from-to)160-169
Number of pages10
JournalLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume3115
StatePublished - 2004

Fingerprint

Parsing
Colonoscopy
Colorectal Cancer
Semantics
Colorectal Neoplasms
Screening
Unit
Mining
Colon
Retrieval
Model
Unknown
Resources
Necessary
Experimental Results
Research
Vision

ASJC Scopus subject areas

  • Biochemistry, Genetics and Molecular Biology(all)
  • Computer Science(all)
  • Theoretical Computer Science

Cite this

A Visual Model Approach for Parsing Colonoscopy Videos. / Cao, Yu; Tavanapong, Wallapak; Li, Dalei; Oh, Junghwan; De Groen, Piet C.; Wong, Johnny.

In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 3115, 2004, p. 160-169.

Research output: Contribution to journalArticle

Cao, Yu ; Tavanapong, Wallapak ; Li, Dalei ; Oh, Junghwan ; De Groen, Piet C. ; Wong, Johnny. / A Visual Model Approach for Parsing Colonoscopy Videos. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). 2004 ; Vol. 3115. pp. 160-169.
@article{f67f9333cefa404a8ae9fa3e2a062ef4,
title = "A Visual Model Approach for Parsing Colonoscopy Videos",
abstract = "Colonoscopy is an important screening procedure for colorectal cancer. During this procedure, the endoscopist visually inspects the colon. Currently, there is no content-based analysis and retrieval system that automatically analyzes videos captured from colonoscopic procedures and provides a user-friendly and efficient access to important content. Such a system will be valuable as an educational resource for endoscopic research, a platform to assess procedural skills for endoscopists, and a platform for mining for unknown abnormality patterns that may lead to colorectal cancer. The first necessary step for the analysis is parsing for semantic units. In this paper, we propose a new visual model approach that employs visual features extracted directly from compressed videos together with audio analysis to discover important semantic units called scenes. Our experimental results show average precision and recall of 93{\%} and 85{\%}, respectively.",
author = "Yu Cao and Wallapak Tavanapong and Dalei Li and Junghwan Oh and {De Groen}, {Piet C.} and Johnny Wong",
year = "2004",
language = "English (US)",
volume = "3115",
pages = "160--169",
journal = "Lecture Notes in Computer Science",
issn = "0302-9743",
publisher = "Springer Verlag",

}

TY - JOUR

T1 - A Visual Model Approach for Parsing Colonoscopy Videos

AU - Cao, Yu

AU - Tavanapong, Wallapak

AU - Li, Dalei

AU - Oh, Junghwan

AU - De Groen, Piet C.

AU - Wong, Johnny

PY - 2004

Y1 - 2004

N2 - Colonoscopy is an important screening procedure for colorectal cancer. During this procedure, the endoscopist visually inspects the colon. Currently, there is no content-based analysis and retrieval system that automatically analyzes videos captured from colonoscopic procedures and provides a user-friendly and efficient access to important content. Such a system will be valuable as an educational resource for endoscopic research, a platform to assess procedural skills for endoscopists, and a platform for mining for unknown abnormality patterns that may lead to colorectal cancer. The first necessary step for the analysis is parsing for semantic units. In this paper, we propose a new visual model approach that employs visual features extracted directly from compressed videos together with audio analysis to discover important semantic units called scenes. Our experimental results show average precision and recall of 93% and 85%, respectively.

AB - Colonoscopy is an important screening procedure for colorectal cancer. During this procedure, the endoscopist visually inspects the colon. Currently, there is no content-based analysis and retrieval system that automatically analyzes videos captured from colonoscopic procedures and provides a user-friendly and efficient access to important content. Such a system will be valuable as an educational resource for endoscopic research, a platform to assess procedural skills for endoscopists, and a platform for mining for unknown abnormality patterns that may lead to colorectal cancer. The first necessary step for the analysis is parsing for semantic units. In this paper, we propose a new visual model approach that employs visual features extracted directly from compressed videos together with audio analysis to discover important semantic units called scenes. Our experimental results show average precision and recall of 93% and 85%, respectively.

UR - http://www.scopus.com/inward/record.url?scp=35048844831&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=35048844831&partnerID=8YFLogxK

M3 - Article

AN - SCOPUS:35048844831

VL - 3115

SP - 160

EP - 169

JO - Lecture Notes in Computer Science

JF - Lecture Notes in Computer Science

SN - 0302-9743

ER -