Automatic real-time detection of endoscopic procedures using temporal features

Sean R. Stanek, Wallapak Tavanapong, Johnny Wong, Jung Hwan Oh, Piet C. de Groen

Research output: Contribution to journalArticle

19 Citations (Scopus)

Abstract

Endoscopy is used for inspection of the inner surface of organs such as the colon. During endoscopic inspection of the colon or colonoscopy, a tiny video camera generates a video signal, which is displayed on a monitor for interpretation in real-time by physicians. In practice, these images are not typically captured, which may be attributed by lack of fully automated tools for capturing, analysis of important contents, and quick and easy retrieval of these contents. This paper presents the description and evaluation results of our novel software that uses new metrics based on image color and motion over time to automatically record all images of an individual endoscopic procedure into a single digitized video file. The software automatically discards out-patient video frames between different endoscopic procedures. We validated our software system on 2464. h of live video (over 265 million frames) from endoscopy units where colonoscopy and upper endoscopy were performed. Our previous classification method achieved a frame-based sensitivity of 100.00%, but only a specificity of 89.22%. Our new method achieved a frame-based sensitivity and specificity of 99.90% and 99.97%, a significant improvement. Our system is robust for day-to-day use in medical practice.

Original languageEnglish (US)
Pages (from-to)524-535
Number of pages12
JournalComputer Methods and Programs in Biomedicine
Volume108
Issue number2
DOIs
StatePublished - Nov 2012

Fingerprint

Endoscopy
Software
Colonoscopy
Inspection
Colon
Video cameras
Color
Outpatients
Physicians
Sensitivity and Specificity

Keywords

  • Colonoscopy
  • Endoscopy
  • Image analysis
  • Real-time
  • Video capture
  • Video content analysis

ASJC Scopus subject areas

  • Computer Science Applications
  • Software
  • Health Informatics

Cite this

Automatic real-time detection of endoscopic procedures using temporal features. / Stanek, Sean R.; Tavanapong, Wallapak; Wong, Johnny; Oh, Jung Hwan; de Groen, Piet C.

In: Computer Methods and Programs in Biomedicine, Vol. 108, No. 2, 11.2012, p. 524-535.

Research output: Contribution to journalArticle

Stanek, Sean R. ; Tavanapong, Wallapak ; Wong, Johnny ; Oh, Jung Hwan ; de Groen, Piet C. / Automatic real-time detection of endoscopic procedures using temporal features. In: Computer Methods and Programs in Biomedicine. 2012 ; Vol. 108, No. 2. pp. 524-535.
@article{87f39cfdf38044ba80ae5786d87ad015,
title = "Automatic real-time detection of endoscopic procedures using temporal features",
abstract = "Endoscopy is used for inspection of the inner surface of organs such as the colon. During endoscopic inspection of the colon or colonoscopy, a tiny video camera generates a video signal, which is displayed on a monitor for interpretation in real-time by physicians. In practice, these images are not typically captured, which may be attributed by lack of fully automated tools for capturing, analysis of important contents, and quick and easy retrieval of these contents. This paper presents the description and evaluation results of our novel software that uses new metrics based on image color and motion over time to automatically record all images of an individual endoscopic procedure into a single digitized video file. The software automatically discards out-patient video frames between different endoscopic procedures. We validated our software system on 2464. h of live video (over 265 million frames) from endoscopy units where colonoscopy and upper endoscopy were performed. Our previous classification method achieved a frame-based sensitivity of 100.00{\%}, but only a specificity of 89.22{\%}. Our new method achieved a frame-based sensitivity and specificity of 99.90{\%} and 99.97{\%}, a significant improvement. Our system is robust for day-to-day use in medical practice.",
keywords = "Colonoscopy, Endoscopy, Image analysis, Real-time, Video capture, Video content analysis",
author = "Stanek, {Sean R.} and Wallapak Tavanapong and Johnny Wong and Oh, {Jung Hwan} and {de Groen}, {Piet C.}",
year = "2012",
month = "11",
doi = "10.1016/j.cmpb.2011.04.003",
language = "English (US)",
volume = "108",
pages = "524--535",
journal = "Computer Methods and Programs in Biomedicine",
issn = "0169-2607",
publisher = "Elsevier Ireland Ltd",
number = "2",

}

TY - JOUR

T1 - Automatic real-time detection of endoscopic procedures using temporal features

AU - Stanek, Sean R.

AU - Tavanapong, Wallapak

AU - Wong, Johnny

AU - Oh, Jung Hwan

AU - de Groen, Piet C.

PY - 2012/11

Y1 - 2012/11

N2 - Endoscopy is used for inspection of the inner surface of organs such as the colon. During endoscopic inspection of the colon or colonoscopy, a tiny video camera generates a video signal, which is displayed on a monitor for interpretation in real-time by physicians. In practice, these images are not typically captured, which may be attributed by lack of fully automated tools for capturing, analysis of important contents, and quick and easy retrieval of these contents. This paper presents the description and evaluation results of our novel software that uses new metrics based on image color and motion over time to automatically record all images of an individual endoscopic procedure into a single digitized video file. The software automatically discards out-patient video frames between different endoscopic procedures. We validated our software system on 2464. h of live video (over 265 million frames) from endoscopy units where colonoscopy and upper endoscopy were performed. Our previous classification method achieved a frame-based sensitivity of 100.00%, but only a specificity of 89.22%. Our new method achieved a frame-based sensitivity and specificity of 99.90% and 99.97%, a significant improvement. Our system is robust for day-to-day use in medical practice.

AB - Endoscopy is used for inspection of the inner surface of organs such as the colon. During endoscopic inspection of the colon or colonoscopy, a tiny video camera generates a video signal, which is displayed on a monitor for interpretation in real-time by physicians. In practice, these images are not typically captured, which may be attributed by lack of fully automated tools for capturing, analysis of important contents, and quick and easy retrieval of these contents. This paper presents the description and evaluation results of our novel software that uses new metrics based on image color and motion over time to automatically record all images of an individual endoscopic procedure into a single digitized video file. The software automatically discards out-patient video frames between different endoscopic procedures. We validated our software system on 2464. h of live video (over 265 million frames) from endoscopy units where colonoscopy and upper endoscopy were performed. Our previous classification method achieved a frame-based sensitivity of 100.00%, but only a specificity of 89.22%. Our new method achieved a frame-based sensitivity and specificity of 99.90% and 99.97%, a significant improvement. Our system is robust for day-to-day use in medical practice.

KW - Colonoscopy

KW - Endoscopy

KW - Image analysis

KW - Real-time

KW - Video capture

KW - Video content analysis

UR - http://www.scopus.com/inward/record.url?scp=84867403697&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84867403697&partnerID=8YFLogxK

U2 - 10.1016/j.cmpb.2011.04.003

DO - 10.1016/j.cmpb.2011.04.003

M3 - Article

C2 - 21621870

AN - SCOPUS:84867403697

VL - 108

SP - 524

EP - 535

JO - Computer Methods and Programs in Biomedicine

JF - Computer Methods and Programs in Biomedicine

SN - 0169-2607

IS - 2

ER -