TY - JOUR
T1 - Informative frame classification for endoscopy video
AU - Oh, Jung Hwan
AU - Hwang, Sae
AU - Lee, Jeong Kyu
AU - Tavanapong, Wallapak
AU - Wong, Johnny
AU - de Groen, Piet C.
N1 - Funding Information:
One of the authors, Piet C. de Groen M.D of the Mayo Clinic College of Medicine provided the videos, his comments of the final evaluation of our experiments, and various supports in this work. This research is partially supported by the National Science Foundation Grants EIA-0216500, IIS-0513777, IIS-0513809, and IIS-0513582.
PY - 2007/4
Y1 - 2007/4
N2 - Advances in video technology allow inspection, diagnosis and treatment of the inside of the human body without or with very small scars. Flexible endoscopes are used to inspect the esophagus, stomach, small bowel, colon, and airways, whereas rigid endoscopes are used for a variety of minimal invasive surgeries (i.e., laparoscopy, arthroscopy, endoscopic neurosurgery). These endoscopes come in various sizes, but all have a tiny video camera at the tip. During an endoscopic procedure, the tiny video camera generates a video signal of the interior of the human organ, which is displayed on a monitor for real-time analysis by the physician. However, many out-of-focus frames are present in endoscopy videos because current endoscopes are equipped with a single, wide-angle lens that cannot be focused. We need to distinguish the out-of-focus frames from the in-focus frames to utilize the information of the out-of-focus and/or the in-focus frames for further automatic or semi-automatic computer-aided diagnosis (CAD). This classification can reduce the number of images to be viewed by a physician and to be analyzed by a CAD system. We call an out-of-focus frame a non-informative frame and an in-focus frame an informative frame. The out-of-focus frames have characteristics that are different from those of in-focus frames. In this paper, we propose two new techniques (edge-based and clustering-based) to classify video frames into two classes, informative and non-informative frames. However, because intensive specular reflections reduce the accuracy of the classification we also propose a specular reflection detection technique, and use the detected specular reflection information to increase the accuracy of informative frame classification. Our experimental studies indicate that precision, sensitivity, specificity, and accuracy for the specular reflection detection technique and the two informative frame classification techniques are greater than 90% and 95%, respectively.
AB - Advances in video technology allow inspection, diagnosis and treatment of the inside of the human body without or with very small scars. Flexible endoscopes are used to inspect the esophagus, stomach, small bowel, colon, and airways, whereas rigid endoscopes are used for a variety of minimal invasive surgeries (i.e., laparoscopy, arthroscopy, endoscopic neurosurgery). These endoscopes come in various sizes, but all have a tiny video camera at the tip. During an endoscopic procedure, the tiny video camera generates a video signal of the interior of the human organ, which is displayed on a monitor for real-time analysis by the physician. However, many out-of-focus frames are present in endoscopy videos because current endoscopes are equipped with a single, wide-angle lens that cannot be focused. We need to distinguish the out-of-focus frames from the in-focus frames to utilize the information of the out-of-focus and/or the in-focus frames for further automatic or semi-automatic computer-aided diagnosis (CAD). This classification can reduce the number of images to be viewed by a physician and to be analyzed by a CAD system. We call an out-of-focus frame a non-informative frame and an in-focus frame an informative frame. The out-of-focus frames have characteristics that are different from those of in-focus frames. In this paper, we propose two new techniques (edge-based and clustering-based) to classify video frames into two classes, informative and non-informative frames. However, because intensive specular reflections reduce the accuracy of the classification we also propose a specular reflection detection technique, and use the detected specular reflection information to increase the accuracy of informative frame classification. Our experimental studies indicate that precision, sensitivity, specificity, and accuracy for the specular reflection detection technique and the two informative frame classification techniques are greater than 90% and 95%, respectively.
KW - Clustering
KW - Colonoscopy
KW - Endoscopy
KW - Frame classification
KW - Specular reflection detection
KW - Texture
UR - http://www.scopus.com/inward/record.url?scp=33847631274&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=33847631274&partnerID=8YFLogxK
U2 - 10.1016/j.media.2006.10.003
DO - 10.1016/j.media.2006.10.003
M3 - Article
C2 - 17329146
AN - SCOPUS:33847631274
SN - 1361-8415
VL - 11
SP - 110
EP - 127
JO - Medical Image Analysis
JF - Medical Image Analysis
IS - 2
ER -