• Apr 28, 2017 News!Vol.3, No.1 has been published with online version.   [Click]
  • Dec 30, 2016 News!Vol.2, No.4 has been published with online version.   [Click]
  • Jun 22, 2016 News!Vol.2, No.3 has been published with online version.   [Click]
General Information
    • ISSN: 2382-6185
    • Frequency: Quarterly (2015-2016); semiyearly (Since 2017)
    • DOI: 10.18178/IJKE
    • Editor-in-Chief: Prof. Chen-Huei Chou
    • Executive Editor: Ms. Nina Lee
    • Indexed by: Google Scholar, DOAJ, Engineering & Technology Digital Library, Crossref, ProQuest
    • E-mail: ijke@ejournal.net
Editor-in-chief
Prof. Chen-Huei Chou
College of Charleston, SC, USA
It is my honor to be the editor-in-chief of IJKE. I will do my best to help develop this journal better.
IJKE 2016 Vol.2(3): 137-141 ISSN: 2382-6185
doi: 10.18178/ijke.2016.2.3.068

Automatic Lip Reading for Inability-to-Talk Patient during Mechanical Ventilation

Yudai Nagano, Ryuhei Sakurai, Yu Kawazoe, Kyohei Miyamoto, Hirotake Yamazoe, and Joo-Ho Lee
Abstract—In this paper, we propose a lip reading system for patients who have inability to talk during mechanical ventilation. Existing automatic lip reading system cannot be used for ICU patient, because their endotracheal tube causes visual occlusion. We are aiming to read patient's lip by using mouth model that is attached endotracheal tube for this problem. In this paper, we defined two models of mouth shape. One model represents mouth of ordinary face with a set of keypoints extracted by facial keypoints detector. The other model represents mouth of ICU patient. In addition, we compared two models in terms of sequential labeling of visemes and isolated word recognition.

Index Terms—Automatic lip reading, visual speech recognition, hidden Markov model, viseme.

Yudai Nagano, Ryuhei Sakurai, Hirotake Yamazoe, and Joo-Ho Lee are with Ritsumeikan University, Japan (e-mail: is0081hx@ed.ritsumei.ac.jp, rsakurai@fc.ritsumei.ac.jp, yamazoe@fc.ritsumei.ac.jp).
Yu Kawazoe is with Tohoku University, Japan (e-mail: ukz411@gmail.com).
Kyohei Miyamoto is with Wakayama Medical University, Japan (e-mail: go.go.kyohei.miyamoto@gmail.com).

[PDF]

Cite: Yudai Nagano, Ryuhei Sakurai, Yu Kawazoe, Kyohei Miyamoto, Hirotake Yamazoe, and Joo-Ho Lee, "Automatic Lip Reading for Inability-to-Talk Patient during Mechanical Ventilation," International Journal of Knowledge Engineering vol. 2, no. 3, pp. 137-141, 2016.

Copyright © 2008-2016. International Journal of Knowledge Engineering. All rights reserved.
E-mail: ijke@ejournal.net