IEICE Technical Committee Submission System
Conference Paper's Information
Online Proceedings
[Sign in]
Tech. Rep. Archives
 Go Top Page Go Previous   [Japanese] / [English] 

Paper Abstract and Keywords
Presentation 2004-11-18 14:00
Research of the had type communication by face image processing of a dialog -- Improvement of the recognition algorithm by mutual subspace method --
Natsuko Nishi, Mutsumi Watanabe (Graduate school,Kagoshima Univ.)
Abstract (in Japanese) (See Japanese page) 
(in English) The authors are developing a vision-based intension transfer system by recognizing user’s face expressions and movements, to help free and convenient communications with aged or disabled persons who find difficulties in talking, discriminating small character prints and operating keyboards by hands and fingers. In this paper, introduces a prototype system, where layered daily conversations are successively selected by recognizing the transition in shape of user’s mouth part using camera image settled in front of the user and correspondent synthetic speech is automatically broadcasted. The four mouth patterns are automatically recognized by using the mutual subspace method by analyzing the intensity histogram data around the mouth part region. The confirmation of selection result by the user is executed by detecting the open and shut movements of mouth though the temporal change in intensity histogram data. Experimental results of mouth pattern recognition by twenty persons have shown the effectiveness of the proposed method.
Keyword (in Japanese) (See Japanese page) 
(in English) Human Interface / Multi-modal Conversation / Mouth Part Pattern Recognition / Intensity Histogram Analysis / Mutual Subspace Method / Computer Vision / /  
Reference Info. IEICE Tech. Rep., vol. 104, no. 447, PRMU2004-100, pp. 43-48, Nov. 2004.
Paper # PRMU2004-100 
Date of Issue 2004-11-11 (PRMU) 
ISSN Print edition: ISSN 0913-5685
Download PDF

Conference Information
Committee PRMU  
Conference Date 2004-11-18 - 2004-11-19 
Place (in Japanese) (See Japanese page) 
Place (in English)  
Topics (in Japanese) (See Japanese page) 
Topics (in English)  
Paper Information
Registration To PRMU 
Conference Code 2004-11-PRMU 
Language Japanese 
Title (in Japanese) (See Japanese page) 
Sub Title (in Japanese) (See Japanese page) 
Title (in English) Research of the had type communication by face image processing of a dialog 
Sub Title (in English) Improvement of the recognition algorithm by mutual subspace method 
Keyword(1) Human Interface  
Keyword(2) Multi-modal Conversation  
Keyword(3) Mouth Part Pattern Recognition  
Keyword(4) Intensity Histogram Analysis  
Keyword(5) Mutual Subspace Method  
Keyword(6) Computer Vision  
Keyword(7)  
Keyword(8)  
1st Author's Name Natsuko Nishi  
1st Author's Affiliation Graduate School of Science and Engineering, Kagoshima University (Graduate school,Kagoshima Univ.)
2nd Author's Name Mutsumi Watanabe  
2nd Author's Affiliation Graduate School of Science and Engineering, Kagoshima University (Graduate school,Kagoshima Univ.)
3rd Author's Name  
3rd Author's Affiliation ()
4th Author's Name  
4th Author's Affiliation ()
5th Author's Name  
5th Author's Affiliation ()
6th Author's Name  
6th Author's Affiliation ()
7th Author's Name  
7th Author's Affiliation ()
8th Author's Name  
8th Author's Affiliation ()
9th Author's Name  
9th Author's Affiliation ()
10th Author's Name  
10th Author's Affiliation ()
11th Author's Name  
11th Author's Affiliation ()
12th Author's Name  
12th Author's Affiliation ()
13th Author's Name  
13th Author's Affiliation ()
14th Author's Name  
14th Author's Affiliation ()
15th Author's Name  
15th Author's Affiliation ()
16th Author's Name  
16th Author's Affiliation ()
17th Author's Name  
17th Author's Affiliation ()
18th Author's Name  
18th Author's Affiliation ()
19th Author's Name  
19th Author's Affiliation ()
20th Author's Name  
20th Author's Affiliation ()
Speaker Author-1 
Date Time 2004-11-18 14:00:00 
Presentation Time 30 minutes 
Registration for PRMU 
Paper # PRMU2004-100 
Volume (vol) vol.104 
Number (no) no.447 
Page pp.43-48 
#Pages
Date of Issue 2004-11-11 (PRMU) 


[Return to Top Page]

[Return to IEICE Web Page]


The Institute of Electronics, Information and Communication Engineers (IEICE), Japan