Paper Abstract and Keywords |
Presentation |
2004-11-18 14:00
Research of the had type communication by face image processing of a dialog
-- Improvement of the recognition algorithm by mutual subspace method -- Natsuko Nishi, Mutsumi Watanabe (Graduate school,Kagoshima Univ.) |
Abstract |
(in Japanese) |
(See Japanese page) |
(in English) |
The authors are developing a vision-based intension transfer system by recognizing user’s face expressions and movements, to help free and convenient communications with aged or disabled persons who find difficulties in talking, discriminating small character prints and operating keyboards by hands and fingers. In this paper, introduces a prototype system, where layered daily conversations are successively selected by recognizing the transition in shape of user’s mouth part using camera image settled in front of the user and correspondent synthetic speech is automatically broadcasted. The four mouth patterns are automatically recognized by using the mutual subspace method by analyzing the intensity histogram data around the mouth part region. The confirmation of selection result by the user is executed by detecting the open and shut movements of mouth though the temporal change in intensity histogram data. Experimental results of mouth pattern recognition by twenty persons have shown the effectiveness of the proposed method. |
Keyword |
(in Japanese) |
(See Japanese page) |
(in English) |
Human Interface / Multi-modal Conversation / Mouth Part Pattern Recognition / Intensity Histogram Analysis / Mutual Subspace Method / Computer Vision / / |
Reference Info. |
IEICE Tech. Rep., vol. 104, no. 447, PRMU2004-100, pp. 43-48, Nov. 2004. |
Paper # |
PRMU2004-100 |
Date of Issue |
2004-11-11 (PRMU) |
ISSN |
Print edition: ISSN 0913-5685 |
Download PDF |
|
Conference Information |
Committee |
PRMU |
Conference Date |
2004-11-18 - 2004-11-19 |
Place (in Japanese) |
(See Japanese page) |
Place (in English) |
|
Topics (in Japanese) |
(See Japanese page) |
Topics (in English) |
|
Paper Information |
Registration To |
PRMU |
Conference Code |
2004-11-PRMU |
Language |
Japanese |
Title (in Japanese) |
(See Japanese page) |
Sub Title (in Japanese) |
(See Japanese page) |
Title (in English) |
Research of the had type communication by face image processing of a dialog |
Sub Title (in English) |
Improvement of the recognition algorithm by mutual subspace method |
Keyword(1) |
Human Interface |
Keyword(2) |
Multi-modal Conversation |
Keyword(3) |
Mouth Part Pattern Recognition |
Keyword(4) |
Intensity Histogram Analysis |
Keyword(5) |
Mutual Subspace Method |
Keyword(6) |
Computer Vision |
Keyword(7) |
|
Keyword(8) |
|
1st Author's Name |
Natsuko Nishi |
1st Author's Affiliation |
Graduate School of Science and Engineering, Kagoshima University (Graduate school,Kagoshima Univ.) |
2nd Author's Name |
Mutsumi Watanabe |
2nd Author's Affiliation |
Graduate School of Science and Engineering, Kagoshima University (Graduate school,Kagoshima Univ.) |
3rd Author's Name |
|
3rd Author's Affiliation |
() |
4th Author's Name |
|
4th Author's Affiliation |
() |
5th Author's Name |
|
5th Author's Affiliation |
() |
6th Author's Name |
|
6th Author's Affiliation |
() |
7th Author's Name |
|
7th Author's Affiliation |
() |
8th Author's Name |
|
8th Author's Affiliation |
() |
9th Author's Name |
|
9th Author's Affiliation |
() |
10th Author's Name |
|
10th Author's Affiliation |
() |
11th Author's Name |
|
11th Author's Affiliation |
() |
12th Author's Name |
|
12th Author's Affiliation |
() |
13th Author's Name |
|
13th Author's Affiliation |
() |
14th Author's Name |
|
14th Author's Affiliation |
() |
15th Author's Name |
|
15th Author's Affiliation |
() |
16th Author's Name |
|
16th Author's Affiliation |
() |
17th Author's Name |
|
17th Author's Affiliation |
() |
18th Author's Name |
|
18th Author's Affiliation |
() |
19th Author's Name |
|
19th Author's Affiliation |
() |
20th Author's Name |
|
20th Author's Affiliation |
() |
Speaker |
Author-1 |
Date Time |
2004-11-18 14:00:00 |
Presentation Time |
30 minutes |
Registration for |
PRMU |
Paper # |
PRMU2004-100 |
Volume (vol) |
vol.104 |
Number (no) |
no.447 |
Page |
pp.43-48 |
#Pages |
6 |
Date of Issue |
2004-11-11 (PRMU) |