| IEICE Technical Committee Submission System Conference Paper's Information |
Online Proceedings [Sign in] Tech. Rep. Archives |
| Go Top Page | Go Previous | [Japanese] / [English] |
| Paper Abstract and Keywords | ||
| Presentation | 2016-05-19 15:10 Study of Photo-realistic Face Moving Image Generation from the Text Using the Facial Feature Kazuki Sato, Takashi Nose, Akinori Ito (Tohoku Univ.)  IT2016-8 EMM2016-8 |
|
| Abstract | (in Japanese) | (See Japanese page) |
| (in English) | In this paper, we propose face moving image synthesis technique based on Hidden Markov model (HMM) using the facial features as a method of face moving image synthesis for the photo-realistic interactive agent implementation. In recent years, it becomes more and more popular for a human to interact with computers using human-like interfaces, such as an interactive agent. In such a situation, realization of more human-like agent is needed. Therefore, focusing on realization of an agent with human-like appearance, we investigate a synthesis method of photo-realistic face moving image synchronized with the speech contents. The conventional method employs the same framework as the HMM speech synthesis for face motion image synthesis; however, there are problems that high cost of data preparation for learning and low quality of the synthesized facial image. In the proposed method, we use Animation Unit (AU) as feature of face image generation, which can be obtained by Kinect. The AU is parameters that express each part of the face. Using AU, we synthesize the face motion image by converting the face feature generated from the HMM face image synthesizer into intensities of pixels using the Deep Neural Network (DNN). In this paper, we investigate the optimal learning conditions for the HMM an | |
| Keyword | (in Japanese) | (See Japanese page) |
| (in English) | face image synthesis / photo-realistic / HMM / DNN / Kinect / / / | |
| Reference Info. | IEICE Tech. Rep., vol. 116, no. 34, EMM2016-8, pp. 43-48, May 2016. | |
| Paper # | EMM2016-8 | |
| Date of Issue | 2016-05-12 (IT, EMM) | |
| ISSN | Print edition: ISSN 0913-5685 Online edition: ISSN 2432-6380 | |
| Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) | |
| Download PDF | IT2016-8 EMM2016-8 |
|
| Conference Information | |
| Committee | IT EMM |
| Conference Date | 2016-05-19 - 2016-05-20 |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Otaru Economic Center |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | Information Security, Information Theory, Information Hiding, etc. |
| Paper Information | |
| Registration To | EMM |
| Conference Code | 2016-05-IT-EMM |
| Language | Japanese |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Study of Photo-realistic Face Moving Image Generation from the Text Using the Facial Feature |
| Sub Title (in English) | |
| Keyword(1) | face image synthesis |
| Keyword(2) | photo-realistic |
| Keyword(3) | HMM |
| Keyword(4) | DNN |
| Keyword(5) | Kinect |
| Keyword(6) | |
| Keyword(7) | |
| Keyword(8) | |
| 1st Author's Name | Kazuki Sato |
| 1st Author's Affiliation | Tohoku University (Tohoku Univ.) |
| 2nd Author's Name | Takashi Nose |
| 2nd Author's Affiliation | Tohoku University (Tohoku Univ.) |
| 3rd Author's Name | Akinori Ito |
| 3rd Author's Affiliation | Tohoku University (Tohoku Univ.) |
| 4th Author's Name | |
| 4th Author's Affiliation | () |
| 5th Author's Name | |
| 5th Author's Affiliation | () |
| 6th Author's Name | |
| 6th Author's Affiliation | () |
| 7th Author's Name | |
| 7th Author's Affiliation | () |
| 8th Author's Name | |
| 8th Author's Affiliation | () |
| 9th Author's Name | |
| 9th Author's Affiliation | () |
| 10th Author's Name | |
| 10th Author's Affiliation | () |
| 11th Author's Name | |
| 11th Author's Affiliation | () |
| 12th Author's Name | |
| 12th Author's Affiliation | () |
| 13th Author's Name | |
| 13th Author's Affiliation | () |
| 14th Author's Name | |
| 14th Author's Affiliation | () |
| 15th Author's Name | |
| 15th Author's Affiliation | () |
| 16th Author's Name | |
| 16th Author's Affiliation | () |
| 17th Author's Name | |
| 17th Author's Affiliation | () |
| 18th Author's Name | |
| 18th Author's Affiliation | () |
| Speaker | Author-1 |
| Date Time | 2016-05-19 15:10:00 |
| Presentation Time | 25 minutes |
| Registration for | EMM |
| Paper # | IT2016-8, EMM2016-8 |
| Volume (vol) | vol.116 |
| Number (no) | no.33(IT), no.34(EMM) |
| Page | pp.43-48 |
| #Pages | 6 |
| Date of Issue | 2016-05-12 (IT, EMM) |
[Return to Top Page]