| IEICE Technical Committee Submission System Conference Paper's Information |
Online Proceedings [Sign in] Tech. Rep. Archives |
| Go Top Page | Go Previous | [Japanese] / [English] |
| Paper Abstract and Keywords | ||
| Presentation | 2023-07-13 13:25 Dementia detection based on dynamic analysis of facial expressions using Action Unit Taichi Okunishi, Chuheng Zheng, Mondher Bouazizi, Tomoaki Ohtsuki, Momoko Kitazawa, Toshiro Horigome, Taishiro Kishimoto (Keio Univ.)  SeMI2023-30 |
|
| Abstract | (in Japanese) | (See Japanese page) |
| (in English) | The Action Unit represents the movement of each facial muscle, and by combining Action Unit, facial expressions can be quantified. In this paper, we propose a method for detecting dementia patients by designing dynamic features of the Action Unit and a method for detecting dementia patients by time series analysis of the Action Unit using LSTM, a deep learning model suitable for time series data. The dynamic feature design aims to capture differences in the speed of facial expression change, and the LSTM analysis aims to capture patterns of facial expression change that are useful for identifying dementia. The PROMPT dataset, in which the upper body of a subject was captured while the subject was engaged in a daily conversation with a doctor, was used, and a total of 155 people, 79 dementia patients and 76 healthy subjects, were evaluated in the dataset. The proposed method using dynamic features and LSTM achieved an AUC of 0.77 for both methods, which is higher than the AUC of 0.70 for the conventional method for dementia detection using Action Unit. The AUC was improved to 0.84 by combining information such as facial landmarks and eye gaze in addition to the Action Unit. The evaluation of feature importance of the proposed method using dynamic features showed that the movements of facial muscles around the eyes may be useful in detecting dementia. Furthermore, we applied the proposed LSTM-based method to depression and bipolar disorder, and showed its applicability to other disorders. | |
| Keyword | (in Japanese) | (See Japanese page) |
| (in English) | dementia detection / facial expression analysis / Action Unit / machine learning / / / / | |
| Reference Info. | IEICE Tech. Rep., vol. 123, no. 110, SeMI2023-30, pp. 40-45, July 2023. | |
| Paper # | SeMI2023-30 | |
| Date of Issue | 2023-07-05 (SeMI) | |
| ISSN | Online edition: ISSN 2432-6380 | |
| Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) | |
| Download PDF | SeMI2023-30 |
|
| Conference Information | |
| Committee | SeMI RCS RCC NS SR |
| Conference Date | 2023-07-12 - 2023-07-14 |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Osaka University Nakanoshima Center + Online |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | Distributed Wireless Network, M2M (Machine-to-Machine)，D2D (Device-to-Device)，IoT（Internet of Things）, etc |
| Paper Information | |
| Registration To | SeMI |
| Conference Code | 2023-07-SeMI-RCS-RCC-NS-SR |
| Language | Japanese |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Dementia detection based on dynamic analysis of facial expressions using Action Unit |
| Sub Title (in English) | |
| Keyword(1) | dementia detection |
| Keyword(2) | facial expression analysis |
| Keyword(3) | Action Unit |
| Keyword(4) | machine learning |
| Keyword(5) | |
| Keyword(6) | |
| Keyword(7) | |
| Keyword(8) | |
| 1st Author's Name | Taichi Okunishi |
| 1st Author's Affiliation | Keio University (Keio Univ.) |
| 2nd Author's Name | Chuheng Zheng |
| 2nd Author's Affiliation | Keio University (Keio Univ.) |
| 3rd Author's Name | Mondher Bouazizi |
| 3rd Author's Affiliation | Keio University (Keio Univ.) |
| 4th Author's Name | Tomoaki Ohtsuki |
| 4th Author's Affiliation | Keio University (Keio Univ.) |
| 5th Author's Name | Momoko Kitazawa |
| 5th Author's Affiliation | Keio University (Keio Univ.) |
| 6th Author's Name | Toshiro Horigome |
| 6th Author's Affiliation | Keio University (Keio Univ.) |
| 7th Author's Name | Taishiro Kishimoto |
| 7th Author's Affiliation | Keio University (Keio Univ.) |
| 8th Author's Name | |
| 8th Author's Affiliation | () |
| 9th Author's Name | |
| 9th Author's Affiliation | () |
| 10th Author's Name | |
| 10th Author's Affiliation | () |
| 11th Author's Name | |
| 11th Author's Affiliation | () |
| 12th Author's Name | |
| 12th Author's Affiliation | () |
| 13th Author's Name | |
| 13th Author's Affiliation | () |
| 14th Author's Name | |
| 14th Author's Affiliation | () |
| 15th Author's Name | |
| 15th Author's Affiliation | () |
| 16th Author's Name | |
| 16th Author's Affiliation | () |
| 17th Author's Name | |
| 17th Author's Affiliation | () |
| 18th Author's Name | |
| 18th Author's Affiliation | () |
| Speaker | Author-1 |
| Date Time | 2023-07-13 13:25:00 |
| Presentation Time | 25 minutes |
| Registration for | SeMI |
| Paper # | SeMI2023-30 |
| Volume (vol) | vol.123 |
| Number (no) | no.110 |
| Page | pp.40-45 |
| #Pages | 6 |
| Date of Issue | 2023-07-05 (SeMI) |
[Return to Top Page]