| Paper Abstract and Keywords |
| Presentation |
2022-12-14 23:25
Analyzing and Recognizing Synergetic Functions between Head Movements and Facial Expressions in Conversations
Mai Imamura, Kazuki Takeda (YNU), Shiro Kumano (NTT), Kazuhiro Otsuka (YNU) |
| Abstract |
(in Japanese) |
(See Japanese page) |
| (in English) |
In this paper, we propose machine-learning models for recognizing the synergetic functions between facial expressions and head movements in conversations. To define such synergetic functions, a functional facial-expression corpus including various facial functions beyond the affect display was constructed and analyzed with the functional head-movement corpus. The analysis discovered several types of synergetic relationships between facial expressions and head movements, including reinforcement, multiplexing, and complement. To recognize such synergetic functions automatically, we constructed several models using convolutional neural networks (CNNs), which input facial action-units and head-pose sequences. Finally, the experiment results verified the potential of the proposed models. |
| Keyword |
(in Japanese) |
(See Japanese page) |
| (in English) |
nonverbal communication / head movement / facial expression / convolutional neural network / / / / |
| Reference Info. |
IEICE Tech. Rep. |
| Paper # |
|
| Date of Issue |
|
| ISSN |
|
| Download PDF |
|
| Conference Information |
| Committee |
HCGSYMPO |
| Conference Date |
2022-12-14 - 2022-12-16 |
| Place (in Japanese) |
(See Japanese page) |
| Place (in English) |
Onsite (Sunport Takamatsu) and Online |
| Topics (in Japanese) |
(See Japanese page) |
| Topics (in English) |
|
| Paper Information |
| Registration To |
HCGSYMPO |
| Conference Code |
2022-12-HCGSYMPO |
| Language |
Japanese |
| Title (in Japanese) |
(See Japanese page) |
| Sub Title (in Japanese) |
(See Japanese page) |
| Title (in English) |
Analyzing and Recognizing Synergetic Functions between Head Movements and Facial Expressions in Conversations |
| Sub Title (in English) |
|
| Keyword(1) |
nonverbal communication |
| Keyword(2) |
head movement |
| Keyword(3) |
facial expression |
| Keyword(4) |
convolutional neural network |
| Keyword(5) |
|
| Keyword(6) |
|
| Keyword(7) |
|
| Keyword(8) |
|
| 1st Author's Name |
Mai Imamura |
| 1st Author's Affiliation |
Yokohama National University (YNU) |
| 2nd Author's Name |
Kazuki Takeda |
| 2nd Author's Affiliation |
Yokohama National University (YNU) |
| 3rd Author's Name |
Shiro Kumano |
| 3rd Author's Affiliation |
Nippon Telegraph and Telephone Corporation (NTT) |
| 4th Author's Name |
Kazuhiro Otsuka |
| 4th Author's Affiliation |
Yokohama National University (YNU) |
| 5th Author's Name |
|
| 5th Author's Affiliation |
() |
| 6th Author's Name |
|
| 6th Author's Affiliation |
() |
| 7th Author's Name |
|
| 7th Author's Affiliation |
() |
| 8th Author's Name |
|
| 8th Author's Affiliation |
() |
| 9th Author's Name |
|
| 9th Author's Affiliation |
() |
| 10th Author's Name |
|
| 10th Author's Affiliation |
() |
| 11th Author's Name |
|
| 11th Author's Affiliation |
() |
| 12th Author's Name |
|
| 12th Author's Affiliation |
() |
| 13th Author's Name |
|
| 13th Author's Affiliation |
() |
| 14th Author's Name |
|
| 14th Author's Affiliation |
() |
| 15th Author's Name |
|
| 15th Author's Affiliation |
() |
| 16th Author's Name |
|
| 16th Author's Affiliation |
() |
| 17th Author's Name |
|
| 17th Author's Affiliation |
() |
| 18th Author's Name |
|
| 18th Author's Affiliation |
() |
| 19th Author's Name |
|
| 19th Author's Affiliation |
() |
| 20th Author's Name |
|
| 20th Author's Affiliation |
() |
| Speaker |
Author-1 |
| Date Time |
2022-12-14 23:25:00 |
| Presentation Time |
25 minutes |
| Registration for |
HCGSYMPO |
| Paper # |
|
| Volume (vol) |
vol. |
| Number (no) |
|
| Page |
|
| #Pages |
|
| Date of Issue |
|