| IEICE Technical Committee Submission System Conference Paper's Information |
Online Proceedings [Sign in] Tech. Rep. Archives |
| Go Top Page | Go Previous | [Japanese] / [English] |
| Paper Abstract and Keywords | ||
| Presentation | 2023-01-22 14:05 Analysis of Role of Multimodal Information and Physiological Signals in Self-Reported and Third-Party Sentiment Estimation Shun Katada, Shogo Okada (JAIST), Kazunori Komatani (Osaka Univ.)  HCS2022-70 |
|
| Abstract | (in Japanese) | (See Japanese page) |
| (in English) | A dialogue system needs to adapt its utterance by estimating a user's internal state. Most of the previous multimodal sentiment analyses use third-party sentiment label; however, a user's self-sentiment annotated by the user themselves is often ignored. Physiological signals can detect subtle changes in self-sentiment. While the relationship between text, acoustic and visual modalities has been analyzed, the relationship between physiological signals and the three modalities has not been well discussed. In this study, we construct sentiment estimation models based on text, acoustic, visual, and physiological information, and compared them for the two types of sentiment estimation. As a result, the fusion of the text and physiological modalities is effective for self-sentiment estimation. In contrast, the fusion of the text and audiovisual modalities is effective for third-party sentiment estimation. Thus, it is suggested that effective modalities for sentiment estimation depend on the type of sentiment labels. | |
| Keyword | (in Japanese) | (See Japanese page) |
| (in English) | self-sentiment / third-party sentiment / multimodal information / physiological signal / / / / | |
| Reference Info. | IEICE Tech. Rep., vol. 122, no. 349, HCS2022-70, pp. 86-91, Jan. 2023. | |
| Paper # | HCS2022-70 | |
| Date of Issue | 2023-01-14 (HCS) | |
| ISSN | Online edition: ISSN 2432-6380 | |
| Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) | |
| Download PDF | HCS2022-70 |
|
| Conference Information | |
| Committee | HCS |
| Conference Date | 2023-01-21 - 2023-01-22 |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Kyoto Institute of Technology |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | Physical Communication, etc. |
| Paper Information | |
| Registration To | HCS |
| Conference Code | 2023-01-HCS |
| Language | Japanese |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Analysis of Role of Multimodal Information and Physiological Signals in Self-Reported and Third-Party Sentiment Estimation |
| Sub Title (in English) | |
| Keyword(1) | self-sentiment |
| Keyword(2) | third-party sentiment |
| Keyword(3) | multimodal information |
| Keyword(4) | physiological signal |
| Keyword(5) | |
| Keyword(6) | |
| Keyword(7) | |
| Keyword(8) | |
| 1st Author's Name | Shun Katada |
| 1st Author's Affiliation | Japan Advanced Institute of Science and Technology (JAIST) |
| 2nd Author's Name | Shogo Okada |
| 2nd Author's Affiliation | Japan Advanced Institute of Science and Technology (JAIST) |
| 3rd Author's Name | Kazunori Komatani |
| 3rd Author's Affiliation | Osaka University (Osaka Univ.) |
| 4th Author's Name | |
| 4th Author's Affiliation | () |
| 5th Author's Name | |
| 5th Author's Affiliation | () |
| 6th Author's Name | |
| 6th Author's Affiliation | () |
| 7th Author's Name | |
| 7th Author's Affiliation | () |
| 8th Author's Name | |
| 8th Author's Affiliation | () |
| 9th Author's Name | |
| 9th Author's Affiliation | () |
| 10th Author's Name | |
| 10th Author's Affiliation | () |
| 11th Author's Name | |
| 11th Author's Affiliation | () |
| 12th Author's Name | |
| 12th Author's Affiliation | () |
| 13th Author's Name | |
| 13th Author's Affiliation | () |
| 14th Author's Name | |
| 14th Author's Affiliation | () |
| 15th Author's Name | |
| 15th Author's Affiliation | () |
| 16th Author's Name | |
| 16th Author's Affiliation | () |
| 17th Author's Name | |
| 17th Author's Affiliation | () |
| 18th Author's Name | |
| 18th Author's Affiliation | () |
| Speaker | Author-1 |
| Date Time | 2023-01-22 14:05:00 |
| Presentation Time | 25 minutes |
| Registration for | HCS |
| Paper # | HCS2022-70 |
| Volume (vol) | vol.122 |
| Number (no) | no.349 |
| Page | pp.86-91 |
| #Pages | 6 |
| Date of Issue | 2023-01-14 (HCS) |
[Return to Top Page]