Paper Abstract and Keywords |
Presentation |
2021-05-25 12:50
Development of a Job Interview Training System with Multi-modal Behavior Analysis Nao Takeuchi, Tomoko Koda (OIT) HCS2021-10 HIP2021-10 |
Abstract |
(in Japanese) |
(See Japanese page) |
(in English) |
This paper introduces a job interview training system that recognizes the nonverbal behaviors of the interviewee, namely, gaze, facial expression, and posture. The proposed system uses a Tobii eye tracker for gaze recognition, and camera images for facial expression and posture recognition. The system compares the recognition results with the models of the interviewee's exemplary nonverbal behaviors and point out the non-verbal behaviors that need improvement while playing back the interview recording. Our development policy of the system is to construct an inexpensive and easy system using commercially available HWs and open source, and utilization of a CG agent that gives feedback to the interviewee. Most of the current interview training systems require high-end HW and SW and are not designed for general users, and there are few systems using CG agents to give feedback. The results of the initial evaluation of the system indicate improvements are needed in terms of recognition accuracy of non-verbal behaviors and quality of the interaction with the CG agent. |
Keyword |
(in Japanese) |
(See Japanese page) |
(in English) |
gaze recognition / posture recognition / facial expression recognition / job interview training / nonverbal behaviors / CG agent / multi-modal interaction / |
Reference Info. |
IEICE Tech. Rep., vol. 121, no. 37, HCS2021-10, pp. 50-54, May 2021. |
Paper # |
HCS2021-10 |
Date of Issue |
2021-05-17 (HCS, HIP) |
ISSN |
Online edition: ISSN 2432-6380 |
Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) |
Download PDF |
HCS2021-10 HIP2021-10 |
Conference Information |
Committee |
HCS HIP HI-SIGCOASTER |
Conference Date |
2021-05-24 - 2021-05-25 |
Place (in Japanese) |
(See Japanese page) |
Place (in English) |
Online |
Topics (in Japanese) |
(See Japanese page) |
Topics (in English) |
Communication Enhancing, Human Communications, and Human Information Processing |
Paper Information |
Registration To |
HCS |
Conference Code |
2021-05-HCS-HIP-SIGCE |
Language |
Japanese |
Title (in Japanese) |
(See Japanese page) |
Sub Title (in Japanese) |
(See Japanese page) |
Title (in English) |
Development of a Job Interview Training System with Multi-modal Behavior Analysis |
Sub Title (in English) |
|
Keyword(1) |
gaze recognition |
Keyword(2) |
posture recognition |
Keyword(3) |
facial expression recognition |
Keyword(4) |
job interview training |
Keyword(5) |
nonverbal behaviors |
Keyword(6) |
CG agent |
Keyword(7) |
multi-modal interaction |
Keyword(8) |
|
1st Author's Name |
Nao Takeuchi |
1st Author's Affiliation |
Osaka Institute of Technology (OIT) |
2nd Author's Name |
Tomoko Koda |
2nd Author's Affiliation |
Osaka Institute of Technology (OIT) |
3rd Author's Name |
|
3rd Author's Affiliation |
() |
4th Author's Name |
|
4th Author's Affiliation |
() |
5th Author's Name |
|
5th Author's Affiliation |
() |
6th Author's Name |
|
6th Author's Affiliation |
() |
7th Author's Name |
|
7th Author's Affiliation |
() |
8th Author's Name |
|
8th Author's Affiliation |
() |
9th Author's Name |
|
9th Author's Affiliation |
() |
10th Author's Name |
|
10th Author's Affiliation |
() |
11th Author's Name |
|
11th Author's Affiliation |
() |
12th Author's Name |
|
12th Author's Affiliation |
() |
13th Author's Name |
|
13th Author's Affiliation |
() |
14th Author's Name |
|
14th Author's Affiliation |
() |
15th Author's Name |
|
15th Author's Affiliation |
() |
16th Author's Name |
|
16th Author's Affiliation |
() |
17th Author's Name |
|
17th Author's Affiliation |
() |
18th Author's Name |
|
18th Author's Affiliation |
() |
19th Author's Name |
|
19th Author's Affiliation |
() |
20th Author's Name |
|
20th Author's Affiliation |
() |
Speaker |
Author-1 |
Date Time |
2021-05-25 12:50:00 |
Presentation Time |
25 minutes |
Registration for |
HCS |
Paper # |
HCS2021-10, HIP2021-10 |
Volume (vol) |
vol.121 |
Number (no) |
no.37(HCS), no.38(HIP) |
Page |
pp.50-54 |
#Pages |
5 |
Date of Issue |
2021-05-17 (HCS, HIP) |
|