| Paper Abstract and Keywords |
| Presentation |
2015-12-16 16:20
Automatic Gaze Analysis in Medium-sized Multiparty Conversations based on Collective First-Person Vision
Shiro Kumano, Kazuhiro Otsuka, Ryo Ishii, Junji Yamato (NTT) |
| Abstract |
(in Japanese) |
(See Japanese page) |
| (in English) |
We target medium-sized-party face-to-face conversations where each person wears inward- and outward-facing cameras. We demonstrate that the fundamental techniques required for group gaze analysis, i.e. speaker detection, face tracking, and gaze estimation, can be accurately and effectively performed via self-training in a unified framework. This is achieved by gathering captured audio-visual signals to a centralized system and using a general conversation rule, i.e. listeners look mainly at the speaker. We visualize the characteristics of participants' gaze behavior as a gazee-centered heat map, which quantitatively reveals what parts of the gazee's body and for how long the participant looked at it while the gazer speaks or listens. An experiment involving two groups of six-person conversations demonstrates the potential of the proposed framework. |
| Keyword |
(in Japanese) |
(See Japanese page) |
| (in English) |
Egocentric vision / gaze / eye-contact / multiparty meeting / calibration / utterance / / |
| Reference Info. |
IEICE Tech. Rep. |
| Paper # |
|
| Date of Issue |
|
| ISSN |
|
| Download PDF |
|
| Conference Information |
| Committee |
HCGSYMPO |
| Conference Date |
2015-12-16 - 2015-12-18 |
| Place (in Japanese) |
(See Japanese page) |
| Place (in English) |
Toyama International Conference Center |
| Topics (in Japanese) |
(See Japanese page) |
| Topics (in English) |
Human communication, etc. |
| Paper Information |
| Registration To |
HCGSYMPO |
| Conference Code |
2015-12-HCGSYMPO |
| Language |
Japanese |
| Title (in Japanese) |
(See Japanese page) |
| Sub Title (in Japanese) |
(See Japanese page) |
| Title (in English) |
Automatic Gaze Analysis in Medium-sized Multiparty Conversations based on Collective First-Person Vision |
| Sub Title (in English) |
|
| Keyword(1) |
Egocentric vision |
| Keyword(2) |
gaze |
| Keyword(3) |
eye-contact |
| Keyword(4) |
multiparty meeting |
| Keyword(5) |
calibration |
| Keyword(6) |
utterance |
| Keyword(7) |
|
| Keyword(8) |
|
| 1st Author's Name |
Shiro Kumano |
| 1st Author's Affiliation |
Nippon Telegraph and Telephone Corporation (NTT) |
| 2nd Author's Name |
Kazuhiro Otsuka |
| 2nd Author's Affiliation |
Nippon Telegraph and Telephone Corporation (NTT) |
| 3rd Author's Name |
Ryo Ishii |
| 3rd Author's Affiliation |
Nippon Telegraph and Telephone Corporation (NTT) |
| 4th Author's Name |
Junji Yamato |
| 4th Author's Affiliation |
Nippon Telegraph and Telephone Corporation (NTT) |
| 5th Author's Name |
|
| 5th Author's Affiliation |
() |
| 6th Author's Name |
|
| 6th Author's Affiliation |
() |
| 7th Author's Name |
|
| 7th Author's Affiliation |
() |
| 8th Author's Name |
|
| 8th Author's Affiliation |
() |
| 9th Author's Name |
|
| 9th Author's Affiliation |
() |
| 10th Author's Name |
|
| 10th Author's Affiliation |
() |
| 11th Author's Name |
|
| 11th Author's Affiliation |
() |
| 12th Author's Name |
|
| 12th Author's Affiliation |
() |
| 13th Author's Name |
|
| 13th Author's Affiliation |
() |
| 14th Author's Name |
|
| 14th Author's Affiliation |
() |
| 15th Author's Name |
|
| 15th Author's Affiliation |
() |
| 16th Author's Name |
|
| 16th Author's Affiliation |
() |
| 17th Author's Name |
|
| 17th Author's Affiliation |
() |
| 18th Author's Name |
|
| 18th Author's Affiliation |
() |
| 19th Author's Name |
|
| 19th Author's Affiliation |
() |
| 20th Author's Name |
|
| 20th Author's Affiliation |
() |
| Speaker |
Author-1 |
| Date Time |
2015-12-16 16:20:00 |
| Presentation Time |
25 minutes |
| Registration for |
HCGSYMPO |
| Paper # |
|
| Volume (vol) |
vol. |
| Number (no) |
|
| Page |
|
| #Pages |
|
| Date of Issue |
|