Paper Abstract and Keywords |
Presentation |
2018-03-20 10:40
[Invited Talk]
Progress of Research on Cross-modal Scene Analysis Kunio Kashino (NTT) EA2017-166 SIP2017-175 SP2017-149 |
Abstract |
(in Japanese) |
(See Japanese page) |
(in English) |
The problem of scene analysis means to understand, or describe, various external objects or events associated with spatial and temporal information based on sensory input. It has been a major research topic over the past decades in multiple fields. In the engineering context, as symbolically shown in the terms such as computer vision and computational auditory scene analysis, a major approach has been defining the problem within a single modality and seeking its solutions by mathematical or heuristic means, and many multimodal approaches that use multiple types of sensory input in parallel have also been reported. However, it is still a hard problem when we consider, for example, understanding the scene as well as we humans do in the natural environment in our daily life, and it is likely that a breakthrough is needed to solve it. Against this background, another type of approach taking advantages of multiple modalities has emerged in recent years, supported by the rapid progress of deep learning technologies. In this talk, we call it cross-modal scene analysis. We review some of such works, and discuss potential implications and possibilities of this new research direction. |
Keyword |
(in Japanese) |
(See Japanese page) |
(in English) |
scene analysis / hashing / multi-modality / cross-modality / deep learning / / / |
Reference Info. |
IEICE Tech. Rep., vol. 117, no. 517, SP2017-149, pp. 353-353, March 2018. |
Paper # |
SP2017-149 |
Date of Issue |
2018-03-12 (EA, SIP, SP) |
ISSN |
Print edition: ISSN 0913-5685 Online edition: ISSN 2432-6380 |
Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) |
Download PDF |
EA2017-166 SIP2017-175 SP2017-149 |
Conference Information |
Committee |
SIP EA SP MI |
Conference Date |
2018-03-19 - 2018-03-20 |
Place (in Japanese) |
(See Japanese page) |
Place (in English) |
|
Topics (in Japanese) |
(See Japanese page) |
Topics (in English) |
Speech, Engineering/Electro Acoustics, Signal Processing, and Related Topics [SIP, EA, SP]/ Medical Image Engineering, Analysis, Recognition, etc. [MI] |
Paper Information |
Registration To |
SP |
Conference Code |
2018-03-SIP-EA-SP-MI |
Language |
Japanese |
Title (in Japanese) |
(See Japanese page) |
Sub Title (in Japanese) |
(See Japanese page) |
Title (in English) |
Progress of Research on Cross-modal Scene Analysis |
Sub Title (in English) |
|
Keyword(1) |
scene analysis |
Keyword(2) |
hashing |
Keyword(3) |
multi-modality |
Keyword(4) |
cross-modality |
Keyword(5) |
deep learning |
Keyword(6) |
|
Keyword(7) |
|
Keyword(8) |
|
1st Author's Name |
Kunio Kashino |
1st Author's Affiliation |
Nippon Telegraph and Telephone Corporation (NTT) |
2nd Author's Name |
|
2nd Author's Affiliation |
() |
3rd Author's Name |
|
3rd Author's Affiliation |
() |
4th Author's Name |
|
4th Author's Affiliation |
() |
5th Author's Name |
|
5th Author's Affiliation |
() |
6th Author's Name |
|
6th Author's Affiliation |
() |
7th Author's Name |
|
7th Author's Affiliation |
() |
8th Author's Name |
|
8th Author's Affiliation |
() |
9th Author's Name |
|
9th Author's Affiliation |
() |
10th Author's Name |
|
10th Author's Affiliation |
() |
11th Author's Name |
|
11th Author's Affiliation |
() |
12th Author's Name |
|
12th Author's Affiliation |
() |
13th Author's Name |
|
13th Author's Affiliation |
() |
14th Author's Name |
|
14th Author's Affiliation |
() |
15th Author's Name |
|
15th Author's Affiliation |
() |
16th Author's Name |
|
16th Author's Affiliation |
() |
17th Author's Name |
|
17th Author's Affiliation |
() |
18th Author's Name |
|
18th Author's Affiliation |
() |
19th Author's Name |
|
19th Author's Affiliation |
() |
20th Author's Name |
|
20th Author's Affiliation |
() |
Speaker |
Author-1 |
Date Time |
2018-03-20 10:40:00 |
Presentation Time |
50 minutes |
Registration for |
SP |
Paper # |
EA2017-166, SIP2017-175, SP2017-149 |
Volume (vol) |
vol.117 |
Number (no) |
no.515(EA), no.516(SIP), no.517(SP) |
Page |
p.353 |
#Pages |
1 |
Date of Issue |
2018-03-12 (EA, SIP, SP) |
|