Paper Abstract and Keywords |
Presentation |
2010-09-06 10:40
Action planning for interactive visual scene understanding based on knowledge confidence defined on latent spaces Gurbachan Sekhon (Univ. of British Columbia), Akisato Kimura, Yasuhiro Minami, Hitoshi Sakano, Eisaku Maeda (NTT) PRMU2010-83 IBISML2010-55 |
Abstract |
(in Japanese) |
(See Japanese page) |
(in English) |
This report proposes a method for action planning in a system of interactive visual scene understanding through the use of system knowledge and its confidence. The knowledge confidence is defined as the combination of the following two properties on the latent space of a topic model connecting image features and text labels: 1) Similarity between an input sample and training samples on the latent space, and 2) the overall associability between each text label as determined by the content of the training samples. We evaluate the proposed method in the context of annotation accuracy and effort for providing answers from users. The experimental results with PASCAL VOC2008 dataset indicate that our proposed method achieved comparable or better annotation accuracy with less effort compared with strategies of 1) always asking the name of objects and 2) generating random questions. |
Keyword |
(in Japanese) |
(See Japanese page) |
(in English) |
image annotation / human-computer interaction / action planning / reinforcement learning / topic model / knowledge confidence / / |
Reference Info. |
IEICE Tech. Rep., vol. 110, no. 187, PRMU2010-83, pp. 201-208, Sept. 2010. |
Paper # |
PRMU2010-83 |
Date of Issue |
2010-08-29 (PRMU, IBISML) |
ISSN |
Print edition: ISSN 0913-5685 Online edition: ISSN 2432-6380 |
Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) |
Download PDF |
PRMU2010-83 IBISML2010-55 |
Conference Information |
Committee |
IBISML PRMU IPSJ-CVIM |
Conference Date |
2010-09-05 - 2010-09-06 |
Place (in Japanese) |
(See Japanese page) |
Place (in English) |
Fukuoka Univ. |
Topics (in Japanese) |
(See Japanese page) |
Topics (in English) |
Machine learning and optimization for computer vision and pattern recognition, etc. |
Paper Information |
Registration To |
PRMU |
Conference Code |
2010-09-IBISML-PRMU-CVIM |
Language |
English |
Title (in Japanese) |
(See Japanese page) |
Sub Title (in Japanese) |
(See Japanese page) |
Title (in English) |
Action planning for interactive visual scene understanding based on knowledge confidence defined on latent spaces |
Sub Title (in English) |
|
Keyword(1) |
image annotation |
Keyword(2) |
human-computer interaction |
Keyword(3) |
action planning |
Keyword(4) |
reinforcement learning |
Keyword(5) |
topic model |
Keyword(6) |
knowledge confidence |
Keyword(7) |
|
Keyword(8) |
|
1st Author's Name |
Gurbachan Sekhon |
1st Author's Affiliation |
University of British Columbia (Univ. of British Columbia) |
2nd Author's Name |
Akisato Kimura |
2nd Author's Affiliation |
NTT (NTT) |
3rd Author's Name |
Yasuhiro Minami |
3rd Author's Affiliation |
NTT (NTT) |
4th Author's Name |
Hitoshi Sakano |
4th Author's Affiliation |
NTT (NTT) |
5th Author's Name |
Eisaku Maeda |
5th Author's Affiliation |
NTT (NTT) |
6th Author's Name |
|
6th Author's Affiliation |
() |
7th Author's Name |
|
7th Author's Affiliation |
() |
8th Author's Name |
|
8th Author's Affiliation |
() |
9th Author's Name |
|
9th Author's Affiliation |
() |
10th Author's Name |
|
10th Author's Affiliation |
() |
11th Author's Name |
|
11th Author's Affiliation |
() |
12th Author's Name |
|
12th Author's Affiliation |
() |
13th Author's Name |
|
13th Author's Affiliation |
() |
14th Author's Name |
|
14th Author's Affiliation |
() |
15th Author's Name |
|
15th Author's Affiliation |
() |
16th Author's Name |
|
16th Author's Affiliation |
() |
17th Author's Name |
|
17th Author's Affiliation |
() |
18th Author's Name |
|
18th Author's Affiliation |
() |
19th Author's Name |
|
19th Author's Affiliation |
() |
20th Author's Name |
|
20th Author's Affiliation |
() |
Speaker |
Author-2 |
Date Time |
2010-09-06 10:40:00 |
Presentation Time |
30 minutes |
Registration for |
PRMU |
Paper # |
PRMU2010-83, IBISML2010-55 |
Volume (vol) |
vol.110 |
Number (no) |
no.187(PRMU), no.188(IBISML) |
Page |
pp.201-208 |
#Pages |
8 |
Date of Issue |
2010-08-29 (PRMU, IBISML) |
|