IEICE Technical Committee Submission System
Conference Paper's Information
Online Proceedings
[Sign in]
Tech. Rep. Archives
 Go Top Page Go Previous   [Japanese] / [English] 

Paper Abstract and Keywords
Presentation 2010-09-06 10:40
Action planning for interactive visual scene understanding based on knowledge confidence defined on latent spaces
Gurbachan Sekhon (Univ. of British Columbia), Akisato Kimura, Yasuhiro Minami, Hitoshi Sakano, Eisaku Maeda (NTT) PRMU2010-83 IBISML2010-55
Abstract (in Japanese) (See Japanese page) 
(in English) This report proposes a method for action planning in a system of interactive visual scene understanding through the use of system knowledge and its confidence. The knowledge confidence is defined as the combination of the following two properties on the latent space of a topic model connecting image features and text labels: 1) Similarity between an input sample and training samples on the latent space, and 2) the overall associability between each text label as determined by the content of the training samples. We evaluate the proposed method in the context of annotation accuracy and effort for providing answers from users. The experimental results with PASCAL VOC2008 dataset indicate that our proposed method achieved comparable or better annotation accuracy with less effort compared with strategies of 1) always asking the name of objects and 2) generating random questions.
Keyword (in Japanese) (See Japanese page) 
(in English) image annotation / human-computer interaction / action planning / reinforcement learning / topic model / knowledge confidence / /  
Reference Info. IEICE Tech. Rep., vol. 110, no. 187, PRMU2010-83, pp. 201-208, Sept. 2010.
Paper # PRMU2010-83 
Date of Issue 2010-08-29 (PRMU, IBISML) 
ISSN Print edition: ISSN 0913-5685    Online edition: ISSN 2432-6380
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034)
Download PDF PRMU2010-83 IBISML2010-55

Conference Information
Conference Date 2010-09-05 - 2010-09-06 
Place (in Japanese) (See Japanese page) 
Place (in English) Fukuoka Univ. 
Topics (in Japanese) (See Japanese page) 
Topics (in English) Machine learning and optimization for computer vision and pattern recognition, etc. 
Paper Information
Registration To PRMU 
Conference Code 2010-09-IBISML-PRMU-CVIM 
Language English 
Title (in Japanese) (See Japanese page) 
Sub Title (in Japanese) (See Japanese page) 
Title (in English) Action planning for interactive visual scene understanding based on knowledge confidence defined on latent spaces 
Sub Title (in English)  
Keyword(1) image annotation  
Keyword(2) human-computer interaction  
Keyword(3) action planning  
Keyword(4) reinforcement learning  
Keyword(5) topic model  
Keyword(6) knowledge confidence  
1st Author's Name Gurbachan Sekhon  
1st Author's Affiliation University of British Columbia (Univ. of British Columbia)
2nd Author's Name Akisato Kimura  
2nd Author's Affiliation NTT (NTT)
3rd Author's Name Yasuhiro Minami  
3rd Author's Affiliation NTT (NTT)
4th Author's Name Hitoshi Sakano  
4th Author's Affiliation NTT (NTT)
5th Author's Name Eisaku Maeda  
5th Author's Affiliation NTT (NTT)
6th Author's Name  
6th Author's Affiliation ()
7th Author's Name  
7th Author's Affiliation ()
8th Author's Name  
8th Author's Affiliation ()
9th Author's Name  
9th Author's Affiliation ()
10th Author's Name  
10th Author's Affiliation ()
11th Author's Name  
11th Author's Affiliation ()
12th Author's Name  
12th Author's Affiliation ()
13th Author's Name  
13th Author's Affiliation ()
14th Author's Name  
14th Author's Affiliation ()
15th Author's Name  
15th Author's Affiliation ()
16th Author's Name  
16th Author's Affiliation ()
17th Author's Name  
17th Author's Affiliation ()
18th Author's Name  
18th Author's Affiliation ()
19th Author's Name  
19th Author's Affiliation ()
20th Author's Name  
20th Author's Affiliation ()
Speaker Author-2 
Date Time 2010-09-06 10:40:00 
Presentation Time 30 minutes 
Registration for PRMU 
Paper # PRMU2010-83, IBISML2010-55 
Volume (vol) vol.110 
Number (no) no.187(PRMU), no.188(IBISML) 
Page pp.201-208 
Date of Issue 2010-08-29 (PRMU, IBISML) 

[Return to Top Page]

[Return to IEICE Web Page]

The Institute of Electronics, Information and Communication Engineers (IEICE), Japan