IEICE Technical Committee Submission System
Conference Paper's Information
Online Proceedings
[Sign in]
Tech. Rep. Archives
 Go Top Page Go Previous   [Japanese] / [English] 

Paper Abstract and Keywords
Presentation 2022-02-22 15:20
A Note on Perceived Visual Content Estimation Based on Compressed Reconstruction Network Using Brain Signals While Gazing on Images
Takaaki Higashi, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama (Hokkaido University)
Abstract (in Japanese) (See Japanese page) 
(in English) In this paper, we propose a method to reconstruct a perceived image using brain signals obtained during gazing images. Specifically, a compressive reconstruction network, which can reconstruct a perceived image, is constructed. We estimate the compressed representation of the perceived image obtained as latent variables from brain signals, and the decoder of the compressive reconstruction network can reconstruct the perceived image. Furthermore, in our method, we construct a multimodal compressive reconstruction network that can reconstruct not only a perceived image but also visual features of the image. Then, latent variables considering semantic information of the perceived image can be extracted. By taking account of semantic information of the perceived image, it is expected to improve both the estimation accuracy of the compressed representation and the reconstruction accuracy of the perceived image.
Keyword (in Japanese) (See Japanese page) 
(in English) brain decoding / functional magnetic resonance imaging / convolutional neural network / machine learning / multimodal VAE / / /  
Reference Info. IEICE Tech. Rep.
Paper #  
Date of Issue  
ISSN  
Download PDF

Conference Information
Committee IE ITS ITE-AIT ITE-ME ITE-MMS  
Conference Date 2022-02-21 - 2022-02-22 
Place (in Japanese) (See Japanese page) 
Place (in English) Online 
Topics (in Japanese) (See Japanese page) 
Topics (in English) Image Processing, etc. 
Paper Information
Registration To ITE-ME 
Conference Code 2022-02-AIT-ME-MMS-IE-ITS 
Language Japanese 
Title (in Japanese) (See Japanese page) 
Sub Title (in Japanese) (See Japanese page) 
Title (in English) A Note on Perceived Visual Content Estimation Based on Compressed Reconstruction Network Using Brain Signals While Gazing on Images 
Sub Title (in English)  
Keyword(1) brain decoding  
Keyword(2) functional magnetic resonance imaging  
Keyword(3) convolutional neural network  
Keyword(4) machine learning  
Keyword(5) multimodal VAE  
Keyword(6)  
Keyword(7)  
Keyword(8)  
1st Author's Name Takaaki Higashi  
1st Author's Affiliation Hokkaido University (Hokkaido University)
2nd Author's Name Keisuke Maeda  
2nd Author's Affiliation Hokkaido University (Hokkaido University)
3rd Author's Name Takahiro Ogawa  
3rd Author's Affiliation Hokkaido University (Hokkaido University)
4th Author's Name Miki Haseyama  
4th Author's Affiliation Hokkaido University (Hokkaido University)
5th Author's Name  
5th Author's Affiliation ()
6th Author's Name  
6th Author's Affiliation ()
7th Author's Name  
7th Author's Affiliation ()
8th Author's Name  
8th Author's Affiliation ()
9th Author's Name  
9th Author's Affiliation ()
10th Author's Name  
10th Author's Affiliation ()
11th Author's Name  
11th Author's Affiliation ()
12th Author's Name  
12th Author's Affiliation ()
13th Author's Name  
13th Author's Affiliation ()
14th Author's Name  
14th Author's Affiliation ()
15th Author's Name  
15th Author's Affiliation ()
16th Author's Name  
16th Author's Affiliation ()
17th Author's Name  
17th Author's Affiliation ()
18th Author's Name  
18th Author's Affiliation ()
19th Author's Name  
19th Author's Affiliation ()
20th Author's Name  
20th Author's Affiliation ()
Speaker Author-1 
Date Time 2022-02-22 15:20:00 
Presentation Time 15 minutes 
Registration for ITE-ME 
Paper #  
Volume (vol) vol.121 
Number (no)  
Page  
#Pages  
Date of Issue  


[Return to Top Page]

[Return to IEICE Web Page]


The Institute of Electronics, Information and Communication Engineers (IEICE), Japan