IEICE Technical Committee Submission System
Conference Paper's Information
Online Proceedings
[Sign in]
Tech. Rep. Archives
 Go Top Page Go Previous   [Japanese] / [English] 

Paper Abstract and Keywords
Presentation 2022-11-18 14:00
Extrapolation of partial X-ray image for prediction of whole body musculoskeletal structure
Weiqi Zhang, Yi Gu, Yoshito Otake, Soufi Mazen (NAIST), Keisuke Uemura (Osaka Univ), Masaki Takao (Ehime Univ), Toshiaki Akashi (Juntendo Univ), Kensaku Mori (Nagoya Univ/NII), Kento Aida (NII), Nobuhiko Sugano (Osaka Univ), Yoshinobu Sato (NAIST) MICT2022-38 MI2022-67
Abstract (in Japanese) (See Japanese page) 
(in English) Image defects and partial disorders are common problems in medical imaging. Image inpainting and extrapolation are helpful techniques to restore missing image information for many clinical applications, including analyzing organs or tissues that are not scanned during imaging processing. Many image restoration algorithms have been proposed for general images. However, numerous challenges still exist in restoring medical images, such as domain shifting and limited datasets. Conventional methods for medical image restoration only focused on recovering small regions within a given image, ignoring clinical demands for extrapolation. In this study, we proposed a method based on the transformer for restoring an X-ray image with large regions, which supports whole-body restoration from a partial region, using mutual conversion between an X-ray image and a digitally reconstructed radiograph. Our method combined an extrapolation network and a style transfer network, simultaneously achieving the inpainting and extrapolating of an X-ray image under a limited dataset. To the best of our knowledge, we are the first to achieve whole-body restoration from an X-ray image. We conducted 1) quantitative and qualitative experiments on the extrapolation and style transfer models and 2) bone mineral density (BMD) estimation experiments from extrapolated X-ray images generated by the proposed method. We used the predicted and ground-truth BMD correlation to evaluate our model's effectiveness, which achieved PCC of 0.374 and 0.534 in DXA-measured and QCT-measured BMD, respectively, demonstrating the high clinical potential of analyzing missing regions using the proposed method.
Keyword (in Japanese) (See Japanese page) 
(in English) Image Extrapolation / X-ray Image / Transformer / Bone Mineral Density (BMD) Estimation / / / /  
Reference Info. IEICE Tech. Rep., vol. 122, no. 265, MI2022-67, pp. 24-28, Nov. 2022.
Paper # MI2022-67 
Date of Issue 2022-11-11 (MICT, MI) 
ISSN Online edition: ISSN 2432-6380
Copyright
and
reproduction
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034)
Download PDF MICT2022-38 MI2022-67

Conference Information
Committee MICT MI  
Conference Date 2022-11-18 - 2022-11-18 
Place (in Japanese) (See Japanese page) 
Place (in English) Nagoya Institute of Technology 
Topics (in Japanese) (See Japanese page) 
Topics (in English) Medical imaging technology, healthcare and medical information communication technology, etc. 
Paper Information
Registration To MI 
Conference Code 2022-11-MICT-MI 
Language English (Japanese title is available) 
Title (in Japanese) (See Japanese page) 
Sub Title (in Japanese) (See Japanese page) 
Title (in English) Extrapolation of partial X-ray image for prediction of whole body musculoskeletal structure 
Sub Title (in English)  
Keyword(1) Image Extrapolation  
Keyword(2) X-ray Image  
Keyword(3) Transformer  
Keyword(4) Bone Mineral Density (BMD) Estimation  
Keyword(5)  
Keyword(6)  
Keyword(7)  
Keyword(8)  
1st Author's Name Weiqi Zhang  
1st Author's Affiliation Nara Institute of Science and Technology (NAIST)
2nd Author's Name Yi Gu  
2nd Author's Affiliation Nara Institute of Science and Technology (NAIST)
3rd Author's Name Yoshito Otake  
3rd Author's Affiliation Nara Institute of Science and Technology (NAIST)
4th Author's Name Soufi Mazen  
4th Author's Affiliation Nara Institute of Science and Technology (NAIST)
5th Author's Name Keisuke Uemura  
5th Author's Affiliation Osaka University (Osaka Univ)
6th Author's Name Masaki Takao  
6th Author's Affiliation Ehime University (Ehime Univ)
7th Author's Name Toshiaki Akashi  
7th Author's Affiliation Juntendo University (Juntendo Univ)
8th Author's Name Kensaku Mori  
8th Author's Affiliation Nagoya University/National Institute of Informatics (Nagoya Univ/NII)
9th Author's Name Kento Aida  
9th Author's Affiliation National Institute of Informatics (NII)
10th Author's Name Nobuhiko Sugano  
10th Author's Affiliation Osaka University (Osaka Univ)
11th Author's Name Yoshinobu Sato  
11th Author's Affiliation Nara Institute of Science and Technology (NAIST)
12th Author's Name  
12th Author's Affiliation ()
13th Author's Name  
13th Author's Affiliation ()
14th Author's Name  
14th Author's Affiliation ()
15th Author's Name  
15th Author's Affiliation ()
16th Author's Name  
16th Author's Affiliation ()
17th Author's Name  
17th Author's Affiliation ()
18th Author's Name  
18th Author's Affiliation ()
19th Author's Name  
19th Author's Affiliation ()
20th Author's Name  
20th Author's Affiliation ()
Speaker Author-1 
Date Time 2022-11-18 14:00:00 
Presentation Time 25 minutes 
Registration for MI 
Paper # MICT2022-38, MI2022-67 
Volume (vol) vol.122 
Number (no) no.264(MICT), no.265(MI) 
Page pp.24-28 
#Pages
Date of Issue 2022-11-11 (MICT, MI) 


[Return to Top Page]

[Return to IEICE Web Page]


The Institute of Electronics, Information and Communication Engineers (IEICE), Japan