| IEICE Technical Committee Submission System Conference Paper's Information |
Online Proceedings [Sign in] Tech. Rep. Archives |
| Go Top Page | Go Previous | [Japanese] / [English] |
| Paper Abstract and Keywords | ||
| Presentation | 2013-12-02 17:10 New techniques of high-speed data processing for spacecraft observation data via NICT Science Cloud Ken T. Murata, Hidenobu Watanabe (NICT), Yoshiya Kasahara, Daisuke Yagi (Kanazawa Univ.), Yasuko Kasai, Shoken Ishii, Kazunori Yamamoto (NICT), Eizen Kimura (Ehime Univ.), Osamu Tatebe, Masahiro Tanaka (Univ. Tsukuba), Kentaro Ukawa, Kazuya Muranaga, Yutaka Suzuki (SEC), Hirotsugu Kojima (Kyoto Univ.)  SANE2013-94 |
|
| Abstract | (in Japanese) | (See Japanese page) |
| (in English) | A variety of satellite missions, Earth observations and environments, Space physics and Astrophysics and Commercial uses, are carried out every year. Most of the satellites yield a large-scale data, and high-performance data processing technologies are expected. We have been developing a cloud system (the NICT Science Cloud) for big data analyses of Earth and Space observations via spacecraft. In the present study we propose a new technique to process large-scale data with paying attention to the fact that high-speed I/O (data file read and write) is important compared with data processing itself. We also adopt a task scheduler, the Pwrake, for easy management of parallel data processing. Using a long-time scientific satellite observation data (GEOTAIL satellite), we examine performance of the system on the NICT Science Cloud. We successfully archive high-speed data processing more than 100 times faster than those on traditional data processing environments. Since the design of the present system is for versatile use, we also discuss how to apply for other satellite missions such as GOSAT satellite, KAGUYA satellite and ISOSIM-L (a radar simulator). | |
| Keyword | (in Japanese) | (See Japanese page) |
| (in English) | Satellite data / Earth and space observation / data processing / NICT Science Cloud / parallel file system / Gfarm / Pwrake / | |
| Reference Info. | IEICE Tech. Rep., vol. 113, no. 335, SANE2013-94, pp. 133-138, Dec. 2013. | |
| Paper # | SANE2013-94 | |
| Date of Issue | 2013-11-25 (SANE) | |
| ISSN | Print edition: ISSN 0913-5685 Online edition: ISSN 2432-6380 | |
| Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) | |
| Download PDF | SANE2013-94 |
|
| Conference Information | |
| Committee | SANE |
| Conference Date | 2013-12-02 - 2013-12-03 |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | VAST/VNSC(2nd Dec.) & Melia Hotel (3rd Dec), Hanoi, Vietnam |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | ICSANE 2013 (International Conference on Space, Aeronautical and Navigational Electronics) |
| Paper Information | |
| Registration To | SANE |
| Conference Code | 2013-12-SANE |
| Language | English (Japanese title is available) |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | New techniques of high-speed data processing for spacecraft observation data via NICT Science Cloud |
| Sub Title (in English) | |
| Keyword(1) | Satellite data |
| Keyword(2) | Earth and space observation |
| Keyword(3) | data processing |
| Keyword(4) | NICT Science Cloud |
| Keyword(5) | parallel file system |
| Keyword(6) | Gfarm |
| Keyword(7) | Pwrake |
| Keyword(8) | |
| 1st Author's Name | Ken T. Murata |
| 1st Author's Affiliation | National Institute of Information and Communications Technology (NICT) |
| 2nd Author's Name | Hidenobu Watanabe |
| 2nd Author's Affiliation | National Institute of Information and Communications Technology (NICT) |
| 3rd Author's Name | Yoshiya Kasahara |
| 3rd Author's Affiliation | Kanazawa University (Kanazawa Univ.) |
| 4th Author's Name | Daisuke Yagi |
| 4th Author's Affiliation | Kanazawa University (Kanazawa Univ.) |
| 5th Author's Name | Yasuko Kasai |
| 5th Author's Affiliation | National Institute of Information and Communications Technology (NICT) |
| 6th Author's Name | Shoken Ishii |
| 6th Author's Affiliation | National Institute of Information and Communications Technology (NICT) |
| 7th Author's Name | Kazunori Yamamoto |
| 7th Author's Affiliation | National Institute of Information and Communications Technology (NICT) |
| 8th Author's Name | Eizen Kimura |
| 8th Author's Affiliation | Ehime University (Ehime Univ.) |
| 9th Author's Name | Osamu Tatebe |
| 9th Author's Affiliation | University of Tsukuba (Univ. Tsukuba) |
| 10th Author's Name | Masahiro Tanaka |
| 10th Author's Affiliation | University of Tsukuba (Univ. Tsukuba) |
| 11th Author's Name | Kentaro Ukawa |
| 11th Author's Affiliation | Systems Engineering Consultants Co., LTD. (SEC) |
| 12th Author's Name | Kazuya Muranaga |
| 12th Author's Affiliation | Systems Engineering Consultants Co., LTD. (SEC) |
| 13th Author's Name | Yutaka Suzuki |
| 13th Author's Affiliation | Systems Engineering Consultants Co., LTD. (SEC) |
| 14th Author's Name | Hirotsugu Kojima |
| 14th Author's Affiliation | Kyoto University (Kyoto Univ.) |
| 15th Author's Name | |
| 15th Author's Affiliation | () |
| 16th Author's Name | |
| 16th Author's Affiliation | () |
| 17th Author's Name | |
| 17th Author's Affiliation | () |
| 18th Author's Name | |
| 18th Author's Affiliation | () |
| Speaker | Author-1 |
| Date Time | 2013-12-02 17:10:00 |
| Presentation Time | 20 minutes |
| Registration for | SANE |
| Paper # | SANE2013-94 |
| Volume (vol) | vol.113 |
| Number (no) | no.335 |
| Page | pp.133-138 |
| #Pages | 6 |
| Date of Issue | 2013-11-25 (SANE) |
[Return to Top Page]