| IEICE Technical Committee Submission System Conference Paper's Information |
Online Proceedings [Sign in] Tech. Rep. Archives |
| Go Top Page | Go Previous | [Japanese] / [English] |
| Paper Abstract and Keywords | ||
| Presentation | 2021-05-13 10:05 Parallelism optimization method for analytical processing on hybrid cloud. Kaori Murase, Shinichi, Satoshi Kaneko, Kouichi Murayama (Hitachi, Ltd.)  ICM2021-3 |
|
| Abstract | (in Japanese) | (See Japanese page) |
| (in English) | A hybrid data analytics platform that consists of data lake on on-premise and servers for analytical processing on public cloud has the advantages of both detailed data management and flexible performance adjustment. However, for some cases cost performance declines due to design policy differences between on-premise and public cloud. For instance, cases where degree of parallelism for data analytics is set higher than necessary since it is difficult to change amount of processing resources of on-premise immediately. In this paper, we propose an optimization method for determining degree of parallelism based on allocatable on-premise resources of the hybrid data analytics platform. We prospect that it can predict appropriate degree of parallelism, and achieve an improved cost performance. | |
| Keyword | (in Japanese) | (See Japanese page) |
| (in English) | Data analytics platform / Hybrid cloud storage / Parallelism / ETL / Optimization / / / | |
| Reference Info. | IEICE Tech. Rep., vol. 121, no. 13, ICM2021-3, pp. 13-18, May 2021. | |
| Paper # | ICM2021-3 | |
| Date of Issue | 2021-05-06 (ICM) | |
| ISSN | Online edition: ISSN 2432-6380 | |
| Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) | |
| Download PDF | ICM2021-3 |
|
| Conference Information | |
| Committee | ICM IPSJ-CSEC IPSJ-IOT |
| Conference Date | 2021-05-13 - 2021-05-14 |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Online |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Paper Information | |
| Registration To | ICM |
| Conference Code | 2021-05-ICM-CSEC-IOT |
| Language | Japanese |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Parallelism optimization method for analytical processing on hybrid cloud. |
| Sub Title (in English) | |
| Keyword(1) | Data analytics platform |
| Keyword(2) | Hybrid cloud storage |
| Keyword(3) | Parallelism |
| Keyword(4) | ETL |
| Keyword(5) | Optimization |
| Keyword(6) | |
| Keyword(7) | |
| Keyword(8) | |
| 1st Author's Name | Kaori Murase |
| 1st Author's Affiliation | Hitachi, Ltd. Research & Development Group (Hitachi, Ltd.) |
| 2nd Author's Name | Shinichi |
| 2nd Author's Affiliation | Hitachi, Ltd. Research & Development Group (Hitachi, Ltd.) |
| 3rd Author's Name | Satoshi Kaneko |
| 3rd Author's Affiliation | Hitachi, Ltd. Research & Development Group (Hitachi, Ltd.) |
| 4th Author's Name | Kouichi Murayama |
| 4th Author's Affiliation | Hitachi, Ltd. Research & Development Group (Hitachi, Ltd.) |
| 5th Author's Name | |
| 5th Author's Affiliation | () |
| 6th Author's Name | |
| 6th Author's Affiliation | () |
| 7th Author's Name | |
| 7th Author's Affiliation | () |
| 8th Author's Name | |
| 8th Author's Affiliation | () |
| 9th Author's Name | |
| 9th Author's Affiliation | () |
| 10th Author's Name | |
| 10th Author's Affiliation | () |
| 11th Author's Name | |
| 11th Author's Affiliation | () |
| 12th Author's Name | |
| 12th Author's Affiliation | () |
| 13th Author's Name | |
| 13th Author's Affiliation | () |
| 14th Author's Name | |
| 14th Author's Affiliation | () |
| 15th Author's Name | |
| 15th Author's Affiliation | () |
| 16th Author's Name | |
| 16th Author's Affiliation | () |
| 17th Author's Name | |
| 17th Author's Affiliation | () |
| 18th Author's Name | |
| 18th Author's Affiliation | () |
| Speaker | Author-1 |
| Date Time | 2021-05-13 10:05:00 |
| Presentation Time | 25 minutes |
| Registration for | ICM |
| Paper # | ICM2021-3 |
| Volume (vol) | vol.121 |
| Number (no) | no.13 |
| Page | pp.13-18 |
| #Pages | 6 |
| Date of Issue | 2021-05-06 (ICM) |
[Return to Top Page]