Paper Abstract and Keywords |
Presentation |
2018-07-30 11:15
Analysis of commercial cloud workload and study on how to apply cache methods Kazuichi Oe, Kazutaka Ogihara (FLABO), Takeo Honda (FST) CPSY2018-14 |
Abstract |
(in Japanese) |
(See Japanese page) |
(in English) |
We analyzed some storage workloads of the FUJITSU K5 cloud service, which was built using the
OpenStack platform, to clarify how to handle these workloads effectively. We retrieved these storage workloads and
analyzed them from the viwe point of both temporal and spatial access locality. For temporal access locality, we
classified these workloads as two input/output (IO) access patterns. One was that the number of IO accesses was
high only for a specific time and the other was that the number of IO accesses was almost stable. For both temporal
and spatial access locality, we found that almost all workloads included IO concentrations. Such concentrations
are aggregations of IO accesses and appear in narrow regions of a storage volume and continue for periods of up
to an hour. Therefore, we studied how to apply cache methods by using a cache simulator. The cache hit ratios
varied with workload, but almost half of the workloads had low cache hit ratios because they included few page-level
regularities. Automated tiered storage with fast memory and slow flash storage (ATSMF), which was we proposed
in our previous study, can handle IO concentration effectively because its migration algorithm found the entire area
of IO concentration and migrated it from slow storage to fast storage if the migration improves user’s performance.
We predict that the cache hit ratios of ATSMF will be much higher than the half workloads of the Least Recently
Used and Adaptive Replacement Cache algorithms. Therefore, we should develop a technique that combines ATSMF
and traditional caching. From the results of temporal access locality, we can a share fast storage area among several
workloads when these workloads have different times when the number of IO accesses is high. Moreover, we should
preferentially allocate a fast storage area to IO concentrated workloads, which accounts for only 1.2% of the total
workloads, because these workloads include more than half of all IO accesses. |
Keyword |
(in Japanese) |
(See Japanese page) |
(in English) |
Cloud workload / analysis / caching / LRU / ARC / IO concentration / ATSMF / |
Reference Info. |
IEICE Tech. Rep., vol. 118, no. 165, CPSY2018-14, pp. 7-12, July 2018. |
Paper # |
CPSY2018-14 |
Date of Issue |
2018-07-23 (CPSY) |
ISSN |
Online edition: ISSN 2432-6380 |
Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) |
Download PDF |
CPSY2018-14 |
Conference Information |
Committee |
CPSY DC IPSJ-ARC |
Conference Date |
2018-07-30 - 2018-08-01 |
Place (in Japanese) |
(See Japanese page) |
Place (in English) |
Kumamoto City International Center |
Topics (in Japanese) |
(See Japanese page) |
Topics (in English) |
Parallel, Distributed and Cooperative Processing Systems and Dependable Computing |
Paper Information |
Registration To |
CPSY |
Conference Code |
2018-07-CPSY-DC-ARC |
Language |
English |
Title (in Japanese) |
(See Japanese page) |
Sub Title (in Japanese) |
(See Japanese page) |
Title (in English) |
Analysis of commercial cloud workload and study on how to apply cache methods |
Sub Title (in English) |
|
Keyword(1) |
Cloud workload |
Keyword(2) |
analysis |
Keyword(3) |
caching |
Keyword(4) |
LRU |
Keyword(5) |
ARC |
Keyword(6) |
IO concentration |
Keyword(7) |
ATSMF |
Keyword(8) |
|
1st Author's Name |
Kazuichi Oe |
1st Author's Affiliation |
Fujitsu Laboratories LTD. (FLABO) |
2nd Author's Name |
Kazutaka Ogihara |
2nd Author's Affiliation |
Fujitsu Laboratories LTD. (FLABO) |
3rd Author's Name |
Takeo Honda |
3rd Author's Affiliation |
FST (FST) |
4th Author's Name |
|
4th Author's Affiliation |
() |
5th Author's Name |
|
5th Author's Affiliation |
() |
6th Author's Name |
|
6th Author's Affiliation |
() |
7th Author's Name |
|
7th Author's Affiliation |
() |
8th Author's Name |
|
8th Author's Affiliation |
() |
9th Author's Name |
|
9th Author's Affiliation |
() |
10th Author's Name |
|
10th Author's Affiliation |
() |
11th Author's Name |
|
11th Author's Affiliation |
() |
12th Author's Name |
|
12th Author's Affiliation |
() |
13th Author's Name |
|
13th Author's Affiliation |
() |
14th Author's Name |
|
14th Author's Affiliation |
() |
15th Author's Name |
|
15th Author's Affiliation |
() |
16th Author's Name |
|
16th Author's Affiliation |
() |
17th Author's Name |
|
17th Author's Affiliation |
() |
18th Author's Name |
|
18th Author's Affiliation |
() |
19th Author's Name |
|
19th Author's Affiliation |
() |
20th Author's Name |
|
20th Author's Affiliation |
() |
Speaker |
Author-1 |
Date Time |
2018-07-30 11:15:00 |
Presentation Time |
30 minutes |
Registration for |
CPSY |
Paper # |
CPSY2018-14 |
Volume (vol) |
vol.118 |
Number (no) |
no.165 |
Page |
pp.7-12 |
#Pages |
6 |
Date of Issue |
2018-07-23 (CPSY) |
|