Paper Abstract and Keywords |
Presentation |
2013-03-08 09:00
Load Balancing and Approximate Memory Minimization in Scale-Out System Architecture for Processing Requests That Follow Zipfian Distribution Takao Yamashita, Hiroyuki Kurita, Naoki Takada, Takuya Minami, Kenji Ota (NTT) IN2012-177 |
Abstract |
(in Japanese) |
(See Japanese page) |
(in English) |
In this paper, we propose a load balancing method to process requests that follow a Zipfian distribution, which has extremely large variance. This large variance of a Zipfian distribution leads to the imbalance of server loads. To solve this problem, we enhanced a previously proposed method that achieves load balancing among servers processing requests with a Zipf-like distribution, where every request has a key used to identify a service. In the previously proposed method, the range of key ranks, which are the places in the order of how frequently the key is used, is divided into three regions: hot, normal, and cold zones, where one of three different ways to process requests is used for every zone. To process requests with keys in the hot and cold zones, round-robin load balancing and consistent hashing are used, respectively. In addition, in order to process requests with keys in the normal zone, requests are processed by a number of servers that is less than the number of all servers. The enhanced method described in this paper approximately minimizes the total amount of memory needed for all servers as well as achieves load balancing. The minimization is accomplished by arranging the boundaries between the hot and normal zones, and between the normal and cold zones. We evaluated the enhanced method by simulation in terms of the amount of memory and the variance of server loads. The simulation showed that it can significantly decrease the amount of memory as well as achieve load balancing, compared to existing methods. |
Keyword |
(in Japanese) |
(See Japanese page) |
(in English) |
Zipfian distribution / scale out / round robin / consistent hashing / load balancing / / / |
Reference Info. |
IEICE Tech. Rep., vol. 112, no. 464, IN2012-177, pp. 137-142, March 2013. |
Paper # |
IN2012-177 |
Date of Issue |
2013-02-28 (IN) |
ISSN |
Print edition: ISSN 0913-5685 Online edition: ISSN 2432-6380 |
Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) |
Download PDF |
IN2012-177 |
Conference Information |
Committee |
NS IN |
Conference Date |
2013-03-07 - 2013-03-08 |
Place (in Japanese) |
(See Japanese page) |
Place (in English) |
Okinawa Zanpamisaki Royal Hotel |
Topics (in Japanese) |
(See Japanese page) |
Topics (in English) |
General |
Paper Information |
Registration To |
IN |
Conference Code |
2013-03-NS-IN |
Language |
Japanese |
Title (in Japanese) |
(See Japanese page) |
Sub Title (in Japanese) |
(See Japanese page) |
Title (in English) |
Load Balancing and Approximate Memory Minimization in Scale-Out System Architecture for Processing Requests That Follow Zipfian Distribution |
Sub Title (in English) |
|
Keyword(1) |
Zipfian distribution |
Keyword(2) |
scale out |
Keyword(3) |
round robin |
Keyword(4) |
consistent hashing |
Keyword(5) |
load balancing |
Keyword(6) |
|
Keyword(7) |
|
Keyword(8) |
|
1st Author's Name |
Takao Yamashita |
1st Author's Affiliation |
NTT Network Service Systems Laboratories (NTT) |
2nd Author's Name |
Hiroyuki Kurita |
2nd Author's Affiliation |
NTT Network Service Systems Laboratories (NTT) |
3rd Author's Name |
Naoki Takada |
3rd Author's Affiliation |
NTT Network Service Systems Laboratories (NTT) |
4th Author's Name |
Takuya Minami |
4th Author's Affiliation |
NTT Network Service Systems Laboratories (NTT) |
5th Author's Name |
Kenji Ota |
5th Author's Affiliation |
NTT Network Service Systems Laboratories (NTT) |
6th Author's Name |
|
6th Author's Affiliation |
() |
7th Author's Name |
|
7th Author's Affiliation |
() |
8th Author's Name |
|
8th Author's Affiliation |
() |
9th Author's Name |
|
9th Author's Affiliation |
() |
10th Author's Name |
|
10th Author's Affiliation |
() |
11th Author's Name |
|
11th Author's Affiliation |
() |
12th Author's Name |
|
12th Author's Affiliation |
() |
13th Author's Name |
|
13th Author's Affiliation |
() |
14th Author's Name |
|
14th Author's Affiliation |
() |
15th Author's Name |
|
15th Author's Affiliation |
() |
16th Author's Name |
|
16th Author's Affiliation |
() |
17th Author's Name |
|
17th Author's Affiliation |
() |
18th Author's Name |
|
18th Author's Affiliation |
() |
19th Author's Name |
|
19th Author's Affiliation |
() |
20th Author's Name |
|
20th Author's Affiliation |
() |
Speaker |
Author-1 |
Date Time |
2013-03-08 09:00:00 |
Presentation Time |
20 minutes |
Registration for |
IN |
Paper # |
IN2012-177 |
Volume (vol) |
vol.112 |
Number (no) |
no.464 |
Page |
pp.137-142 |
#Pages |
6 |
Date of Issue |
2013-02-28 (IN) |
|