Paper Abstract and Keywords |
Presentation |
2015-03-28 10:55
Parallel Processing of Large-Scale Graphs Using Spark on GPGPU Yuki Inamoto, Mikio Aoyama (Nanzan Univ.) SC2014-19 |
Abstract |
(in Japanese) |
(See Japanese page) |
(in English) |
We propose a high performance computing method for large-scale graphs using the Spark on GPGPU. RDD, multiple sets of abstract data of Spark, cannot be processed on the device memory on GPU. In this article, we propose a processing method on GPU in consideration of the attributes of the RDD. We divide an RDD on a device memory into two kinds of data, which enables Spark to accelerate the thread-level parallel processing on the GPU under the constraint of the RDD. We measured and compared computing time of graph processing of the conventional CPU, the proposed method on Spark and the other high performance graph processing method. |
Keyword |
(in Japanese) |
(See Japanese page) |
(in English) |
Parallel Distributed Processing / Apache Spark / GPGPU / Hadoop / / / / |
Reference Info. |
IEICE Tech. Rep., vol. 114, no. 525, SC2014-19, pp. 31-36, March 2015. |
Paper # |
SC2014-19 |
Date of Issue |
2015-03-20 (SC) |
ISSN |
Print edition: ISSN 0913-5685 Online edition: ISSN 2432-6380 |
Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) |
Download PDF |
SC2014-19 |
Conference Information |
Committee |
SC |
Conference Date |
2015-03-27 - 2015-03-28 |
Place (in Japanese) |
(See Japanese page) |
Place (in English) |
Aizu Univ. |
Topics (in Japanese) |
(See Japanese page) |
Topics (in English) |
QoS, SLA, Policy of Service and Cloud and Other Issues |
Paper Information |
Registration To |
SC |
Conference Code |
2015-03-SC |
Language |
Japanese |
Title (in Japanese) |
(See Japanese page) |
Sub Title (in Japanese) |
(See Japanese page) |
Title (in English) |
Parallel Processing of Large-Scale Graphs Using Spark on GPGPU |
Sub Title (in English) |
|
Keyword(1) |
Parallel Distributed Processing |
Keyword(2) |
Apache Spark |
Keyword(3) |
GPGPU |
Keyword(4) |
Hadoop |
Keyword(5) |
|
Keyword(6) |
|
Keyword(7) |
|
Keyword(8) |
|
1st Author's Name |
Yuki Inamoto |
1st Author's Affiliation |
Nanzan University (Nanzan Univ.) |
2nd Author's Name |
Mikio Aoyama |
2nd Author's Affiliation |
Nanzan University (Nanzan Univ.) |
3rd Author's Name |
|
3rd Author's Affiliation |
() |
4th Author's Name |
|
4th Author's Affiliation |
() |
5th Author's Name |
|
5th Author's Affiliation |
() |
6th Author's Name |
|
6th Author's Affiliation |
() |
7th Author's Name |
|
7th Author's Affiliation |
() |
8th Author's Name |
|
8th Author's Affiliation |
() |
9th Author's Name |
|
9th Author's Affiliation |
() |
10th Author's Name |
|
10th Author's Affiliation |
() |
11th Author's Name |
|
11th Author's Affiliation |
() |
12th Author's Name |
|
12th Author's Affiliation |
() |
13th Author's Name |
|
13th Author's Affiliation |
() |
14th Author's Name |
|
14th Author's Affiliation |
() |
15th Author's Name |
|
15th Author's Affiliation |
() |
16th Author's Name |
|
16th Author's Affiliation |
() |
17th Author's Name |
|
17th Author's Affiliation |
() |
18th Author's Name |
|
18th Author's Affiliation |
() |
19th Author's Name |
|
19th Author's Affiliation |
() |
20th Author's Name |
|
20th Author's Affiliation |
() |
Speaker |
Author-1 |
Date Time |
2015-03-28 10:55:00 |
Presentation Time |
25 minutes |
Registration for |
SC |
Paper # |
SC2014-19 |
Volume (vol) |
vol.114 |
Number (no) |
no.525 |
Page |
pp.31-36 |
#Pages |
6 |
Date of Issue |
2015-03-20 (SC) |
|