Paper Abstract and Keywords |
Presentation |
2021-03-04 11:00
Application Offloading Mechanism based on Distributed Reinforcement Learning in MEC Environment Soh Takamura, Takao Kondo, Fumio Teraoka (Keio Univ.) IN2020-67 |
Abstract |
(in Japanese) |
(See Japanese page) |
(in English) |
This paper proposes a mechanism for determining the offloading strategy of an application running on a User Equipment (UE) with battery and computational resource constraints based on distributed reinforcement learning, a form of reinforcement learning, assuming a Multi-access Edge Computing (MEC) environment. The MEC environment envisioned in this paper consists of a large number of UEs, multiple MEC servers, and a cloud server. A group of UEs executing an application requests and collects from a neighboring MEC server an estimated reward value, which serves as a decision indicator for the offload destination, and the UE determines the MEC server for offloading based on the collected estimated reward values. The UE sends the results of the application execution via the MEC server to the cloud server. The cloud server updates the learning model at regular intervals and synchronizes it with the MEC servers. The above process is expected to reduce the battery consumption of the UEs in an unstable wireless communication environment.In the evaluation, we evaluated the offload selection for image processing applications in the UEs, assuming game rendering, in terms of learning convergence speed and energy consumption.The number of UEs was varied according to the mobility scenario of the UEs. 20 UEs converged 9 times faster than 1 UE, and 2.4 times faster than 10 UEs. |
Keyword |
(in Japanese) |
(See Japanese page) |
(in English) |
MEC / Deep Reinforcement Learning / Distributed Reinforcement Learning / / / / / |
Reference Info. |
IEICE Tech. Rep., vol. 120, no. 414, IN2020-67, pp. 79-84, March 2021. |
Paper # |
IN2020-67 |
Date of Issue |
2021-02-25 (IN) |
ISSN |
Online edition: ISSN 2432-6380 |
Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) |
Download PDF |
IN2020-67 |
Conference Information |
Committee |
IN NS |
Conference Date |
2021-03-04 - 2021-03-05 |
Place (in Japanese) |
(See Japanese page) |
Place (in English) |
Online |
Topics (in Japanese) |
(See Japanese page) |
Topics (in English) |
General |
Paper Information |
Registration To |
IN |
Conference Code |
2021-03-IN-NS |
Language |
Japanese |
Title (in Japanese) |
(See Japanese page) |
Sub Title (in Japanese) |
(See Japanese page) |
Title (in English) |
Application Offloading Mechanism based on Distributed Reinforcement Learning in MEC Environment |
Sub Title (in English) |
|
Keyword(1) |
MEC |
Keyword(2) |
Deep Reinforcement Learning |
Keyword(3) |
Distributed Reinforcement Learning |
Keyword(4) |
|
Keyword(5) |
|
Keyword(6) |
|
Keyword(7) |
|
Keyword(8) |
|
1st Author's Name |
Soh Takamura |
1st Author's Affiliation |
Keio University (Keio Univ.) |
2nd Author's Name |
Takao Kondo |
2nd Author's Affiliation |
Keio University (Keio Univ.) |
3rd Author's Name |
Fumio Teraoka |
3rd Author's Affiliation |
Keio University (Keio Univ.) |
4th Author's Name |
|
4th Author's Affiliation |
() |
5th Author's Name |
|
5th Author's Affiliation |
() |
6th Author's Name |
|
6th Author's Affiliation |
() |
7th Author's Name |
|
7th Author's Affiliation |
() |
8th Author's Name |
|
8th Author's Affiliation |
() |
9th Author's Name |
|
9th Author's Affiliation |
() |
10th Author's Name |
|
10th Author's Affiliation |
() |
11th Author's Name |
|
11th Author's Affiliation |
() |
12th Author's Name |
|
12th Author's Affiliation |
() |
13th Author's Name |
|
13th Author's Affiliation |
() |
14th Author's Name |
|
14th Author's Affiliation |
() |
15th Author's Name |
|
15th Author's Affiliation |
() |
16th Author's Name |
|
16th Author's Affiliation |
() |
17th Author's Name |
|
17th Author's Affiliation |
() |
18th Author's Name |
|
18th Author's Affiliation |
() |
19th Author's Name |
|
19th Author's Affiliation |
() |
20th Author's Name |
|
20th Author's Affiliation |
() |
Speaker |
Author-1 |
Date Time |
2021-03-04 11:00:00 |
Presentation Time |
20 minutes |
Registration for |
IN |
Paper # |
IN2020-67 |
Volume (vol) |
vol.120 |
Number (no) |
no.414 |
Page |
pp.79-84 |
#Pages |
6 |
Date of Issue |
2021-02-25 (IN) |
|