| IEICE Technical Committee Submission System Conference Paper's Information |
Online Proceedings [Sign in] Tech. Rep. Archives |
| Go Top Page | Go Previous | [Japanese] / [English] |
| Paper Abstract and Keywords | ||
| Presentation | 2023-12-14 16:25 Implementation and evaluation of Double DQN and Noisy Network to Reinforcement learning for Automation of ICT System Design Hiroyuki Hochigai (Sophia Univ.), Yutaka Yakuwa (NEC), Natsuki Okamura, Zhou Tianchen (Sophia Univ.), Takayuki Kuroda (NEC), Ikuko Eguchi Yairi (Sophia Univ.)  NS2023-134 |
|
| Abstract | (in Japanese) | (See Japanese page) |
| (in English) | This paper introduces an efficient reinforcement learning method for the ICT system design process. Since the state space of the designing process is enormous and complex. Also, rewards obtained in the design process are significantly sparse. The proposed method aims to improve the automation of ICT System Design by combining reinforcement learning algorithms. This paper applied DoubleDQN, a reinforcement learning algorithm, and a noisy network, the structure of the graph neural network added a noisy layer in an automated design technology for ICT systems called Weaver. The former is an approach to improve the efficiency of Multi-Step Q-learning. The latter is parametric noise applied to the network, and this helps to reduce harmful overestimation from the network and aids the efficiency of exploration for Weaver. The evaluation result showed that applying both for Weaver could shorten the number of steps to design in a shorter time, stabilize learning, and improve the design accuracy of ICT systems. | |
| Keyword | (in Japanese) | (See Japanese page) |
| (in English) | / / / / / / / | |
| Reference Info. | IEICE Tech. Rep., vol. 123, no. 307, NS2023-134, pp. 48-53, Dec. 2023. | |
| Paper # | NS2023-134 | |
| Date of Issue | 2023-12-07 (NS) | |
| ISSN | Online edition: ISSN 2432-6380 | |
| Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) | |
| Download PDF | NS2023-134 |
|
| Conference Information | |
| Committee | NS RCS |
| Conference Date | 2023-12-14 - 2023-12-15 |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Kyushu Institute of Technology Tobata campus, and Online |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | Multi-hop/Relay/Cooperation, Disaster-resistant wireless network, Sensor/Mesh network, Ad-hoc network, D2D/M2M, Wireless network coding, Handover/AP switching/Connected cell control/Load balancing among base stations/Mobile network dynamic reconfiguration, QoS/QoE assurance, Wireless VoIP, IoT, Edge computing, etc. |
| Paper Information | |
| Registration To | NS |
| Conference Code | 2023-12-NS-RCS |
| Language | Japanese |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Implementation and evaluation of Double DQN and Noisy Network to Reinforcement learning for Automation of ICT System Design |
| Sub Title (in English) | |
| Keyword(1) | |
| Keyword(2) | |
| Keyword(3) | |
| Keyword(4) | |
| Keyword(5) | |
| Keyword(6) | |
| Keyword(7) | |
| Keyword(8) | |
| 1st Author's Name | Hiroyuki Hochigai |
| 1st Author's Affiliation | Sophia University (Sophia Univ.) |
| 2nd Author's Name | Yutaka Yakuwa |
| 2nd Author's Affiliation | NEC Corporation (NEC) |
| 3rd Author's Name | Natsuki Okamura |
| 3rd Author's Affiliation | Sophia University (Sophia Univ.) |
| 4th Author's Name | Zhou Tianchen |
| 4th Author's Affiliation | Sophia University (Sophia Univ.) |
| 5th Author's Name | Takayuki Kuroda |
| 5th Author's Affiliation | NEC Corporation (NEC) |
| 6th Author's Name | Ikuko Eguchi Yairi |
| 6th Author's Affiliation | Sophia University (Sophia Univ.) |
| 7th Author's Name | |
| 7th Author's Affiliation | () |
| 8th Author's Name | |
| 8th Author's Affiliation | () |
| 9th Author's Name | |
| 9th Author's Affiliation | () |
| 10th Author's Name | |
| 10th Author's Affiliation | () |
| 11th Author's Name | |
| 11th Author's Affiliation | () |
| 12th Author's Name | |
| 12th Author's Affiliation | () |
| 13th Author's Name | |
| 13th Author's Affiliation | () |
| 14th Author's Name | |
| 14th Author's Affiliation | () |
| 15th Author's Name | |
| 15th Author's Affiliation | () |
| 16th Author's Name | |
| 16th Author's Affiliation | () |
| 17th Author's Name | |
| 17th Author's Affiliation | () |
| 18th Author's Name | |
| 18th Author's Affiliation | () |
| Speaker | Author-1 |
| Date Time | 2023-12-14 16:25:00 |
| Presentation Time | 25 minutes |
| Registration for | NS |
| Paper # | NS2023-134 |
| Volume (vol) | vol.123 |
| Number (no) | no.307 |
| Page | pp.48-53 |
| #Pages | 6 |
| Date of Issue | 2023-12-07 (NS) |
[Return to Top Page]