| IEICE Technical Committee Submission System Conference Paper's Information |
Online Proceedings [Sign in] Tech. Rep. Archives |
| Go Top Page | Go Previous | [Japanese] / [English] |
| Paper Abstract and Keywords | ||
| Presentation | 2021-08-05 14:25 Digital Implement of 3-layered Neural Networks with Stochastic Activation, Shunting Inhibition, and a Dual-rail Backpropagation Yoshiaki Sasaki, Seiya Muramatsu, Kohei Nishida, Megumi Akai-Kasaya, Tetsuya Asai (Hokkaido Univ.)  CCS2021-16 |
|
| Abstract | (in Japanese) | (See Japanese page) |
| (in English) | Stochastic computing (SC) is an arithmetic technique that enables various operations to be performed with a small number of logic gates in exchange for operational accuracy. In this paper, we discuss the realization of an edge AI integrated circuit with a learning function based on the SC. First, we propose a logic circuit that realizes an area-efficient activation function that does not require decoding in the midst of forward operations. Next, we propose a method to realize an operation equivalent to subtraction, which is considered to be difficult in SC, as well as propose a new arithmetic method that mimics the synaptic transmission of neural circuits. By assuming the input to the activation function, we also propose a summation operation that utilizes imperfect addition, which has rarely been used in SC. By introducing these arithmetic methods, we propose a digital implementation of a multilayer perceptron based on the SC. First, we learn simple logic operations and then learn linear and nonlinear regression problems. We then demonstrate the feasibility of SC-based machine learning. The method presented herein will expand the options of edge AI integrated circuits using SC and may contribute to the development of edge AI integrated circuits in the future. | |
| Keyword | (in Japanese) | (See Japanese page) |
| (in English) | Stochastic Computing / Machine Learning / Neural Network / Edge AI Integrated Circuit / Backpropagation / / / | |
| Reference Info. | IEICE Tech. Rep., vol. 121, no. 134, CCS2021-16, pp. 7-13, Aug. 2021. | |
| Paper # | CCS2021-16 | |
| Date of Issue | 2021-07-29 (CCS) | |
| ISSN | Online edition: ISSN 2432-6380 | |
| Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) | |
| Download PDF | CCS2021-16 |
|
| Conference Information | |
| Committee | IN CCS |
| Conference Date | 2021-08-05 - 2021-08-05 |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Online |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | Network Science, Future Network, Cloud/SDN/Virtualization, Contents Delivery/Contents Exchange, and others |
| Paper Information | |
| Registration To | CCS |
| Conference Code | 2021-08-IN-CCS |
| Language | Japanese |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Digital Implement of 3-layered Neural Networks with Stochastic Activation, Shunting Inhibition, and a Dual-rail Backpropagation |
| Sub Title (in English) | |
| Keyword(1) | Stochastic Computing |
| Keyword(2) | Machine Learning |
| Keyword(3) | Neural Network |
| Keyword(4) | Edge AI Integrated Circuit |
| Keyword(5) | Backpropagation |
| Keyword(6) | |
| Keyword(7) | |
| Keyword(8) | |
| 1st Author's Name | Yoshiaki Sasaki |
| 1st Author's Affiliation | Hokkaido University (Hokkaido Univ.) |
| 2nd Author's Name | Seiya Muramatsu |
| 2nd Author's Affiliation | Hokkaido University (Hokkaido Univ.) |
| 3rd Author's Name | Kohei Nishida |
| 3rd Author's Affiliation | Hokkaido University (Hokkaido Univ.) |
| 4th Author's Name | Megumi Akai-Kasaya |
| 4th Author's Affiliation | Hokkaido University (Hokkaido Univ.) |
| 5th Author's Name | Tetsuya Asai |
| 5th Author's Affiliation | Hokkaido University (Hokkaido Univ.) |
| 6th Author's Name | |
| 6th Author's Affiliation | () |
| 7th Author's Name | |
| 7th Author's Affiliation | () |
| 8th Author's Name | |
| 8th Author's Affiliation | () |
| 9th Author's Name | |
| 9th Author's Affiliation | () |
| 10th Author's Name | |
| 10th Author's Affiliation | () |
| 11th Author's Name | |
| 11th Author's Affiliation | () |
| 12th Author's Name | |
| 12th Author's Affiliation | () |
| 13th Author's Name | |
| 13th Author's Affiliation | () |
| 14th Author's Name | |
| 14th Author's Affiliation | () |
| 15th Author's Name | |
| 15th Author's Affiliation | () |
| 16th Author's Name | |
| 16th Author's Affiliation | () |
| 17th Author's Name | |
| 17th Author's Affiliation | () |
| 18th Author's Name | |
| 18th Author's Affiliation | () |
| Speaker | Author-1 |
| Date Time | 2021-08-05 14:25:00 |
| Presentation Time | 25 minutes |
| Registration for | CCS |
| Paper # | CCS2021-16 |
| Volume (vol) | vol.121 |
| Number (no) | no.134 |
| Page | pp.7-13 |
| #Pages | 7 |
| Date of Issue | 2021-07-29 (CCS) |
[Return to Top Page]