| IEICE Technical Committee Submission System Conference Paper's Information |
Online Proceedings [Sign in] Tech. Rep. Archives |
| Go Top Page | Go Previous | [Japanese] / [English] |
| Paper Abstract and Keywords | ||
| Presentation | 2022-03-07 15:15 Project-domain adaptation with RoBERTa Model for Code Completion Daisuke Fukumoto, Toshiki Hirao (NAIST), Kenji Fujiwara (TCU), Hajimu Iida (NAIST)  SS2021-50 |
|
| Abstract | (in Japanese) | (See Japanese page) |
| (in English) | Code completion is a function that automatically recommends code for developers when they are writing code. Code completion can reduce coding time even for developers with insufficient skills. In the previous research, the machine learning-based completion that considers the context of the program and completes tokens in a more generally has been proposed. However, these previous studies have reported that the accuracy of completion decreases rapidly when the number of completing tokens increases. In this study, we propose a method that additionally trains RoBERTa, a machine learning model for natural language processing, on a dataset built in the domain of a developer's repository. We expect it can reduce the vocabulary recommended by the model and improve the completion accuracy. As a result of our experiments, we confirmed a improvement in accuracy compared to pre-trained model. | |
| Keyword | (in Japanese) | (See Japanese page) |
| (in English) | Code Completion / Transfer Learning / BERT / RoBERTa / / / / | |
| Reference Info. | IEICE Tech. Rep., vol. 121, no. 416, SS2021-50, pp. 49-53, March 2022. | |
| Paper # | SS2021-50 | |
| Date of Issue | 2022-02-28 (SS) | |
| ISSN | Online edition: ISSN 2432-6380 | |
| Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) | |
| Notes on Review | This article is a technical report without peer review, and its polished version will be published elsewhere. | |
| Download PDF | SS2021-50 |
|
| Conference Information | |
| Committee | SS |
| Conference Date | 2022-03-07 - 2022-03-08 |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Online |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | Software Science etc. |
| Paper Information | |
| Registration To | SS |
| Conference Code | 2022-03-SS |
| Language | Japanese |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Project-domain adaptation with RoBERTa Model for Code Completion |
| Sub Title (in English) | |
| Keyword(1) | Code Completion |
| Keyword(2) | Transfer Learning |
| Keyword(3) | BERT |
| Keyword(4) | RoBERTa |
| Keyword(5) | |
| Keyword(6) | |
| Keyword(7) | |
| Keyword(8) | |
| 1st Author's Name | Daisuke Fukumoto |
| 1st Author's Affiliation | Nara Institute of Science and Technology (NAIST) |
| 2nd Author's Name | Toshiki Hirao |
| 2nd Author's Affiliation | Nara Institute of Science and Technology (NAIST) |
| 3rd Author's Name | Kenji Fujiwara |
| 3rd Author's Affiliation | Tokyo City University (TCU) |
| 4th Author's Name | Hajimu Iida |
| 4th Author's Affiliation | Nara Institute of Science and Technology (NAIST) |
| 5th Author's Name | |
| 5th Author's Affiliation | () |
| 6th Author's Name | |
| 6th Author's Affiliation | () |
| 7th Author's Name | |
| 7th Author's Affiliation | () |
| 8th Author's Name | |
| 8th Author's Affiliation | () |
| 9th Author's Name | |
| 9th Author's Affiliation | () |
| 10th Author's Name | |
| 10th Author's Affiliation | () |
| 11th Author's Name | |
| 11th Author's Affiliation | () |
| 12th Author's Name | |
| 12th Author's Affiliation | () |
| 13th Author's Name | |
| 13th Author's Affiliation | () |
| 14th Author's Name | |
| 14th Author's Affiliation | () |
| 15th Author's Name | |
| 15th Author's Affiliation | () |
| 16th Author's Name | |
| 16th Author's Affiliation | () |
| 17th Author's Name | |
| 17th Author's Affiliation | () |
| 18th Author's Name | |
| 18th Author's Affiliation | () |
| Speaker | Author-1 |
| Date Time | 2022-03-07 15:15:00 |
| Presentation Time | 25 minutes |
| Registration for | SS |
| Paper # | SS2021-50 |
| Volume (vol) | vol.121 |
| Number (no) | no.416 |
| Page | pp.49-53 |
| #Pages | 5 |
| Date of Issue | 2022-02-28 (SS) |
[Return to Top Page]