| IEICE Technical Committee Submission System Conference Paper's Information |
Online Proceedings [Sign in] Tech. Rep. Archives |
| Go Top Page | Go Previous | [Japanese] / [English] |
| Paper Abstract and Keywords | ||
| Presentation | 2021-09-16 14:35 Performance Validation of Pre-Trained BERT in the Financial Domain Masahiro Suzuki, Hiroki Sakaji, Masanori Hirano, Kiyoashi Izumi (The Univ. of Tokyo)  NLC2021-12 |
|
| Abstract | (in Japanese) | (See Japanese page) |
| (in English) | Recently, general-purpose language models pre-trained on large corpora such as BERT have been widely used. In Japanese, several pre-trained models based on Wikipedia have been published. On the other hand, general-purpose models may not be sufficiently effective in the financial domain because of the use of specialized phrases. In this study, we construct a pre-training model using a corpus of the financial domain, and evaluate it on a task in the financial domain. | |
| Keyword | (in Japanese) | (See Japanese page) |
| (in English) | Natural language processing / Language resources / BERT / Financial text / / / / | |
| Reference Info. | IEICE Tech. Rep., vol. 121, no. 178, NLC2021-12, pp. 26-29, Sept. 2021. | |
| Paper # | NLC2021-12 | |
| Date of Issue | 2021-09-09 (NLC) | |
| ISSN | Online edition: ISSN 2432-6380 | |
| Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) | |
| Download PDF | NLC2021-12 |
|
| Conference Information | |
| Committee | NLC |
| Conference Date | 2021-09-16 - 2021-09-16 |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Online |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | The 18th Text Analytics Symposium |
| Paper Information | |
| Registration To | NLC |
| Conference Code | 2021-09-NLC |
| Language | Japanese |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Performance Validation of Pre-Trained BERT in the Financial Domain |
| Sub Title (in English) | |
| Keyword(1) | Natural language processing |
| Keyword(2) | Language resources |
| Keyword(3) | BERT |
| Keyword(4) | Financial text |
| Keyword(5) | |
| Keyword(6) | |
| Keyword(7) | |
| Keyword(8) | |
| 1st Author's Name | Masahiro Suzuki |
| 1st Author's Affiliation | The University of Tokyo (The Univ. of Tokyo) |
| 2nd Author's Name | Hiroki Sakaji |
| 2nd Author's Affiliation | The University of Tokyo (The Univ. of Tokyo) |
| 3rd Author's Name | Masanori Hirano |
| 3rd Author's Affiliation | The University of Tokyo (The Univ. of Tokyo) |
| 4th Author's Name | Kiyoashi Izumi |
| 4th Author's Affiliation | The University of Tokyo (The Univ. of Tokyo) |
| 5th Author's Name | |
| 5th Author's Affiliation | () |
| 6th Author's Name | |
| 6th Author's Affiliation | () |
| 7th Author's Name | |
| 7th Author's Affiliation | () |
| 8th Author's Name | |
| 8th Author's Affiliation | () |
| 9th Author's Name | |
| 9th Author's Affiliation | () |
| 10th Author's Name | |
| 10th Author's Affiliation | () |
| 11th Author's Name | |
| 11th Author's Affiliation | () |
| 12th Author's Name | |
| 12th Author's Affiliation | () |
| 13th Author's Name | |
| 13th Author's Affiliation | () |
| 14th Author's Name | |
| 14th Author's Affiliation | () |
| 15th Author's Name | |
| 15th Author's Affiliation | () |
| 16th Author's Name | |
| 16th Author's Affiliation | () |
| 17th Author's Name | |
| 17th Author's Affiliation | () |
| 18th Author's Name | |
| 18th Author's Affiliation | () |
| Speaker | Author-1 |
| Date Time | 2021-09-16 14:35:00 |
| Presentation Time | 25 minutes |
| Registration for | NLC |
| Paper # | NLC2021-12 |
| Volume (vol) | vol.121 |
| Number (no) | no.178 |
| Page | pp.26-29 |
| #Pages | 4 |
| Date of Issue | 2021-09-09 (NLC) |
[Return to Top Page]