| IEICE Technical Committee Submission System Conference Paper's Information |
Online Proceedings [Sign in] Tech. Rep. Archives |
| Go Top Page | Go Previous | [Japanese] / [English] |
| Paper Abstract and Keywords | ||
| Presentation | 2023-03-02 10:55 Report on the 3rd Lip-Reading Challenge Takeshi Saitoh (Kyutech), Yuto Goto, Hiroyuki Nagano, Akihiro Kato, Masaki Nose (RICOH), Naoki Hiramoto (Mercoin), Tomohiro Hattori, Shiiya Aoyama, Yusuke Katoh, Ryuta Toshima, Takumi Nagawaki, Satoshi Tamura (Gifu University), Daiki Arakane (Kyutech)  PRMU2022-76 IBISML2022-83 |
|
| Abstract | (in Japanese) | (See Japanese page) |
| (in English) | There is a machine lip-reading technology that uses a computer to estimate the utterance content using only visual information without using audio information. Despite more than 40 years of engineering analysis, it has not yet been put to practical use. Therefore, we planned the ``machine lip-reading challenge'' for the purpose of revitalizing the field of machine lip-reading research. When we held the 1st and 2nd machine lip-reading challenges in 2018 and 2019, we set the classification problem of 25 Japanese words as a task. Since high accuracy was achieved in the 2nd challenge, in 2022, the 3rd challenge, we held the problem of estimating the phoneme label sequence of Japanese sentences as a task. In this paper, we report on the overview of the competition, the database, the models of the baseline and the three participating teams, and the results. | |
| Keyword | (in Japanese) | (See Japanese page) |
| (in English) | Lip-reading / sentence / competition / / / / / | |
| Reference Info. | IEICE Tech. Rep., vol. 122, no. 404, PRMU2022-76, pp. 97-101, March 2023. | |
| Paper # | PRMU2022-76 | |
| Date of Issue | 2023-02-23 (PRMU, IBISML) | |
| ISSN | Online edition: ISSN 2432-6380 | |
| Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) | |
| Download PDF | PRMU2022-76 IBISML2022-83 |
|
| Conference Information | |
| Committee | PRMU IBISML IPSJ-CVIM |
| Conference Date | 2023-03-02 - 2023-03-03 |
| Place (in Japanese) | (See Japanese page) |
| Place (in English) | Future University Hakodate |
| Topics (in Japanese) | (See Japanese page) |
| Topics (in English) | |
| Paper Information | |
| Registration To | PRMU |
| Conference Code | 2023-03-PRMU-IBISML-CVIM |
| Language | Japanese |
| Title (in Japanese) | (See Japanese page) |
| Sub Title (in Japanese) | (See Japanese page) |
| Title (in English) | Report on the 3rd Lip-Reading Challenge |
| Sub Title (in English) | |
| Keyword(1) | Lip-reading |
| Keyword(2) | sentence |
| Keyword(3) | competition |
| Keyword(4) | |
| Keyword(5) | |
| Keyword(6) | |
| Keyword(7) | |
| Keyword(8) | |
| 1st Author's Name | Takeshi Saitoh |
| 1st Author's Affiliation | Kyushu Institute of Technology (Kyutech) |
| 2nd Author's Name | Yuto Goto |
| 2nd Author's Affiliation | Ricoh Company, Ltd. (RICOH) |
| 3rd Author's Name | Hiroyuki Nagano |
| 3rd Author's Affiliation | Ricoh Company, Ltd. (RICOH) |
| 4th Author's Name | Akihiro Kato |
| 4th Author's Affiliation | Ricoh Company, Ltd. (RICOH) |
| 5th Author's Name | Masaki Nose |
| 5th Author's Affiliation | Ricoh Company, Ltd. (RICOH) |
| 6th Author's Name | Naoki Hiramoto |
| 6th Author's Affiliation | Mercoin, Inc. (Mercoin) |
| 7th Author's Name | Tomohiro Hattori |
| 7th Author's Affiliation | Gifu University (Gifu University) |
| 8th Author's Name | Shiiya Aoyama |
| 8th Author's Affiliation | Gifu University (Gifu University) |
| 9th Author's Name | Yusuke Katoh |
| 9th Author's Affiliation | Gifu University (Gifu University) |
| 10th Author's Name | Ryuta Toshima |
| 10th Author's Affiliation | Gifu University (Gifu University) |
| 11th Author's Name | Takumi Nagawaki |
| 11th Author's Affiliation | Gifu University (Gifu University) |
| 12th Author's Name | Satoshi Tamura |
| 12th Author's Affiliation | Gifu University (Gifu University) |
| 13th Author's Name | Daiki Arakane |
| 13th Author's Affiliation | Kyushu Institute of Technology (Kyutech) |
| 14th Author's Name | |
| 14th Author's Affiliation | () |
| 15th Author's Name | |
| 15th Author's Affiliation | () |
| 16th Author's Name | |
| 16th Author's Affiliation | () |
| 17th Author's Name | |
| 17th Author's Affiliation | () |
| 18th Author's Name | |
| 18th Author's Affiliation | () |
| Speaker | Author-1 |
| Date Time | 2023-03-02 10:55:00 |
| Presentation Time | 10 minutes |
| Registration for | PRMU |
| Paper # | PRMU2022-76, IBISML2022-83 |
| Volume (vol) | vol.122 |
| Number (no) | no.404(PRMU), no.405(IBISML) |
| Page | pp.97-101 |
| #Pages | 5 |
| Date of Issue | 2023-02-23 (PRMU, IBISML) |
[Return to Top Page]