| Paper Abstract and Keywords |
| Presentation |
2025-03-01 10:45
Design Goals and Principles of an Automatic Scoring System for Handwritten Answers on Electronic Paper Masaki Nakagawa, Hung Tuan Nguyen, Thanh-Nghia Truong, Nam Tuan Ly (TUAT), Cuong Tuan Nguyen (VGU), Tomo Asakura, Hiroshi Miyazawa, Toshihiko Horie (Wacom) ET2024-65 |
| Abstract |
(in Japanese) |
(See Japanese page) |
| (in English) |
This paper presents the design goals and principles of an automatic scoring system for handwritten answers on electronic paper in Japanese, English, and mathematics. This system applies DNN-based online and offline handwriting recognizers for each subject and matches recognized candidates with correct answers. By controlling similarity and rejection, we aim to achieve human-comparable false-positive scoring and gradually reduce the rate of scoring by humans (human-scoring rate) and false-negative scoring for any question in any subject. False positive scores of wrong answers misjudged correct are risky because they may not be claimed. False negative scores of correct answers misjudged as wrong damage examinees’ impression. Our first milestone is to achieve a human scoring rate of less than 30%, a false positive error rate of less than 2%, and a false negative error rate of less than 30% before conducting field experiments. Currently, we are approaching these levels. The human scoring rate is an indicator of the benefit of adopting automatic scoring. Once it is in use, we expect all indicators to improve as data accumulates. |
| Keyword |
(in Japanese) |
(See Japanese page) |
| (in English) |
automatic scoring / computer-aided scoring / handwritten answers / handwriting recognition / deep neural networks / / / |
| Reference Info. |
IEICE Tech. Rep., vol. 124, no. 388, ET2024-65, pp. 12-19, March 2025. |
| Paper # |
ET2024-65 |
| Date of Issue |
2025-02-22 (ET) |
| ISSN |
Online edition: ISSN 2432-6380 |
Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) |
| Download PDF |
ET2024-65 |
| Conference Information |
| Committee |
ET |
| Conference Date |
2025-03-01 - 2025-03-01 |
| Place (in Japanese) |
(See Japanese page) |
| Place (in English) |
Shinshu University Faculty of Education |
| Topics (in Japanese) |
(See Japanese page) |
| Topics (in English) |
Advanced Teaching and Learning Support Environment, etc. |
| Paper Information |
| Registration To |
ET |
| Conference Code |
2025-03-ET |
| Language |
Japanese |
| Title (in Japanese) |
(See Japanese page) |
| Sub Title (in Japanese) |
(See Japanese page) |
| Title (in English) |
Design Goals and Principles of an Automatic Scoring System for Handwritten Answers on Electronic Paper |
| Sub Title (in English) |
|
| Keyword(1) |
automatic scoring |
| Keyword(2) |
computer-aided scoring |
| Keyword(3) |
handwritten answers |
| Keyword(4) |
handwriting recognition |
| Keyword(5) |
deep neural networks |
| Keyword(6) |
|
| Keyword(7) |
|
| Keyword(8) |
|
| 1st Author's Name |
Masaki Nakagawa |
| 1st Author's Affiliation |
Tokyo University of Agriculture and Technology (TUAT) |
| 2nd Author's Name |
Hung Tuan Nguyen |
| 2nd Author's Affiliation |
Tokyo University of Agriculture and Technology (TUAT) |
| 3rd Author's Name |
Thanh-Nghia Truong |
| 3rd Author's Affiliation |
Tokyo University of Agriculture and Technology (TUAT) |
| 4th Author's Name |
Nam Tuan Ly |
| 4th Author's Affiliation |
Tokyo University of Agriculture and Technology (TUAT) |
| 5th Author's Name |
Cuong Tuan Nguyen |
| 5th Author's Affiliation |
Vietnamese-German University (VGU) |
| 6th Author's Name |
Tomo Asakura |
| 6th Author's Affiliation |
Wacom Co., Ltd, (Wacom) |
| 7th Author's Name |
Hiroshi Miyazawa |
| 7th Author's Affiliation |
Wacom Co., Ltd, (Wacom) |
| 8th Author's Name |
Toshihiko Horie |
| 8th Author's Affiliation |
Wacom Co., Ltd, (Wacom) |
| 9th Author's Name |
|
| 9th Author's Affiliation |
() |
| 10th Author's Name |
|
| 10th Author's Affiliation |
() |
| 11th Author's Name |
|
| 11th Author's Affiliation |
() |
| 12th Author's Name |
|
| 12th Author's Affiliation |
() |
| 13th Author's Name |
|
| 13th Author's Affiliation |
() |
| 14th Author's Name |
|
| 14th Author's Affiliation |
() |
| 15th Author's Name |
|
| 15th Author's Affiliation |
() |
| 16th Author's Name |
|
| 16th Author's Affiliation |
() |
| 17th Author's Name |
|
| 17th Author's Affiliation |
() |
| 18th Author's Name |
|
| 18th Author's Affiliation |
() |
| 19th Author's Name |
|
| 19th Author's Affiliation |
() |
| 20th Author's Name |
|
| 20th Author's Affiliation |
() |
| 21st Author's Name |
|
| 21st Author's Affiliation |
() |
| 22nd Author's Name |
|
| 22nd Author's Affiliation |
() |
| 23rd Author's Name |
|
| 23rd Author's Affiliation |
() |
| 24th Author's Name |
|
| 24th Author's Affiliation |
() |
| 25th Author's Name |
|
| 25th Author's Affiliation |
() |
| 26th Author's Name |
/ / |
| 26th Author's Affiliation |
()
() |
| 27th Author's Name |
/ / |
| 27th Author's Affiliation |
()
() |
| 28th Author's Name |
/ / |
| 28th Author's Affiliation |
()
() |
| 29th Author's Name |
/ / |
| 29th Author's Affiliation |
()
() |
| 30th Author's Name |
/ / |
| 30th Author's Affiliation |
()
() |
| 31st Author's Name |
/ / |
| 31st Author's Affiliation |
()
() |
| 32nd Author's Name |
/ / |
| 32nd Author's Affiliation |
()
() |
| 33rd Author's Name |
/ / |
| 33rd Author's Affiliation |
()
() |
| 34th Author's Name |
/ / |
| 34th Author's Affiliation |
()
() |
| 35th Author's Name |
/ / |
| 35th Author's Affiliation |
()
() |
| 36th Author's Name |
/ / |
| 36th Author's Affiliation |
()
() |
| Speaker |
Author-1 |
| Date Time |
2025-03-01 10:45:00 |
| Presentation Time |
25 minutes |
| Registration for |
ET |
| Paper # |
ET2024-65 |
| Volume (vol) |
vol.124 |
| Number (no) |
no.388 |
| Page |
pp.12-19 |
| #Pages |
8 |
| Date of Issue |
2025-02-22 (ET) |