Paper Abstract and Keywords |
Presentation |
2024-03-19 12:10
A Study on the Relationship Between the Linguistic Features of Sign Language and the Accuracy of Imitation
-- Sign Language Imitation Experiment using Illustrations, Video, and HMD Learning Materials -- Tomoya Sato, Takeaki Shionome (Teikyo Univ.) WIT2023-54 |
Abstract |
(in Japanese) |
(See Japanese page) |
(in English) |
In sign language learning using a head-mounted display (HMD), the hand-tracking function enables users to learn from a first-person perspective by simultaneously presenting their own hand movements and the sign language of the model.
In order to provide basic data for creating sign language learning materials that reflect the linguistic characteristics of the signs, we have conducted learning and imitation experiments of signs learned with text materials, video materials, and learning materials using HMDs.
The results of the analysis of the accuracy of imitation and the evaluation of understandability by Deaf people showed that the video materials and the HMD materials using both first-person and face-to-face models were effective for imitation. In addition, it was found that one-handed sign language and two-handed homomorphic sign language were highly evaluated in terms of understandability.
Furthermore, we found that there are issues in the presentation of sign language materials using the HMD for signs that use the position around the face. |
Keyword |
(in Japanese) |
(See Japanese page) |
(in English) |
Sign language learning / Learning material / Head-Mounted Display / Hand-tracking / Deaf people / / / |
Reference Info. |
IEICE Tech. Rep., vol. 123, no. 447, WIT2023-54, pp. 63-68, March 2024. |
Paper # |
WIT2023-54 |
Date of Issue |
2024-03-11 (WIT) |
ISSN |
Online edition: ISSN 2432-6380 |
Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) |
Download PDF |
WIT2023-54 |
Conference Information |
Committee |
WIT IPSJ-AAC |
Conference Date |
2024-03-18 - 2024-03-19 |
Place (in Japanese) |
(See Japanese page) |
Place (in English) |
Tsukuba University of Technology |
Topics (in Japanese) |
(See Japanese page) |
Topics (in English) |
Hearing / Visually impaired person support technology, etc. |
Paper Information |
Registration To |
WIT |
Conference Code |
2024-03-WIT-AAC |
Language |
Japanese |
Title (in Japanese) |
(See Japanese page) |
Sub Title (in Japanese) |
(See Japanese page) |
Title (in English) |
A Study on the Relationship Between the Linguistic Features of Sign Language and the Accuracy of Imitation |
Sub Title (in English) |
Sign Language Imitation Experiment using Illustrations, Video, and HMD Learning Materials |
Keyword(1) |
Sign language learning |
Keyword(2) |
Learning material |
Keyword(3) |
Head-Mounted Display |
Keyword(4) |
Hand-tracking |
Keyword(5) |
Deaf people |
Keyword(6) |
|
Keyword(7) |
|
Keyword(8) |
|
1st Author's Name |
Tomoya Sato |
1st Author's Affiliation |
Teikyo University (Teikyo Univ.) |
2nd Author's Name |
Takeaki Shionome |
2nd Author's Affiliation |
Teikyo University (Teikyo Univ.) |
3rd Author's Name |
|
3rd Author's Affiliation |
() |
4th Author's Name |
|
4th Author's Affiliation |
() |
5th Author's Name |
|
5th Author's Affiliation |
() |
6th Author's Name |
|
6th Author's Affiliation |
() |
7th Author's Name |
|
7th Author's Affiliation |
() |
8th Author's Name |
|
8th Author's Affiliation |
() |
9th Author's Name |
|
9th Author's Affiliation |
() |
10th Author's Name |
|
10th Author's Affiliation |
() |
11th Author's Name |
|
11th Author's Affiliation |
() |
12th Author's Name |
|
12th Author's Affiliation |
() |
13th Author's Name |
|
13th Author's Affiliation |
() |
14th Author's Name |
|
14th Author's Affiliation |
() |
15th Author's Name |
|
15th Author's Affiliation |
() |
16th Author's Name |
|
16th Author's Affiliation |
() |
17th Author's Name |
|
17th Author's Affiliation |
() |
18th Author's Name |
|
18th Author's Affiliation |
() |
19th Author's Name |
|
19th Author's Affiliation |
() |
20th Author's Name |
|
20th Author's Affiliation |
() |
Speaker |
Author-1 |
Date Time |
2024-03-19 12:10:00 |
Presentation Time |
25 minutes |
Registration for |
WIT |
Paper # |
WIT2023-54 |
Volume (vol) |
vol.123 |
Number (no) |
no.447 |
Page |
pp.63-68 |
#Pages |
6 |
Date of Issue |
2024-03-11 (WIT) |
|