| Paper Abstract and Keywords |
| Presentation |
2024-03-01 16:35
Synthesizing perceived melody from stereo electroencephalogram Yuta Inaba, Yuiko Kumagai, Naoki Yoshimura, Shuji Komeiji (Tokyo Univ. Agri.&Tech.), Takumi Mitsuhashi, Yasushi Iimura, Hiroharu Suzuki, Hidenori Sugano (Juntendo Univ.), Toshihisa Tanaka (Tokyo Univ. Agri.&Tech.) EA2023-129 SIP2023-176 SP2023-111 |
| Abstract |
(in Japanese) |
(See Japanese page) |
| (in English) |
Estimating perceived music from intracranial electroencephalogram measured with implanted electrodes is challenging. In this study, we recorded stereo electroencephalogram (SEEG) during music perception and attempted to estimate the log-mel spectrogram of short melodies, approximately 4 seconds in duration. The mean squared error (MSE) loss was calculated from the estimated log-mel spectrogram and ground truth labels, and the results were compared with those obtained when the input was a random signal. The results of a two-way analysis of variance revealed a significant reduction in MSE loss compared to chance level. However, no significant differences were observed for the encoder type or interaction. Furthermore, reconstruction of the acoustic signal from the estimated log-mel spectrogram with low MSE allowed for subjective recognition of the heard melody. |
| Keyword |
(in Japanese) |
(See Japanese page) |
| (in English) |
melody / stereo electroencephalogram / brain-computer interface / BLSTM / Transformer / / / |
| Reference Info. |
IEICE Tech. Rep., vol. 123, no. 402, SIP2023-176, pp. 400-405, Feb. 2024. |
| Paper # |
SIP2023-176 |
| Date of Issue |
2024-02-22 (EA, SIP, SP) |
| ISSN |
Online edition: ISSN 2432-6380 |
Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) |
| Download PDF |
EA2023-129 SIP2023-176 SP2023-111 |