| Paper Abstract and Keywords |
| Presentation |
2015-08-04 10:00
On Development of an Estimation Model for Instantaneous Presence in Audio-visual Content
Shota Tsukahara, Kenji Ozawa, Yuichiro Kinoshita, Masanori Morise (Univ. Yamanashi) |
| Abstract |
(in Japanese) |
(See Japanese page) |
| (in English) |
The sense of presence is often used to evaluate the performances of audio-visual (AV) content and systems. However, a presence meter has yet to be realized. We consider that the sense of presence can be divided into two aspects: system presence and content presence. In this study we focused on content presence. To estimate the overall presence of a content item, we have developed estimation models for the sense of presence in audio-only and audio-visual content. In this study, the audio-visual model is expanded to estimate the instantaneous presence in an AV content item. Initially, we conducted an evaluation experiment of the presence with 40 content items. Based on the experimental data, a neural-network-based model was developed by expanding the previous model. To express the variation in instantaneous presence, 6 audio-related features and 14 visual-related features, which are extracted from the content items in 500-ms intervals, are used as inputs for the model. The audio-related features are loudness, sharpness, roughness, dynamic range and standard deviation in sound pressure levels, and movement of sound images. The visual-related features involve hue, lightness, saturation, and movement of visual images. After constructing the model, a generalization test confirmed that the model is sufficiently accurate to estimate the instantaneous presence. Hence, the model should contribute to the development of a presence meter. |
| Keyword |
(in Japanese) |
(See Japanese page) |
| (in English) |
sense of presence / audio-visual content / neural networks / time-series data / / / / |
| Reference Info. |
IEICE Tech. Rep., vol. 115, pp. 41-46, Aug. 2015. |
| Paper # |
|
| Date of Issue |
2015-07-27 (EA) |
| ISSN |
Print edition: ISSN 0913-5685 Online edition: ISSN 2432-6380 |
| Download PDF |
|
| Conference Information |
| Committee |
EA ASJ-H |
| Conference Date |
2015-08-03 - 2015-08-04 |
| Place (in Japanese) |
(See Japanese page) |
| Place (in English) |
Tohoku Univ., Research Inst. of Electrical Communication |
| Topics (in Japanese) |
(See Japanese page) |
| Topics (in English) |
Engineering/Electro Acoustics, Psychological and Physiological Acoustics, and Related Topics |
| Paper Information |
| Registration To |
ASJ-H |
| Conference Code |
2015-08-EA-H |
| Language |
Japanese |
| Title (in Japanese) |
(See Japanese page) |
| Sub Title (in Japanese) |
(See Japanese page) |
| Title (in English) |
On Development of an Estimation Model for Instantaneous Presence in Audio-visual Content |
| Sub Title (in English) |
|
| Keyword(1) |
sense of presence |
| Keyword(2) |
audio-visual content |
| Keyword(3) |
neural networks |
| Keyword(4) |
time-series data |
| Keyword(5) |
|
| Keyword(6) |
|
| Keyword(7) |
|
| Keyword(8) |
|
| 1st Author's Name |
Shota Tsukahara |
| 1st Author's Affiliation |
University of Yamanashi (Univ. Yamanashi) |
| 2nd Author's Name |
Kenji Ozawa |
| 2nd Author's Affiliation |
University of Yamanashi (Univ. Yamanashi) |
| 3rd Author's Name |
Yuichiro Kinoshita |
| 3rd Author's Affiliation |
University of Yamanashi (Univ. Yamanashi) |
| 4th Author's Name |
Masanori Morise |
| 4th Author's Affiliation |
University of Yamanashi (Univ. Yamanashi) |
| 5th Author's Name |
|
| 5th Author's Affiliation |
() |
| 6th Author's Name |
|
| 6th Author's Affiliation |
() |
| 7th Author's Name |
|
| 7th Author's Affiliation |
() |
| 8th Author's Name |
|
| 8th Author's Affiliation |
() |
| 9th Author's Name |
|
| 9th Author's Affiliation |
() |
| 10th Author's Name |
|
| 10th Author's Affiliation |
() |
| 11th Author's Name |
|
| 11th Author's Affiliation |
() |
| 12th Author's Name |
|
| 12th Author's Affiliation |
() |
| 13th Author's Name |
|
| 13th Author's Affiliation |
() |
| 14th Author's Name |
|
| 14th Author's Affiliation |
() |
| 15th Author's Name |
|
| 15th Author's Affiliation |
() |
| 16th Author's Name |
|
| 16th Author's Affiliation |
() |
| 17th Author's Name |
|
| 17th Author's Affiliation |
() |
| 18th Author's Name |
|
| 18th Author's Affiliation |
() |
| 19th Author's Name |
|
| 19th Author's Affiliation |
() |
| 20th Author's Name |
|
| 20th Author's Affiliation |
() |
| 21st Author's Name |
|
| 21st Author's Affiliation |
() |
| 22nd Author's Name |
|
| 22nd Author's Affiliation |
() |
| 23rd Author's Name |
|
| 23rd Author's Affiliation |
() |
| 24th Author's Name |
|
| 24th Author's Affiliation |
() |
| 25th Author's Name |
|
| 25th Author's Affiliation |
() |
| 26th Author's Name |
/ / |
| 26th Author's Affiliation |
()
() |
| 27th Author's Name |
/ / |
| 27th Author's Affiliation |
()
() |
| 28th Author's Name |
/ / |
| 28th Author's Affiliation |
()
() |
| 29th Author's Name |
/ / |
| 29th Author's Affiliation |
()
() |
| 30th Author's Name |
/ / |
| 30th Author's Affiliation |
()
() |
| 31st Author's Name |
/ / |
| 31st Author's Affiliation |
()
() |
| 32nd Author's Name |
/ / |
| 32nd Author's Affiliation |
()
() |
| 33rd Author's Name |
/ / |
| 33rd Author's Affiliation |
()
() |
| 34th Author's Name |
/ / |
| 34th Author's Affiliation |
()
() |
| 35th Author's Name |
/ / |
| 35th Author's Affiliation |
()
() |
| 36th Author's Name |
/ / |
| 36th Author's Affiliation |
()
() |
| Speaker |
Author-2 |
| Date Time |
2015-08-04 10:00:00 |
| Presentation Time |
30 minutes |
| Registration for |
ASJ-H |
| Paper # |
EA2015-17 |
| Volume (vol) |
vol.115 |
| Number (no) |
no.169 |
| Page |
pp.41-46 |
| #Pages |
6 |
| Date of Issue |
2015-07-27 (EA) |