Paper Abstract and Keywords |
Presentation |
2022-10-25 14:40
Comparison of the Coverage Indicators of Evaluation Data for the Convolutional Neural Networks Yuto Yokoyama, Kozo Okano, Shinpei Ogata (Shinshu Univ.), Shin Nakazima (NII) SS2022-27 DC2022-33 |
Abstract |
(in Japanese) |
(See Japanese page) |
(in English) |
Neuron Coverage (NC) was proposed as a measure to quantify the usefulness of evaluation data against Deep Neural Networks (DNNs): the larger the value of NC, the better the coverage of the evaluation data. Since NC is inappropriate for such a metric in some cases, DeepGauge was proposed to overcome those deficiencies. In this study, we conducted a series of experiments to examine how the two metrics differ when DNN models are tested in terms of label imbalances. We found that (1) the NC is less sensitive and thus is not appropriate as the test metrics, which is in accordance with existing studies, and (2) some DeepGauge indices are appropriately sensitive in certain cases. We also found that those DeepGauge indices do not show any difference for the case of calculating the indices for CNNs, whether the neurons in the convolution and pooling layers are considered or not. |
Keyword |
(in Japanese) |
(See Japanese page) |
(in English) |
CNN / NeuronCoverage / DeepGauge / / / / / |
Reference Info. |
IEICE Tech. Rep., vol. 122, no. 225, SS2022-27, pp. 29-34, Oct. 2022. |
Paper # |
SS2022-27 |
Date of Issue |
2022-10-18 (SS, DC) |
ISSN |
Online edition: ISSN 2432-6380 |
Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) |
Download PDF |
SS2022-27 DC2022-33 |
Conference Information |
Committee |
DC SS |
Conference Date |
2022-10-25 - 2022-10-25 |
Place (in Japanese) |
(See Japanese page) |
Place (in English) |
|
Topics (in Japanese) |
(See Japanese page) |
Topics (in English) |
|
Paper Information |
Registration To |
SS |
Conference Code |
2022-10-DC-SS |
Language |
Japanese |
Title (in Japanese) |
(See Japanese page) |
Sub Title (in Japanese) |
(See Japanese page) |
Title (in English) |
Comparison of the Coverage Indicators of Evaluation Data for the Convolutional Neural Networks |
Sub Title (in English) |
|
Keyword(1) |
CNN |
Keyword(2) |
NeuronCoverage |
Keyword(3) |
DeepGauge |
Keyword(4) |
|
Keyword(5) |
|
Keyword(6) |
|
Keyword(7) |
|
Keyword(8) |
|
1st Author's Name |
Yuto Yokoyama |
1st Author's Affiliation |
Shinshu University (Shinshu Univ.) |
2nd Author's Name |
Kozo Okano |
2nd Author's Affiliation |
Shinshu University (Shinshu Univ.) |
3rd Author's Name |
Shinpei Ogata |
3rd Author's Affiliation |
Shinshu University (Shinshu Univ.) |
4th Author's Name |
Shin Nakazima |
4th Author's Affiliation |
National Institute of Informatics (NII) |
5th Author's Name |
|
5th Author's Affiliation |
() |
6th Author's Name |
|
6th Author's Affiliation |
() |
7th Author's Name |
|
7th Author's Affiliation |
() |
8th Author's Name |
|
8th Author's Affiliation |
() |
9th Author's Name |
|
9th Author's Affiliation |
() |
10th Author's Name |
|
10th Author's Affiliation |
() |
11th Author's Name |
|
11th Author's Affiliation |
() |
12th Author's Name |
|
12th Author's Affiliation |
() |
13th Author's Name |
|
13th Author's Affiliation |
() |
14th Author's Name |
|
14th Author's Affiliation |
() |
15th Author's Name |
|
15th Author's Affiliation |
() |
16th Author's Name |
|
16th Author's Affiliation |
() |
17th Author's Name |
|
17th Author's Affiliation |
() |
18th Author's Name |
|
18th Author's Affiliation |
() |
19th Author's Name |
|
19th Author's Affiliation |
() |
20th Author's Name |
|
20th Author's Affiliation |
() |
Speaker |
Author-1 |
Date Time |
2022-10-25 14:40:00 |
Presentation Time |
25 minutes |
Registration for |
SS |
Paper # |
SS2022-27, DC2022-33 |
Volume (vol) |
vol.122 |
Number (no) |
no.225(SS), no.226(DC) |
Page |
pp.29-34 |
#Pages |
6 |
Date of Issue |
2022-10-18 (SS, DC) |
|