Paper Abstract and Keywords |
Presentation |
2017-09-15 10:30
Experimental Analysis of Variational Bayesian Method in Model Selection of Gaussian Mixture Model by Singular Bayesian Information Criterion Naoki Hayashi (Tokyo Tech), Fumito Nakamura (Bosch) PRMU2017-41 IBISML2017-13 |
Abstract |
(in Japanese) |
(See Japanese page) |
(in English) |
A Gaussian mixture model (GMM) is a statistical model used in various fields such a pattern recognition, thus, it is important to resolve its model selection problems, however, GMM is not statistical regular since the map from the set of parameters to the set of probability density functions is not injective.
Recently, a statistical model selection criterion, called the singular Bayesian information criterion (sBIC) has been proposed and it can be applied even if the statistical model is not regular. The model selection of GMM is carried out using by the local maximum likelihood estimator (LMLE) calculated by the EM algorithm for sBIC. On the other hand, the variational Bayesian method is also applied to estimate GMM because of that there does not exists the maximum likelihood estimator.
In this paper, we consider the numerical behavior of the model selection of GMMs using by sBIC that is evaluated the estimator by the variational Bayesian method (variational Bayesian estimator, VBE) instead of LMLE. We compare with the cases that sBIC uses the LMLE, and report that sBIC that uses the VBE estimates more rigorous in both the case (1) that only the components' means and the mixtured ratio are estimated and the case (2) that the covariance is additionally did. |
Keyword |
(in Japanese) |
(See Japanese page) |
(in English) |
Gaussian mixture model / model selection / EM algorithm / variational Bayesian method / real log canonical threshold / singular Bayesian information criterion / sBIC / |
Reference Info. |
IEICE Tech. Rep., vol. 117, no. 211, IBISML2017-13, pp. 19-26, Sept. 2017. |
Paper # |
IBISML2017-13 |
Date of Issue |
2017-09-08 (PRMU, IBISML) |
ISSN |
Print edition: ISSN 0913-5685 Online edition: ISSN 2432-6380 |
Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) |
Download PDF |
PRMU2017-41 IBISML2017-13 |
Conference Information |
Committee |
PRMU IBISML IPSJ-CVIM |
Conference Date |
2017-09-15 - 2017-09-16 |
Place (in Japanese) |
(See Japanese page) |
Place (in English) |
|
Topics (in Japanese) |
(See Japanese page) |
Topics (in English) |
|
Paper Information |
Registration To |
IBISML |
Conference Code |
2017-09-PRMU-IBISML-CVIM |
Language |
Japanese |
Title (in Japanese) |
(See Japanese page) |
Sub Title (in Japanese) |
(See Japanese page) |
Title (in English) |
Experimental Analysis of Variational Bayesian Method in Model Selection of Gaussian Mixture Model by Singular Bayesian Information Criterion |
Sub Title (in English) |
|
Keyword(1) |
Gaussian mixture model |
Keyword(2) |
model selection |
Keyword(3) |
EM algorithm |
Keyword(4) |
variational Bayesian method |
Keyword(5) |
real log canonical threshold |
Keyword(6) |
singular Bayesian information criterion |
Keyword(7) |
sBIC |
Keyword(8) |
|
1st Author's Name |
Naoki Hayashi |
1st Author's Affiliation |
Tokyo Institute of Technology (Tokyo Tech) |
2nd Author's Name |
Fumito Nakamura |
2nd Author's Affiliation |
Bosch Corporation (Bosch) |
3rd Author's Name |
|
3rd Author's Affiliation |
() |
4th Author's Name |
|
4th Author's Affiliation |
() |
5th Author's Name |
|
5th Author's Affiliation |
() |
6th Author's Name |
|
6th Author's Affiliation |
() |
7th Author's Name |
|
7th Author's Affiliation |
() |
8th Author's Name |
|
8th Author's Affiliation |
() |
9th Author's Name |
|
9th Author's Affiliation |
() |
10th Author's Name |
|
10th Author's Affiliation |
() |
11th Author's Name |
|
11th Author's Affiliation |
() |
12th Author's Name |
|
12th Author's Affiliation |
() |
13th Author's Name |
|
13th Author's Affiliation |
() |
14th Author's Name |
|
14th Author's Affiliation |
() |
15th Author's Name |
|
15th Author's Affiliation |
() |
16th Author's Name |
|
16th Author's Affiliation |
() |
17th Author's Name |
|
17th Author's Affiliation |
() |
18th Author's Name |
|
18th Author's Affiliation |
() |
19th Author's Name |
|
19th Author's Affiliation |
() |
20th Author's Name |
|
20th Author's Affiliation |
() |
Speaker |
Author-1 |
Date Time |
2017-09-15 10:30:00 |
Presentation Time |
30 minutes |
Registration for |
IBISML |
Paper # |
PRMU2017-41, IBISML2017-13 |
Volume (vol) |
vol.117 |
Number (no) |
no.210(PRMU), no.211(IBISML) |
Page |
pp.19-26 |
#Pages |
8 |
Date of Issue |
2017-09-08 (PRMU, IBISML) |
|