| 講演抄録/キーワード |
| 講演名 |
2011-11-09 15:45
Kernel and Feature Search in Kernel PCA ○Alam Md. Ashad(SOKENDAI)・Kenji Fukumizu(ISM) IBISML2011-49 |
| 抄録 |
(和) |
During the last decade, unsupervised learning has become an important application area of the kernel
methods. While the choice of kernel is essential in kernel methods for favorable performance, well-founded methods
for kernel choice in unsupervised learning have not yet been established. We proposes a method for choosing parameters,
the kernel and the number of features, of the kernel principal component analysis (kernel PCA) which is one
of the most powerful tools in unsupervised learning. While the cross-validation has been applied to the standard
PCA for choosing the number of components in kernel PCA we have a different feature space for each kernel, which
makes it difficult to apply the cross-validation on the feature spaces for seeking a kernel and the number features.
The propose method chooses them through the cross-validation based on pre-images. This paper mainly focuses two
examples of kernels, Gaussian radial basis function (RBF) kernel and polynomial kernel. We have made experiments
on simulated data as well as real world problems. The results show that the proposed method successfully chooses
an appropriate kernel and the number of features in kernel PCA in terms of visualization and classification errors
on the principal components. |
| (英) |
During the last decade, unsupervised learning has become an important application area of the kernel
methods. While the choice of kernel is essential in kernel methods for favorable performance, well-founded methods
for kernel choice in unsupervised learning have not yet been established. We proposes a method for choosing parameters,
the kernel and the number of features, of the kernel principal component analysis (kernel PCA) which is one
of the most powerful tools in unsupervised learning. While the cross-validation has been applied to the standard
PCA for choosing the number of components in kernel PCA we have a different feature space for each kernel, which
makes it difficult to apply the cross-validation on the feature spaces for seeking a kernel and the number features.
The propose method chooses them through the cross-validation based on pre-images. This paper mainly focuses two
examples of kernels, Gaussian radial basis function (RBF) kernel and polynomial kernel. We have made experiments
on simulated data as well as real world problems. The results show that the proposed method successfully chooses
an appropriate kernel and the number of features in kernel PCA in terms of visualization and classification errors
on the principal components. |
| キーワード |
(和) |
Unsupervised Learning / Kernel PCA / Pre-Iamges / Leave-one-out Cross-Validation / / / / |
| (英) |
Unsupervised Learning / Kernel PCA / Pre-Iamges / Leave-one-out Cross-Validation / / / / |
| 文献情報 |
信学技報, vol. 111, no. 275, IBISML2011-49, pp. 47-56, 2011年11月. |
| 資料番号 |
IBISML2011-49 |
| 発行日 |
2011-11-02 (IBISML) |
| ISSN |
Print edition: ISSN 0913-5685 Online edition: ISSN 2432-6380 |
著作権に ついて |
技術研究報告に掲載された論文の著作権は電子情報通信学会に帰属します.(許諾番号:10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) |
| PDFダウンロード |
IBISML2011-49 |