| 講演抄録/キーワード |
| 講演名 |
2014-11-17 17:00
[ポスター講演]Breakdown Point of Robust Support Vector Machine ○Takafumi Kanamori(Nagoya Univ.)・Shuhei Fujiwara・Akiko Takeda(Univ. of Tokyo) IBISML2014-41 |
| 抄録 |
(和) |
(事前公開アブストラクト) The main contribution of this paper is to show an exact evaluation of the breakdown point for a robust variant of support vector machine (SVM). For learning parameters such as the regularization parameter, we derive a simple formula that guarantees the robustness of the classifier. When the learning parameters are determined with a grid search using cross validation, our formula works to reduce the number of candidate search points. We show that the statistical properties of the robust SVM are well explained by a theoretical analysis of the breakdown point. |
| (英) |
The support vector machine (SVM) is one of the most successful learning methods for solving classification
problems. Despite its popularity, SVM has a serious drawback, that is sensitivity to outliers in training samples. The
penalty on misclassification is defined by a convex loss called the hinge loss, and the unboundedness of the convex
loss causes the sensitivity to outliers. To deal with outliers, robust variants of SVM have been proposed, such as the
robust outlier detection algorithm and an SVM with a bounded loss called the ramp loss. In this paper, we propose a
robust variant of SVM and investigate its robustness in terms of the breakdown point. The breakdown point is a
robustness measure that is the largest amount of contamination such that the estimated classifier still gives
information about the non-contaminated data. The main contribution of this paper is to show an exact evaluation of the
breakdown point for the robust SVM.
For learning parameters such as the regularization parameter in our algorithm,
we derive a simple formula that guarantees the robustness of the classifier.
When the learning parameters are determined with a grid search using cross validation, our formula works to reduce the
number of candidate search points. The robustness of the proposed method is confirmed in numerical experiments. We show
that the statistical properties of the robust SVM are well explained by a theoretical analysis of the
breakdown point. |
| キーワード |
(和) |
/ / / / / / / |
| (英) |
Support Vector machine / Breakdown point / Robustness / Regularization / / / / |
| 文献情報 |
信学技報, vol. 114, no. 306, IBISML2014-41, pp. 49-56, 2014年11月. |
| 資料番号 |
IBISML2014-41 |
| 発行日 |
2014-11-10 (IBISML) |
| ISSN |
Print edition: ISSN 0913-5685 Online edition: ISSN 2432-6380 |
著作権に ついて |
技術研究報告に掲載された論文の著作権は電子情報通信学会に帰属します.(許諾番号:10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) |
| PDFダウンロード |
IBISML2014-41 |