Paper Abstract and Keywords |
Presentation |
2015-11-27 14:00
[Poster Presentation]
Performance degradation of AMP for Ising perceptron when the system size is small Arise Kuriya, Toshiyuki Tanaka (Kyoto Univ.) IBISML2015-85 |
Abstract |
(in Japanese) |
(See Japanese page) |
(in English) |
Approximate Massage Passing (AMP) algorithm, proposed by Donoho et al., is derived from Belief Propagation (BP) algorithm by introducing the Gaussian approximation and the first-order approximation for reducing the number of messages, both of which are justifiable when the problem size is sufficiently large. We have been studying properties of the AMP algorithm when the problem size is relatively small by comparing the AMP algorithm with the BP algorithm. The main objective of our study is to investigate effects of the approximations and the cause for the poor performance of the AMP algorithm in small-sized problems. In this paper, we study the AMP algorithm applied to the problem of Ising perceptron learning. From numerical experiments of comparing performance of the AMP and BP algorithms applied to the Ising perceptron learning, we observed that the application of loopy-BP mainly causes the degradation of the performance of AMP in small-sized problems. We also observed that introducing the Gaussian approximation has hardly any effect on the basis of the performance even when the problem size is small. The first-order approximation, on the other hand, can cause instability of AMP by which the performance of AMP falls below BP. |
Keyword |
(in Japanese) |
(See Japanese page) |
(in English) |
Belief Propagation / Approximate Message Passing / Ising Perceptron / / / / / |
Reference Info. |
IEICE Tech. Rep., vol. 115, no. 323, IBISML2015-85, pp. 241-247, Nov. 2015. |
Paper # |
IBISML2015-85 |
Date of Issue |
2015-11-19 (IBISML) |
ISSN |
Print edition: ISSN 0913-5685 Online edition: ISSN 2432-6380 |
Copyright and reproduction |
All rights are reserved and no part of this publication may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopy, recording, or any information storage and retrieval system, without permission in writing from the publisher. Notwithstanding, instructors are permitted to photocopy isolated articles for noncommercial classroom use without fee. (License No.: 10GA0019/12GB0052/13GB0056/17GB0034/18GB0034) |
Download PDF |
IBISML2015-85 |
Conference Information |
Committee |
IBISML |
Conference Date |
2015-11-25 - 2015-11-27 |
Place (in Japanese) |
(See Japanese page) |
Place (in English) |
Epochal Tsukuba |
Topics (in Japanese) |
(See Japanese page) |
Topics (in English) |
Information-Based Induction Science Workshop (IBIS2015) |
Paper Information |
Registration To |
IBISML |
Conference Code |
2015-11-IBISML |
Language |
English |
Title (in Japanese) |
(See Japanese page) |
Sub Title (in Japanese) |
(See Japanese page) |
Title (in English) |
Performance degradation of AMP for Ising perceptron when the system size is small |
Sub Title (in English) |
|
Keyword(1) |
Belief Propagation |
Keyword(2) |
Approximate Message Passing |
Keyword(3) |
Ising Perceptron |
Keyword(4) |
|
Keyword(5) |
|
Keyword(6) |
|
Keyword(7) |
|
Keyword(8) |
|
1st Author's Name |
Arise Kuriya |
1st Author's Affiliation |
Kyoto University (Kyoto Univ.) |
2nd Author's Name |
Toshiyuki Tanaka |
2nd Author's Affiliation |
Kyoto University (Kyoto Univ.) |
3rd Author's Name |
|
3rd Author's Affiliation |
() |
4th Author's Name |
|
4th Author's Affiliation |
() |
5th Author's Name |
|
5th Author's Affiliation |
() |
6th Author's Name |
|
6th Author's Affiliation |
() |
7th Author's Name |
|
7th Author's Affiliation |
() |
8th Author's Name |
|
8th Author's Affiliation |
() |
9th Author's Name |
|
9th Author's Affiliation |
() |
10th Author's Name |
|
10th Author's Affiliation |
() |
11th Author's Name |
|
11th Author's Affiliation |
() |
12th Author's Name |
|
12th Author's Affiliation |
() |
13th Author's Name |
|
13th Author's Affiliation |
() |
14th Author's Name |
|
14th Author's Affiliation |
() |
15th Author's Name |
|
15th Author's Affiliation |
() |
16th Author's Name |
|
16th Author's Affiliation |
() |
17th Author's Name |
|
17th Author's Affiliation |
() |
18th Author's Name |
|
18th Author's Affiliation |
() |
19th Author's Name |
|
19th Author's Affiliation |
() |
20th Author's Name |
|
20th Author's Affiliation |
() |
Speaker |
Author-1 |
Date Time |
2015-11-27 14:00:00 |
Presentation Time |
180 minutes |
Registration for |
IBISML |
Paper # |
IBISML2015-85 |
Volume (vol) |
vol.115 |
Number (no) |
no.323 |
Page |
pp.241-247 |
#Pages |
7 |
Date of Issue |
2015-11-19 (IBISML) |
|