| Paper Abstract and Keywords |
| Presentation |
2007-03-14 15:30
A Study of Policy-Gradient Methods in Non-Markov Decision Porcesses
-- Application to a Curling Game --
Harukazu Igarashi (Shibaura Inst. Tech.), Seiji Ishihara (Kinki Univ.), Masaomi Kimura (Shibaura Inst. Tech.) |
| Abstract |
(in Japanese) |
(See Japanese page) |
| (in English) |
There are two approaches to reinforcement learning: value-based methods and policy-gradient methods. Baird and Moore proposed the VAPS algorithm to unify these two approaches. In a previous paper, we gave a simple proof in which the VAPS algorithm's learning rule can be extensively applied even in non-Markov decision processes and clarified statistical properties on the correlation between characteristic eligibility functions. In this paper, we investigate an inverse problem in a curling game and show that the problem can be formalized to a learning problem in non-Markov decision processes. |
| Keyword |
(in Japanese) |
(See Japanese page) |
| (in English) |
Reinforcement learning / Non-Markov decision process / Policy-gradient method / / / / / |
| Reference Info. |
IEICE Tech. Rep., vol. 106, no. 588, NC2006-148, pp. 179-184, March 2007. |
| Paper # |
NC2006-148 |
| Date of Issue |
2007-03-07 (NC) |
| ISSN |
Print edition: ISSN 0913-5685 |
| Download PDF |
|
| Conference Information |
| Committee |
NC |
| Conference Date |
2007-03-14 - 2007-03-16 |
| Place (in Japanese) |
(See Japanese page) |
| Place (in English) |
Tamagawa University |
| Topics (in Japanese) |
(See Japanese page) |
| Topics (in English) |
General |
| Paper Information |
| Registration To |
NC |
| Conference Code |
2007-03-NC |
| Language |
Japanese |
| Title (in Japanese) |
(See Japanese page) |
| Sub Title (in Japanese) |
(See Japanese page) |
| Title (in English) |
A Study of Policy-Gradient Methods in Non-Markov Decision Porcesses |
| Sub Title (in English) |
Application to a Curling Game |
| Keyword(1) |
Reinforcement learning |
| Keyword(2) |
Non-Markov decision process |
| Keyword(3) |
Policy-gradient method |
| Keyword(4) |
|
| Keyword(5) |
|
| Keyword(6) |
|
| Keyword(7) |
|
| Keyword(8) |
|
| 1st Author's Name |
Harukazu Igarashi |
| 1st Author's Affiliation |
Shibaura Institute of Technology (Shibaura Inst. Tech.) |
| 2nd Author's Name |
Seiji Ishihara |
| 2nd Author's Affiliation |
Kinki University (Kinki Univ.) |
| 3rd Author's Name |
Masaomi Kimura |
| 3rd Author's Affiliation |
Shibaura Institute of Technology (Shibaura Inst. Tech.) |
| 4th Author's Name |
|
| 4th Author's Affiliation |
() |
| 5th Author's Name |
|
| 5th Author's Affiliation |
() |
| 6th Author's Name |
|
| 6th Author's Affiliation |
() |
| 7th Author's Name |
|
| 7th Author's Affiliation |
() |
| 8th Author's Name |
|
| 8th Author's Affiliation |
() |
| 9th Author's Name |
|
| 9th Author's Affiliation |
() |
| 10th Author's Name |
|
| 10th Author's Affiliation |
() |
| 11th Author's Name |
|
| 11th Author's Affiliation |
() |
| 12th Author's Name |
|
| 12th Author's Affiliation |
() |
| 13th Author's Name |
|
| 13th Author's Affiliation |
() |
| 14th Author's Name |
|
| 14th Author's Affiliation |
() |
| 15th Author's Name |
|
| 15th Author's Affiliation |
() |
| 16th Author's Name |
|
| 16th Author's Affiliation |
() |
| 17th Author's Name |
|
| 17th Author's Affiliation |
() |
| 18th Author's Name |
|
| 18th Author's Affiliation |
() |
| 19th Author's Name |
|
| 19th Author's Affiliation |
() |
| 20th Author's Name |
|
| 20th Author's Affiliation |
() |
| 21st Author's Name |
|
| 21st Author's Affiliation |
() |
| 22nd Author's Name |
|
| 22nd Author's Affiliation |
() |
| 23rd Author's Name |
|
| 23rd Author's Affiliation |
() |
| 24th Author's Name |
|
| 24th Author's Affiliation |
() |
| 25th Author's Name |
|
| 25th Author's Affiliation |
() |
| 26th Author's Name |
/ / |
| 26th Author's Affiliation |
()
() |
| 27th Author's Name |
/ / |
| 27th Author's Affiliation |
()
() |
| 28th Author's Name |
/ / |
| 28th Author's Affiliation |
()
() |
| 29th Author's Name |
/ / |
| 29th Author's Affiliation |
()
() |
| 30th Author's Name |
/ / |
| 30th Author's Affiliation |
()
() |
| 31st Author's Name |
/ / |
| 31st Author's Affiliation |
()
() |
| 32nd Author's Name |
/ / |
| 32nd Author's Affiliation |
()
() |
| 33rd Author's Name |
/ / |
| 33rd Author's Affiliation |
()
() |
| 34th Author's Name |
/ / |
| 34th Author's Affiliation |
()
() |
| 35th Author's Name |
/ / |
| 35th Author's Affiliation |
()
() |
| 36th Author's Name |
/ / |
| 36th Author's Affiliation |
()
() |
| Speaker |
Author-1 |
| Date Time |
2007-03-14 15:30:00 |
| Presentation Time |
20 minutes |
| Registration for |
NC |
| Paper # |
NC2006-148 |
| Volume (vol) |
vol.106 |
| Number (no) |
no.588 |
| Page |
pp.179-184 |
| #Pages |
6 |
| Date of Issue |
2007-03-07 (NC) |