𝔖 Bobbio Scriptorium
✦   LIBER   ✦

Modeling of autonomous problem solving process by dynamic construction of task models in multiple tasks environment

✍ Scribed by Yu Ohigashi; Takashi Omori


Publisher
Elsevier Science
Year
2006
Tongue
English
Weight
755 KB
Volume
19
Category
Article
ISSN
0893-6080

No coin nor oath required. For personal study only.

✦ Synopsis


Traditional reinforcement learning (RL) supposes a complex but single task to be solved. When a RL agent faces a task similar to a learned one, the agent must re-learn the task from the beginning because it doesn't reuse the past learned results. This is the problem of quick action learning, which is the foundation of decision making in the real world. In this paper, we suppose agents that can solve a set of tasks similar to each other in a multiple tasks environment, where we encounter various problems one after another, and propose a technique of action learning that can quickly solve similar tasks by reusing previously learned knowledge. In our method, a model-based RL uses a task model constructed by combining primitive local predictors for predicting task and environmental dynamics. To evaluate the proposed method, we performed a computer simulation using a simple ping-pong game with variations.