Publication

Trajectory tracking control of a rotational joint using feature-based categorization learning

Conference Article

Conference

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

Edition

2004

Pages

3489-3494

Doc link

http://dx.doi.org/10.1109/IROS.2004.1389956

File

Download the digital copy of the doc pdf document

Abstract

Real world robot applications have to cope with large variations in the operating conditions due to the variability and unpredictability of the environment and its interaction with the robot. Performing an adequate control using conventional control techniques, that require the model of the plant and some knowledge about the influence of the environment, could be almost impossible. An alternative to traditional control techniques is to use an automatic learning system that uses previous experience to learn an adequate control policy. Learning by experience has been formalized in the field of Reinforcement Learning. But the application of Reinforcement Learning techniques in complex environments is only feasible when some generalization can be made in order to reduce the required amount of experience. This work presents an algorithm that performs a kind of generalization called categorization. This algorithm is able to perform efficient generalization of the observed situations, and learn accurate control policies in a short time without any previous knowledge of the plant and without the need of any kind of traditional control technique. Its performance is evaluated on the trajectory tracking control with simulated DC motors and compared with PID systems specifically tuned for the same problem.

Categories

artificial intelligence.

Author keywords

reinforcement learning, trajectory tracking control, categorization

Scientific reference

A. Agostini and E. Celaya. Trajectory tracking control of a rotational joint using feature-based categorization learning, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2004, Sendai, Japan, in Intelligent Robots and Systems, pp. 3489-3494, 2004, IEEE, Barcelona, Espanya.