Publication
Sample-efficient robot motion learning using Gaussian process latent variable models
Conference Article
Conference
IEEE International Conference on Robotics and Automation (ICRA)
Edition
2020
Pages
314-320
Doc link
https://doi.org/10.1109/ICRA40945.2020.9196658
File
Abstract
Robotic manipulators are reaching a state where we could see them in household environments in the following decade. Nevertheless, such robots need to be easy to instruct by lay people. This is why kinesthetic teaching has become very popular in recent years, in which the robot is taught a motion that is encoded as a parametric function - usually a Movement Primitive (MP)-. This approach produces trajectories that are usually suboptimal, and the robot needs to be able to improve them through trial-and-error. Such optimization is often done with Policy Search (PS) reinforcement learning, using a given reward function. PS algorithms can be classified as model-free, where neither the environment nor the reward function are modelled, or model-based, which can use a surrogate model of the reward function and/or a model for the dynamics of the task.
However, MPs can become very high-dimensional in terms of parameters, which constitute the search space, so their optimization often requires too many samples. In this paper, we assume we have a robot motion task characterized with an MP of which we cannot model the dynamics. We build a surrogate model for the reward function, that maps an MP parameter latent space (obtained through a Mutual-information-weighted Gaussian Process Latent Variable Model) into a reward. While we do not model the task dynamics, using mutual information to shrink the task space makes it more consistent with the reward and so the policy improvement is faster in terms of sample efficiency.
Categories
learning (artificial intelligence), manipulators, robots.
Scientific reference
J.A. Delgado-Guerrero, A. Colomé and C. Torras. Sample-efficient robot motion learning using Gaussian process latent variable models, 2020 IEEE International Conference on Robotics and Automation, 2020, Paris, France, pp. 314-320, IEEE.
Follow us!