Publication
Context attention: Human motion prediction using context information and deep learning attention models
Conference Article
Conference
Iberian Robotics Conference (ROBOT)
Edition
5th
Pages
102-112
Doc link
https://doi.org/10.1007/978-3-031-21065-5_9
File
Abstract
This work proposes a human motion prediction model for handover operations. The model uses a multi-headed attention architec- ture to process the human skeleton data together with contextual data from the operation. This contextual data consists on the position of the robot’s End Effector (REE). The model input is a sequence of 5 seconds skeleton position and it outputs the predicted 2.5 future seconds posi- tion. We provide results of the human upper body and the human right hand or Human End Effector (HEE).
The attention deep learning based model has been trained and evaluated with a dataset created using human volunteers and an anthropomorphic robot, simulating handover operations where the robot is the giver and the human the receiver. For each operation, the human skeleton is ob- tained using OpenPose with an Intel RealSense D435i camera set inside the robot’s head. The results show a great improvement of the human’s right hand prediction and 3D body compared with other methods.
Categories
automation.
Author keywords
machine learning, human-robot collaboration
Scientific reference
J. Laplaza, F. Moreno-Noguer and A. Sanfeliu. Context attention: Human motion prediction using context information and deep learning attention models, 5th Iberian Robotics Conference, 2022, Zaragoza, Spain, Vol 590 of Lecture Notes in Networks and Systems, pp. 102-112, 2023.
Follow us!