Research Project

MdM: Unit of Excellence María de Maeztu

Type

National Project

Start Date

01/07/2017

End Date

30/06/2021

Project Code

MDM-2016-0656

Project illustration

Staff

Project Description



The "María de Maeztu" scientific excellence seal has been awarded to IRI by the Spanish State Research Agency for the period 01/07/2017-30/06/2021.

A 4-year Strategic Research Programme will be developed in HUMAN-CENTERED ROBOTICS

SPECIFIC SCIENTIFIC OBJECTIVES AND PRIORITIES

The concept of “human-centered robotics” is meant to include the many different situations in which robots are in close contact and interact with humans. These include, but is not limited to, social robotics with significant human-robot interaction, collaborative robotics in which humans and robots work together to achieve a common task, or assistive robotics in which robotic technologies are exploited to help the elderly or the impaired. The 7 key core challenges identified apply to all these domains, and translate into this 7 Specific Scientific Objectives of significant relevance and novelty:


  • Emphatic natural human robot interaction and collaboration: Robots need to be accessible to the non-expert. Research is needed to find ways to allow a robot to interact with people in a natural and intuitive way, combining multiple sensing modalities to understand gestures, and to produce socially acceptable gestures and motion. Moreover, research is needed to develop models of robot behavior that guarantee that a task can be completed in cooperation with a human, understanding and anticipating human intentions, being a true collaborator.

  • Robust localization and mapping: Localization and mapping is a key component of any assistive robotics solution, and it is perhaps one of the most studied topics in robotics. Whereas there is today a general consensus on the mathematical formulation of the problem and on the computational tools needed for its solution, the objective now is to provide robustness, reliability, and scalability.

  • Dexterous textile manipulation: Textile manipulation would open a whole range of possibilities, from increased autonomy of the elderly, to housekeeping or industrial applications. In our approach to the problem, we seek to develop a theory of cloth manipulation using tools from computational topology and machine learning, and to develop the adequate end effectors and tools to handle cloth with dexterity.

  • Robot learning using natural communication: A new paradigm for robot learning will be studied. Exploiting recent advances in the area of visual object recognition, natural language processing, and their combination by means of machine learning tools, we seek to advance the way a human can instruct a robot using solely natural language and standard gestures.

  • Energy supply and optimization: Energy autonomy is also a key factor for the penetration of robust mobile systems in assistive robotics applications. We seek to develop an innovative fuel cell system tailored to assistive robotics applications with improved efficiency, reliability and lifetime, addressing the problems of space (high energy density) and weight (high specific energy). Additionally, we seek to explore the possibility of obtaining the fuel (hydrogen or hydrogen rich compounds) from different alternative means.

  • Supervision and control of complex dynamic systems: Robots need to react in real time and reliable alongside humans. Hence, the objective is to work on controllers that can change parameters in real time, efficiently handle constraints and disturbances, and detect faults and reconfigure to maintain functionality.

  • Ethical, regulatory and philosophical aspects of social robotics: Many risks and regulatory issues still need to be resolved prior to the deployment of helper robots. These issues have passed until now overwhelmingly unattended, concentrating research efforts in developing the technologies and the prototypes, but they can no longer be obviated. A collaborative effort with experts in legal frontiers of technology and privacy issues will be pursued, as well as with experts that can analyze the ethical perspective.


IMPLEMENTATION

IRI’s María de Maeztu Strategic Research Program on Human-Centered Robotics is organized in 7 Work Packages, consistent with the 7 Research Objectives outlined above.

WP1 Emphatic natural human robot interaction and collaboration
- 1.1 Human action recognition
- 1.2 Socially aware path planning, navigation and path execution
- 1.3 Compliant and safe interaction between humans and robots
PI Leader: A. Sanfeliu
Other PIs involved: JM Porta , V Puig

WP2 Robust localization and mapping
- 2.1 Sensory data fusion for localization
- 2.2 SLAM and Deep Learning
- 2.3 Robustness/reliability/scalability/loop closure detection
PI Leader: J. Andrade
Other PIs involved: F. Moreno, A Sanfeliu

WP3 Dexterous textile manipulation
- 3.1 Perception of deformable objects
- 3.2 High level encoding of object primitives using computational topology
- 3.3 Design and construction of dexterous end effectors and grippers for robot design
PI Leader: C. Torras
Other PIs involved: F. Moreno, JM Porta

WP4 Robot learning using natural communication
- 4.1 Joint annotation of visual and textual data
- 4.2 Inference techniques (dynamic neural networks) to predict semantic tuples and actions from object detection in input images and video
- 4.3 Learning from demonstration manipulation skills
PI leader: F Moreno
Other PIs involved: J Andrade, C Torras

WP5 Energy supply and management
- 5.1 Design of autonomous energy systems based on PEM fuel cells
- 5.2 Dynamic modelling and development of diagnosis tools
- 5.3 Design and implementation of controllers for optimal efficiency and low degradation of the energy generation system
PI leader: V Puig
Other PIs involved: G Cembrano, A Sanfeliu

WP6 Advanced supervision and control
- 6.1 Modelling complex dynamic systems
- 6.2 Real-time supervision in complex dynamic systems
- 6.3 Model-based and data driven control in complex dynamic systems
PI leader: G Cembrano
Other PIs involved: J Andrade, V Puig

WP7 Ethical, regulatory and philosophical aspects of social robotics
- 7.1 Risk/contingency management
- 7.2 Liability /regulations
- 7.3 Privacy issues
PI Leader: A Sanfeliu
Other PIs involved: C Torras

Project Publications

Journal Publications

  • S. Sarabandi and F. Thomas. A survey on the computation of quaternions from rotation matrices. Journal of Mechanisms and Robotics, 2019, to appear.

    Open/Close abstract Abstract Info Info pdf PDF
  • A. Ramisa, F. Yan, F. Moreno-Noguer and K. Mikolajczyk. BreakingNews: Article annotation by image and text processing. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40(5): 1072-1085, 2018.

    Open/Close abstract Abstract Info Info pdf PDF
  • M. Nassourou, J. Blesa and V. Puig. Optimal energy dispatch in a smart micro-grid system using economic model predictive control. Proceedings of the Institution of Mechanical Engineers Part I - Journal of Systems and Control Engineering: 1-11, 2018.

    Open/Close abstract Abstract Info Info pdf PDF
  • J. Vallvé, J. Solà and J. Andrade-Cetto. Graph SLAM sparsification with populated topologies using factor descent optimization. IEEE Robotics and Automation Letters, 3(2): 1322-1329, 2018.

    Open/Close abstract Abstract Info Info pdf PDF
  • S. Foix, G. Alenyà and C. Torras. Task-driven active sensing framework applied to leaf probing. Computers and Electronics in Agriculture, 147: 166-175, 2018.

    Open/Close abstract Abstract Info Info pdf PDF
  • A. Colomé and C. Torras. Dimensionality reduction in learning Gaussian mixture models of movement primitives for contextualized action selection and adaptation. IEEE Robotics and Automation Letters, 3(4): 3922-3929, 2018.

    Open/Close abstract Abstract Info Info pdf PDF
  • A. Jevtić, A. Flores, G. Alenyà, G. Chance, P. Caleb-Solly, S. Dogramadzi and C. Torras. Personalized robot assistant for support in dressing. IEEE Transactions on Cognitive and Developmental Systems, 2018, to appear.

    Open/Close abstract Abstract Info Info pdf PDF
  • P.G. Rullo, R. Costa Castelló, V. Roda and D. Feroldi. Energy management strategy for a bioethanol isolated hybrid system: Simulations and experiments. Energies, 11(6): 1362, 2018.

    Open/Close abstract Abstract Info Info pdf PDF
  • A. Agudo and F. Moreno-Noguer. Force-based representation for non-rigid shape and elastic model estimation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40(9): 2137-2150, 2018.

    Open/Close abstract Abstract Info Info pdf PDF
  • A. Andriella, G. Alenyà, J. Hernández-Farigola and C. Torras. Deciding the different robot roles for patient cognitive training. International Journal of Human-Computer Studies, 117: 20-29, 2018.

    Open/Close abstract Abstract Info Info pdf PDF
  • G. Canal, G. Alenyà and C. Torras. Adapting robot task planning to user preferences: An assistive shoe dressing example. Autonomous Robots, 2018, to appear.

    Open/Close abstract Abstract Info Info pdf PDF
  • A. Agudo and F. Moreno-Noguer. Shape basis interpretation for monocular deformable 3D reconstruction. IEEE Transactions on Multimedia, 2018, to appear.

    Open/Close abstract Abstract Info Info pdf PDF
  • A. Agudo and F. Moreno-Noguer. Robust spatio-temporal clustering and reconstruction of multiple deformable bodies. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2018, to appear.

    Open/Close abstract Abstract Info Info pdf PDF
  • A. Santamaria-Navarro, G. Loianno, J. Solà, V. Kumar and J. Andrade-Cetto. Autonomous navigation of micro aerial vehicles: State estimation using fast and low-cost sensors. Autonomous Robots, 42(6): 1263-1280, 2018.

    Open/Close abstract Abstract Info Info pdf PDF
  • R. Costa Castelló, N. Carrero, S. Dormido and E. Fossas. Teaching, analyzing, designing and interactively simulating sliding mode control. IEEE Access, 6(1): 16783-16794, 2018.

    Open/Close abstract Abstract Info Info pdf PDF
  • R. Busqué, R. Torres, J. Grau, V. Roda and A.P. Husar. Mathematical modeling, numerical simulation and experimental comparison of the desorption process in a metal hydride hydrogen storage system. International Journal of Hydrogen Energy, 43(35): 16929-16940, 2018.

    Open/Close abstract Abstract Info Info pdf PDF
  • Y. Wang, T. Álamo, V. Puig and G. Cembrano. Economic model predictive control with nonlinear constraint relaxation for the operational management of water distribution networks. Energies, 11(4): 991, 2018.

    Open/Close abstract Abstract Info Info pdf PDF
  • C. Torras. Assistent(e)s robòtiqu(e)s: Un punt de confluència entre tecnociència i humanitats. Quadern de les idees, les arts i les lletres, 38(209): 19-21, 2017.

    Open/Close abstract Abstract Info Info pdf PDF

Conference Publications

  • A. Agudo and F. Moreno-Noguer. Deformable motion 3D reconstruction by union of regularized subspaces, 25th IEEE International Conference on Image Processing, 2018, Athens, Greece, pp. 2930-2934.

    Open/Close abstract Abstract Info Info pdf PDF
  • G. Canal, E. Pignat, G. Alenyà, S. Calinon and C. Torras. Joining high-level symbolic planning with low-level motion primitives in adaptive HRI: application to dressing assistance, 2018 IEEE International Conference on Robotics and Automation, 2018, Brisbane, Australia, pp. 3273-3278.

    Open/Close abstract Abstract Info Info pdf PDF
  • J. Quevedo, H.S. Sánchez, D. Rotondo, T. Escobet and V. Puig. A two-tank benchmark for detection and isolation of cyber attacks, 10th IFAC Symposium on Fault Detection Supervision and Safety for Technical Processes, 2018, Warsow, Poland, Vol 51-24 of IFAC Papers Online, pp. 770-775, IFAC-Elsevier.

    Open/Close abstract Abstract Info Info pdf PDF
  • H.S. Sánchez, D. Rotondo, T. Escobet, V. Puig and J. Quevedo. Frequency-based detection of replay attacks: application to a multiple tank system, 10th IFAC Symposium on Fault Detection Supervision and Safety for Technical Processes, 2018, Warsow, Poland, Vol 51-24 of IFAC Papers Online, pp. 969-974, IFAC-Elsevier.

    Open/Close abstract Abstract Info Info pdf PDF
  • H.S. Sánchez, D. Rotondo, V. Puig and J. Quevedo. A shifting pole placement approach for the design of performance-varying multivariable PID controllers via BMIs, 3rd IFAC Conference on Advances in Proportional-Integral-Derivative Control, 2018, Ghent, Belgium, Vol 51(4) of IFAC Papers Online, pp. 256-261.

    Open/Close abstract Abstract Info Info pdf PDF
  • R. Bordalba, L. Ros and J.M. Porta. Randomized kinodynamic planning for constrained systems, 2018 IEEE International Conference on Robotics and Automation, 2018, Brisbane, Australia, pp. 7079-7086.

    Open/Close abstract Abstract Info Info pdf PDF
  • X. Corbella, V. Roda, R. Torres and A.P. Husar. Design of an ejector for a hydrogen recirculation system for a PEM fuel cell, 2018 European Hydrogen Energy Conference, 2018, Malaga, Spain, pp. 1-2.

    Open/Close abstract Abstract Info Info pdf PDF
  • V. Vaquero, A. Sanfeliu and F. Moreno-Noguer. Deep lidar CNN to understand the dynamics of moving vehicles, 2018 IEEE International Conference on Robotics and Automation, 2018, Brisbane, Australia, pp. 4504-4509.

    Open/Close abstract Abstract Info Info pdf PDF
  • A. Pumarola, A. Agudo, A.M. Martinez, A. Sanfeliu and F. Moreno-Noguer. GANimation: Anatomically-aware facial animation from a single image, 15th European Conference on Computer Vision, 2018, Munich, in Computer Vision - ECCV 2018, Vol 11214 of Lecture Notes in Computer Science, pp. 835-851, 2018.

    Open/Close abstract Abstract Info Info pdf PDF
  • C. Sun, B. Joseph, G. Cembrano, V. Puig and J. Meseguer. Advanced integrated real-time control of combined urban drainage systems using MPC: Badalona case study, 13th International Conference on Hydroinformatics, 2018, Palermo, Italy, pp. 2033-2041.

    Open/Close abstract Abstract Info Info pdf PDF
  • J.M. Díaz, S. Dormido and R. Costa Castelló. The use of interactivity in the controller design: Loop shaping versus closed-loop shaping, 3rd IFAC Conference on Advances in Proportional-Integral-Derivative Control, 2018, Ghent, Belgium, Vol 51(4) of IFAC Papers Online, pp. 334-339.

    Open/Close abstract Abstract Info Info pdf PDF
  • J. Feng, C. Sun, G. Cembrano and V. Puig. Factors influencing the simplified quality model performance, 13th International Conference on Hydroinformatics, 2018, Palermo, Italy, pp. 706-714.

    Open/Close abstract Abstract Info Info pdf PDF
  • A. Agudo, M. Pijoan and F. Moreno-Noguer. Image collection pop-up: 3D reconstruction and clustering of rigid and non-rigid categories, 2018 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2018, Salt Lake City, to appear.

    Open/Close abstract Abstract Info Info pdf PDF
  • Y. Xing, J. Na and R. Costa Castelló. Composite PID control with unknown dynamics estimator for rotomagnet plant. , 3rd IFAC Conference on Advances in Proportional-Integral-Derivative Control, 2018, Ghent, Belgium, Vol 51(4) of IFAC Papers Online, pp. 817-822.

    Open/Close abstract Abstract Info Info pdf PDF
  • C. Sun, G. Cembrano, V. Puig and J. Meseguer. Cyber-physical systems for real-time management in the urban water cycle, 4th International Workshop on Cyber-Physical Systems for Smart Water Networks, 2018, Porto, Portugal, pp. 5-8.

    Open/Close abstract Abstract Info Info pdf PDF
  • A. Pumarola, A. Agudo, L. Porzi, A. Sanfeliu, V. Lepetit and F. Moreno-Noguer. Geometry-aware network for non-rigid shape prediction from a single view, 2018 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2018, Salt Lake City, to appear.

    Open/Close abstract Abstract Info Info pdf PDF
  • U. Raveendran Nair, R. Costa Castelló and A. Baños. Grid voltage regulation using a reset PI+CI controller for energy storage systems. , 3rd IFAC Conference on Advances in Proportional-Integral-Derivative Control, 2018, Ghent, Belgium, Vol 51(4) of IFAC Papers Online, pp. 226-231.

    Open/Close abstract Abstract Info Info pdf PDF
  • A. Pumarola, A. Agudo, A. Sanfeliu and F. Moreno-Noguer. Unsupervised person image synthesis in arbitrary poses, 2018 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2018, Salt Lake City, to appear.

    Open/Close abstract Abstract Info Info pdf PDF
  • A. Suárez, G. Alenyà and C. Torras. Interleaving hierarchical task planning and motion constraint testing for dual-arm manipulation, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2018, Madrid, to appear.

    Open/Close abstract Abstract Info Info pdf PDF
  • G. Rotger, F. Lumbreras, F. Moreno-Noguer and A. Agudo. 2D-to-3D facial expression transfer, 2018 International Conference on Pattern Recognition, 2018, Beijing, China, to appear.

    Open/Close abstract Abstract Info Info pdf PDF
  • V. Vaquero, A. Sanfeliu and F. Moreno-Noguer. Hallucinating dense optical flow from sparse lidar for autonomous vehicles, 2018 International Conference on Pattern Recognition, 2018, Beijing, China, to appear.

    Open/Close abstract Abstract Info Info pdf PDF
  • S. Sarabandi and F. Thomas. Accurate computation of quaternions from rotation matrices, 16th International Conference on Advances in Robot Kinematics, 2018, Bologna, Italy, in Advances in Robot Kinematics 2018, Vol 8 of Springer Proceedings in Advanced Robotics, pp. 39-46, 2019.

    Open/Close abstract Abstract Info Info pdf PDF
  • S. Sarabandi, P. Grosch, J.M. Porta and F. Thomas. A reconfigurable asymmetric 3-UPU parallel robot , 4th International Conference on Reconfigurable Mechanisms and Robots, 2018, Delft, Netherlands, pp. 1-8.

    Open/Close abstract Abstract Info Info pdf PDF
  • L. Porzi, A. Penate-Sanchez, E. Ricci and F. Moreno-Noguer. Depth-aware convolutional neural networks for accurate 3D pose estimation in RGB-D images, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2017, Vancouver, Canada, pp. 5777-5783.

    Open/Close abstract Abstract Info Info pdf PDF
  • V. Vaquero, I. del Pino, F. Moreno-Noguer, J. Solà, A. Sanfeliu and J. Andrade-Cetto. Deconvolutional networks for point-cloud vehicle detection and tracking in driving scenarios, 8th European Conference on Mobile Robots, 2017, Paris, France, pp. 1-7.

    Open/Close abstract Abstract Info Info pdf PDF
  • J. Vallvé, J. Solà and J. Andrade-Cetto. Factor descent optimization for sparsification in graph SLAM, 8th European Conference on Mobile Robots, 2017, Paris, France, pp. 1-6.

    Open/Close abstract Abstract Info Info pdf PDF
  • I. del Pino, V. Vaquero, B. Masini, J. Solà, F. Moreno-Noguer, A. Sanfeliu and J. Andrade-Cetto. Low resolution lidar-based multi object tracking for driving applications, 3rd Iberian Robotics Conference, 2017, Seville, in Robot 2017: Third Iberian Robotics Conference, Vol 694 of Advances in Intelligent Systems and Computing, pp. 287-298, Springer.

    Open/Close abstract Abstract Info Info pdf PDF
  • A. Hernandez Ruiz, L. Porzi, S. Rota and F. Moreno-Noguer. 3D CNNs on distance matrices for human action recognition, 25th ACM Conference on Multimedia, 2017, Mountain View, CA. USA., pp. 1087-1095.

    Open/Close abstract Abstract Info Info pdf PDF
  • A. Garrell Zulueta, L.A. Garza, M. Villamizar, F. Herrero and A. Sanfeliu. Aerial social force model: A new framework to accompany people using autonomous flying robots, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2017, Vancouver, Canada, pp. 7011-7017.

    Open/Close abstract Abstract Info Info pdf PDF

Other Publications

  • A. Santamaria-Navarro, J. Solà and J. Andrade-Cetto. Visual Guidance of Unmanned Aerial Manipulators. Volume 125 of Springer Tracts in Advanced Robotics. Springer International Publishing, 2019.

    Open/Close abstract Abstract Info Info
  • C. Torras. The Vestigial Heart. A Novel of the Robot Age. The MIT Press, 2018.

    Open/Close abstract Abstract Info Info pdf PDF