Research line
Perception and Manipulation

The research of PERCEPTION AND MANIPULATION group focuses on enhancing the perception, learning, and planning capabilities of robots to achieve higher degrees of autonomy and user-friendliness during everyday manipulation tasks. Some topics addressed are the geometric interpretation of perceptual information, construction of 3D object models, action selection and planning, reinforcement learning, and teaching by demonstration.
Head of line: Carme Torras Genís

Research areas
>> Learning by demonstration
>> Planning for perception and manipulation
>> Perception of rigid and non-rigid objects

Tech. transfer
Our activity finds applications in several fields through collaboration with our technological partners
Facilities

Research projects
We carry out projects from national and international research programmes.
→ More about our research projects
<< Back to Perception and Manipulation main page
Learning by demonstration
We devise methods to learn object-action relations to accomplish tasks at different levels of abstraction, where object models are generated from visual and depth information, and actions, involving manipulation skills, are learned from demonstrations provided by a human using multimodal algorithms that combine vision and haptics.

Planning for perception and manipulation
We are interested in view planning for object modeling, as well as manipulation planning, with special interest in deformable objects. High-level task formulations are integrated with low-level geometry-based methods and simplified physical models, together with an on-line sensory-based treatment of uncertainty, so as to come up with specific sequences of motion commands.

Perception of rigid and non-rigid objects
Our objective is to investigate computer vision algorithms for interpreting and understanding scenes from images, with applications in robotics and medical imaging. In particular, our activities are concentrated on retrieving rigid and non-rigid shape, motion and camera pose from single images and video sequences.

These are the latest research projects of the Perception and Manipulation research line:
-
IPALM: Interactive Perception-Action-Learning for Modelling Objects
European Project
Start Date: 01/10/2019
-
IMAGINE: Robots understanding their actions by imagining their effects
European Project
Start Date: 01/01/2017
-
I-DRESS: Assistive interactive robotic system for support in dressing
European Project
Start Date: 01/12/2015
-
ViSen: Visual Sense, Tagging visual data with semantic descriptions
European Project
Start Date: 01/07/2013
-
IntellAct: Intelligent observation and execution of Actions and manipulations
European Project
Start Date: 01/03/2011
-
PACOPLUS: Perception, action & cognition through learning of object-action complexes.
European Project
Start Date: 01/02/2006
-
PARALIN: Parallel computing modelling for industrial problems
European Project
Start Date: 01/06/1996
-
ROB-IN: Robots para la asistencia continua y personalizada capaces de explicarse a sí mismos
National Project
Start Date: 01/12/2021
-
CHLOE-GRAPH: ClotH-Like ObjEcts Grasping, Representation, and Action Planning
National Project
Start Date: 01/09/2021
-
GREAT: Beyond Graph Neural Networks: Joint graph topology learning and graph-based inference for computer vision
National Project
Start Date: 01/06/2020
-
HuMoUR: Markerless 3D human motion understanding for adaptive robot behavior
National Project
Start Date: 01/01/2018
-
RobInstruct: Instructing robots using natural communication skills
National Project
Start Date: 01/01/2015
-
REST: Computación mediante restricciones en robótica y gestión de recursos
National Project
Start Date: 31/12/1999
-
AECEX 2022: Ayuda extraordinaria a Unidad de Excelencia María de Maeztu 2022
CSIC Project
Start Date: 15/03/2022
-
AECEX: Ayuda extraordinaria a Unidad de Excelencia María de Maeztu
CSIC Project
Start Date: 24/03/2021
-
CONPRERO: NonLinear Predictive Control For Robotic Systems With High Dynamics
CSIC Project
Start Date: 15/01/2021
-
MARE: Manipulación robotizada: Aprendizaje por demostración y Refuerzo
CSIC Project
Start Date: 15/12/2018
-
R3OBJ: Reconstrucción 3D, localización y segmentación automática de objetos a partir de imágenes
CSIC Project
Start Date: 22/11/2018
-
CINNOVA: Modelos cinemáticos y técnicas de aprendizaje para robots de estructura innovadora
CSIC Project
Start Date: 01/07/2011
-
MVOD: Medición eficiente de volúmenes de objetos deformables con cámaras rentables
CSIC Project
Start Date: 01/03/2012
-
APREN: Modelos perceptivos y técnicas de aprendizaje para robots de servicios
CSIC Project
Start Date: 01/01/2010
-
BPnP: Priors para la detección 3D en tiempo real de objetos rígidos y deformables
CSIC Project
Start Date: 01/10/2008
-
SGR RobIRI: Grup consolidat de Percepció i Manipulació Robotitzada de l'IRI
Regional Project
Start Date: 01/01/2017
-
SIMBIOTS: Facilitar una introducció de la robòtica a nous processos i aplicacions dintre de la industria
Regional Project
Start Date: 01/01/2018
-
PYERCING: Open your ears: predicting object material from impact sounds
UPC Project
Start Date: 01/07/2020
-
MP-CloL: Learning Robotic Cloth Manipulation based on Physics Models and Model Predictive Control
UPC Project
Start Date: 01/07/2020
-
SPECTACLE: From Spectators to Actors: Understanding Social Interactions through the Eyes of a Participant
UPC Project
Start Date: 01/10/2019
-
MESSI: Camera Self-Calibration for Structure from Motion on Dynamic Scenarios
UPC Project
Start Date: 01/10/2019
-
iMOVE: Development of a hybrid control interface based on sEMG and movement signals for an assistive robotic manipulator
UPC Project
Start Date: 01/10/2019
-
LatCom: Variable Impedance Control with Movement Primitives in Latent Spaces During Compliant Manipulation
UPC Project
Start Date: 01/01/2019
-
LLULL: Librerías de tratamiento de datos, modelado y exploración de procesos industriales
Technology Transfer Contract
Start Date: 03/07/2019
-
Text4Pose: Leveraging text to improve human pose, shape, motion estimation and generation
Technology Transfer Contract
Start Date: 15/09/2021
-
Amazon ResearchAward: Geometry-aware 3D Human Body Animation from Still Photos
Technology Transfer Contract
Start Date: 14/03/2019
-
DeepRender: Deep Neural Rendering for Cinematography
Technology Transfer Contract
Start Date: 15/02/2022
-
DeepSoccer: Deep Learning Technology applied to Soccer Videos
Technology Transfer Contract
Start Date: 20/05/2019
-
IMPROFIT: Estimació de la posició del cos humà a partir d’imatges de dispositius mòbils
Technology Transfer Contract
Start Date: 01/10/2021
-
PADEL: Asesoramiento visión por ordenador para partidos de pádel
Technology Transfer Contract
Start Date: 29/06/2021
-
HELIPORTS: Desarrollo de soluciones de visión por computador para la gestión de helipuertos y aeródromos
Technology Transfer Contract
Start Date: 06/05/2021
-
APYUR: Asesoramiento para el análisis y ensayo en el desarrollo de un sistema de visión multi-cámara para identificación de personas
Technology Transfer Contract
Start Date: 26/07/2021
-
Google ResearchAward: GANimation3D: Unsupervised 3D Face Animation from Monocular Images
Technology Transfer Contract
Start Date: 01/10/2019
-
SLD: Proceso automatizado de detección y clasificación inteligente de pieles (smart leather detector)
Technology Transfer Contract
Start Date: 06/03/2018
-
AIPICS: Desarrollo de un sistema integral de control de la producción dotado de inteligencia artificial y capacidad de autodecisión
Technology Transfer Contract
Start Date: 01/01/2018
-
RELAPP: Aplicació electrònica portàtil controlada per una APP per a la mesura in situ de l’elasticitat de materials visco-elàstics
Technology Transfer Contract
Start Date: 19/10/2020
-
SCIACE: Sistema de climatización inteligente auto-adaptativo a las condiciones del entorno
Technology Transfer Contract
Start Date: 15/12/2017
-
3T-SLTE: Grupo tractor para elevadores con gestión inteligente de energía integrada
Technology Transfer Contract
Start Date: 11/03/2015
-
PERSEO: Paquete escalable robusto soluciones específicas orientadas
Technology Transfer Contract
Start Date: 26/05/2016
-
Google Faculty Award: Geometry-aware CNNs for Non-Rigid Shape Reconstruction
Technology Transfer Contract
Start Date: 17/02/2017
-
TERMOSOLD: Desarrollo de un sistema basado en técnicas de inteligencia artificial para la inspección de soldaduras en lineas de envasado horizontal
Technology Transfer Contract
Start Date: 10/03/2015
-
CRISTALBREAD: Investigació de la capacitat de tecnologíes de robotització intel.ligent per a la manipulació de masses de panificació altament hidratades
Technology Transfer Contract
Start Date: 01/03/2015
-
SENECA: Semi-automatic neuron reconstruction in CATMAID
Technology Transfer Contract
Start Date: 01/09/2015
-
SITVIA: Sistema de inspección de tampografía por visión artificial adaptable
Technology Transfer Contract
Start Date: 07/09/2015
-
AutomaticTV: Algorithms for automatic audiovisual production
Technology Transfer Contract
Start Date: 24/10/2014
-
RecycLearn: Desarrollo de tecnología para aprendizaje autónomo de un brazo robótico - Aplicación a plantas de reciclaje.
Technology Transfer Contract
Start Date: 01/09/2013
-
ROBOSOFT: Sistema de visió d'ajuda a la conducció per al vehicle NICOLAS-VTCU
Technology Transfer Contract
Start Date: 23/02/2006
These are the most recent publications (2022 - 2021) of the Perception and Manipulation
-
A. Agudo. Unsupervised 3D reconstruction and grouping of rigid and non-rigid categories. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(1): 519-532, 2022.
Abstract
Info
PDF
-
F. Coltraro, J. Amorós, M. Alberich-Carramiñana and C. Torras. An inextensible model for the robotic manipulation of textiles. Applied Mathematical Modelling, 101: 832-858, 2022.
Abstract
Info
PDF
-
A. Agudo, V. Lepetit and F. Moreno-Noguer. Simultaneous completion and spatiotemporal grouping of corrupted motion tracks. The Visual Computer, 2022, to appear.
Abstract
Info
PDF
-
X. Xu, H. Chen, F. Moreno-Noguer, L. Jeni and F. De la Torre. 3D human pose, shape and texture from low-resolution images and videos. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2022.
Abstract
Info
PDF
-
A. Pérez and A. Agudo. Matching and recovering 3D people from multiple views, 2022 IEEE Winter Conference on Applications of Computer Vision, 2022, Waikoloa, Hawaii, USA, pp. 1184-1193, IEEE.
Abstract
Info
PDF
-
P. Jiménez. Learning in autonomous and intelligent systems: Overview and biases from data sources. Arbor - Ciencia, Pensamiento y Cultura, 197(802): a627, 2022.
Abstract
Info
PDF
-
A. Olivares-Alarcos, S. Foix, S. Borgo and G. Alenyà. OCRA – An ontology for collaborative robotics and adaptation. Computers in Industry, 132: 103627, 2022.
Abstract
Info
PDF
-
I. Garcia-Camacho, J. Borràs, B. Calli, A. Norton and G. Alenyà. Household cloth object set: Fostering benchmarking in deformable object manipulation. IEEE Robotics and Automation Letters, 7(3): 5866-5873, 2022, to appear.
Abstract
Info
PDF
-
A. Andriella, C. Torras, C. Abdelnour and G. Alenyà. Introducing CARESSER: A framework for in situ learning robot social assistance from expert knowledge and demonstrations. User Modeling and User-Adapted Interaction, 2022.
Abstract
Info
PDF
-
A. San-Miguel, G. Alenyà and V. Puig. Automated off-line generation of stable variable impedance controllers according to performance specifications. IEEE Robotics and Automation Letters, 7(3): 5874-5881, 2022, to appear.
Abstract
Info
PDF
-
J. Borràs. Effective grasping enables successful robot-assisted dressing. Science robotics, 7(65): eabo7229, 2022.
Abstract
Info
PDF
-
W. Guo, E. Corona, F. Moreno-Noguer and X. Alameda. PI-Net: Pose interacting network for multi-person monocular 3D pose estimation, 21st IEEE Winter Conference on Applications of Computer Vision, 2021, (Virtual), pp. 2795-2805.
Abstract
Info
PDF
-
M. Dimiccoli, H. Wendt and P. Batlle. Learning grounded word meaning representations on similarity graphs, 16th Conference on Empirical Methods in Natural Language Processing, 2021, Punta Cana, Dominican Republic, pp. 4760-4769.
Abstract
Info
PDF
-
A. Pumarola, E. Corona, G. Pons-Moll and F. Moreno-Noguer. D-NeRF: Neural radiance fields for dynamic scenes, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, Nashville, TN, USA (Virtual), pp. 10313-10322, Computer Vision Foundation.
Abstract
Info
PDF
-
M. Alberich-Carramiñana, P. Almirón, G. Blanco and A. Melle-Hernández. The minimal Tjurina number of irreducible germs of plane curve singularities. Indiana University Mathematics Journal, 70(4): 1211-1220, 2021.
Abstract
Info
PDF
-
J. Shen, A. Ruiz, A. Agudo and F. Moreno-Noguer. Stochastic Neural Radiance Fields: Quantifying uncertainty in implicit 3D representations, 2021 International Conference on 3D Vision, 2021, London, UK (Virtual), pp. 972-981.
Abstract
Info
PDF
-
M. Dalmasso, A. Garrell Zulueta, J.E. Domínguez, P. Jiménez and A. Sanfeliu. Human-robot collaborative multi-agent path planning using Monte Carlo tree search and Social Reward Sources, 2021 IEEE International Conference on Robotics and Automation, 2021, Xian, China, pp. 10133-10138.
Abstract
Info
PDF
-
E. Corona, A. Pumarola, G. Alenyà, G. Pons-Moll and F. Moreno-Noguer. SMPLicit: Topology-aware generative model for clothed people, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, Nashville, TN, USA (Virtual), pp. 11870-11880, Computer Vision Foundation.
Abstract
Info
PDF
-
M. Alberich-Carramiñana, J. Amorós and F. Coltraro. Developable surfaces with prescribed boundary. In Extended Abstracts GEOMVAP 2019, 127-132. Springer-Birkhäuser, 2021.
Abstract
Info
PDF
-
G. Simarro, D. Calvete, T. Plomaritis, F. Moreno-Noguer, I. Giannoukakou, J. Montes and R. Duran. The influence of camera calibration on nearshore bathymetry estimation from UAV videos. Remote Sensing, 13(1): 150, 2021.
Abstract
Info
PDF
-
J. Laplaza, A. Pumarola, F. Moreno-Noguer and A. Sanfeliu. Attention deep learning based model for predicting the 3D human body pose using the robot human handover phases, 30th IEEE International Symposium on Robot and Human Interactive Communication, 2021, Vancouver, Canada, pp. 161-166.
Abstract
Info
PDF
-
A. Chatziagapi, S. Athar, F. Moreno-Noguer and D. Samaras. SIDER: Single-image neural optimization for facial geometric detail recovery, 2021 International Conference on 3D Vision, 2021, London, UK (Virtual), pp. 815-824.
Abstract
Info
PDF
-
M. Alberich-Carramiñana, J. Àlvarez and V. González. When is a complete ideal in a rational surface singularity a multiplier ideal?. In Extended Abstracts GEOMVAP 2019, 145-151. Springer-Birkhäuser, 2021.
Abstract
Info
PDF
-
M. Arduengo, A. Colomé, J. Borràs, L. Sentis and C. Torras. Task-adaptive robot learning from demonstration with Gaussian process models under replication. IEEE Robotics and Automation Letters, 6(2): 966-973, 2021.
Abstract
Info
PDF
-
J. Pareto, B. Román and C. Torras. The ethical issues of social assistive robotics: A critical literature review. Technology in Society, 67: 101726, 2021.
Abstract
Info
PDF
-
J. Lundell, E. Corona, T. Nguyen Le, F. Verdoja, P. Weinzaepfel, G. Rogez, F. Moreno-Noguer and V. Kyrki. Multi-FinGAN: Generative coarse-to-fine sampling of multi-finger grasps, 2021 IEEE International Conference on Robotics and Automation, 2021, Xian, China, pp. 4495-4501.
Abstract
Info
PDF
-
M. Alberich-Carramiñana, G. Blanco, I. Gálvez Carrillo, M. Garrote-López, E. Miranda (editors). Extended Abstracts GEOMVAP 2019. Volume 15 of Trends in Mathematics-Research Perspectives CRM Barcelona. Springer-Birkhäuser, 2021.
Abstract
Info
PDF
-
A. Colomé and C. Torras. A topological extension of movement primitives for curvature modulation and sampling of robot motion. Autonomous Robots, 45: 725-735, 2021.
Abstract
Info
PDF
-
I. Garcia-Camacho, J. Borràs and G. Alenyà. Benchmarking cloth manipulation using action graphs: an example in placing flat, 1st IROS Workshop on Benchmarking of robotic grasping and manipulation: protocols, metrics and data analysis, 2021, Prague, Czech Republic (Virtual), pp. 1-3.
Abstract
Info
PDF
-
A. Olivares-Alarcos, S. Foix and G. Alenyà. Knowledge Representation for Explainability in Collaborative Robotics and Adaptation, 3rd International Workshop on Data meets Applied Ontologies, 2021, Bratislava, Slovakia (Virtual), pp. 1-8.
Abstract
Info
PDF
-
B.W. Smith, J. Lobo, D.K. Zondervan, C. Lew, V. Chan, C. Chou, S. Toledo, D.J. Reinkensmeyer, S. Shaw and S.C. Cramer. Using a bimanual lever-driven wheelchair for arm movement practice early after stroke: A pilot, randomized, controlled, single-blind trial. Clinical Rehabilitation, 35(11): 1577-1589, 2021.
Abstract
Info
PDF
-
V. Vaquero, I. del Pino, F. Moreno-Noguer, J. Solà, A. Sanfeliu and J. Andrade-Cetto. Dual-branch CNNs for vehicle detection and tracking on LiDAR data. IEEE Transactions on Intelligent Transportation Systems, 22(11): 6942-6953, 2021.
Abstract
Info
PDF
-
F. Strazzeri and C. Torras. Topological representation of cloth state for robot manipulation. Autonomous Robots, 45: 737–754, 2021.
Abstract
Info
PDF
-
G. Canal, C. Torras and G. Alenyà. Are preferences useful for better assistance?: A physically assistive robotics user study. ACM Transactions on Human-Robot Interaction, 10(4): 1-19, 2021.
Abstract
Info
PDF
-
B.M. Lopes, J. Sousa and G. Alenyà. Machine learning methods for quality prediction in thermoplastics injection molding, 2021 IEEE International Conference on Electrical, Computer and Energy Technologies, 2021, Cape Town, South Africa (Virtual), pp. 1-6.
Abstract
Info
PDF
-
F. Strazzeri and C. Torras. Configuration space of a textile rectangle. In Geometry, Topology, Algebra, and Applications; Women in Geometry and Topology, 133-137. Springer-Birkhäuser, 2021.
Abstract
Info
PDF
-
B. Nicolás, X. Wu, M. Dimiccoli, J. Sierpowska, C. Saiz-Masvidal, C. Soriano-Mas, P. Radeva and L. Fuentemilla. Behavioural and neurophysiological signatures in the retrieval of individual memories of recent and remote real-life routine episodic events. Cortex, 141: 128-143, 2021.
Abstract
Info
PDF
-
A. San-Miguel, V. Puig and G. Alenyà. Disturbance observer-based LPV feedback control of a N-DoF robotic manipulator including compliance through gain shifting. Control Engineering Practice, 115(104887), 2021.
Abstract
Info
PDF
-
M. Alberich-Carramiñana, A. Fernández-Boix, J. Fernández, J. Guàrdia, E. Nart and J. Roé. Of limit key polynomials. Illinois Journal of Mathematics, 65(1): 201-229, 2021.
Abstract
Info
PDF
-
J. Garcia, A. Agudo and F. Moreno-Noguer. E-DNAS: Differentiable neural architecture search for embedded systems, 25th International Conference on Pattern Recognition, 2021, Milan, Italy (Virtual), pp. 4704-4711.
Abstract
Info
PDF
-
M.A. Roa, M.R. Dogar, J. Pagès, C. Vivas, A. Morales, N. Correll, M. Görner, J. Rosell, S. Foix, R. Memmesheier and F. Ferro. Mobile manipulation hackathon: moving into real world applications. IEEE Robotics and Automation Magazine, 28(2): 112-124, 2021.
Abstract
Info
PDF
-
A. Carfi, T. Patten, Y. Kuang, A. Hammoud, M. Alameh, E. Maiettini, A.I. Weinberg, D. Faria, F. Mastrogiovanni, G. Alenyà, L. Natale, V. Perdereau, M. Vincze and A. Billard. Hand-Object Interaction: From Human Demonstrations to Robot Manipulation. Frontiers in Robotics and AI, 8: 714023, 2021.
Abstract
Info
PDF
-
P. Goncalves, A. Olivares-Alarcos, J. Bermejo-Alonso, S. Borgo, M. Diab, M.K. Habib, H. Nakawala, V.R. Kumar, R. Sanz, E. Tosello and H. Li. IEEE Standard for autonomous robotics ontology [Standards]. IEEE Robotics and Automation Magazine, 28(3): 171-173, 2021.
Abstract
Info
PDF
-
A. Agudo. Total estimation from RGB video: On-line camera self-calibration, non-rigid shape and motion, 25th International Conference on Pattern Recognition, 2021, Milan, Italy (Virtual), pp. 8140-8147.
Abstract
Info
PDF
-
N. Hansen, R. Jangir, Y.S. , G. Alenyà, P. Abbeel, A.A. , L.P. and X.W.. Self-supervised policy adaptation during deployment, 9th International Conference on Learning Representations, 2021, (Virtual).
Abstract
Info
PDF
-
A. Suárez, A. Andriella, A. Taranović, J. Segovia, C. Torras and G. Alenyà. Automatic learning of cognitive exercises for socially assistive robotics, 30th IEEE International Symposium on Robot and Human Interactive Communication, 2021, Vancouver, Canada, pp. 139-146.
Abstract
Info
PDF
-
A. Rodríguez, J. Lobo and J.M. Font. Systematic review on wearable lower-limb exoskeletons for gait training in neuromuscular impairments. Journal of NeuroEngineering and Rehabilitation, 18(22), 2021.
Abstract
Info
PDF
-
A. Cartas, P. Radeva and M. Dimiccoli. Modeling long-term interactions to enhance action recognition, 25th International Conference on Pattern Recognition, 2021, Milan, Italy (Virtual), pp. 10351-10358.
Abstract
Info
PDF
-
A. Agudo. Piecewise Bézier space: Recovering 3D dynamic motion from video, 28th IEEE International Conference on Image Processing, 2021, Anchorage, AK, USA, pp. 3268-3272.
Abstract
Info
PDF
-
A. Vakhitov, L. Ferraz, A. Agudo and F. Moreno-Noguer. Uncertainty-Aware Camera Pose Estimation from Points and Lines, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, Nashville, TN, USA (Virtual), pp. 4657-4666, Computer Vision Foundation.
Abstract
Info
PDF
-
A. Chacón, P. Ponsa and C. Angulo. Usability study through a human-robot collaborative workspace experience. Designs, 5(2): 35, 2021.
Abstract
Info
PDF
-
A. Andriella, H. Siqueira, D. Fu, S. Magg, P. Barros, S. Wermter, C. Torras and G. Alenyà. Do I have a personality? Endowing care robots with context-dependent personality traits. International Journal of Social Robotics, 13(8): 2081-2102, 2021.
Abstract
Info
PDF
-
S. Felicioni and M. Dimiccoli. Interaction-GCN: a Graph Convolutional Network based framework for social interaction recognition in egocentric videos, 28th IEEE International Conference on Image Processing, 2021, Anchorage, AK, USA, pp. 2348-2352.
Abstract
Info
PDF
-
M. Arduengo, C. Torras and L. Sentis. Robust and adaptive door operation with a mobile robot. Intelligent Service Robotics, 14(3): 409-425, 2021.
Abstract
Info
PDF
-
P. Noriega, T. Ausín, H. Mueller, M. Ellman, A.R. Cardoso, F. Aguiar, D. López, M.A. Toboso, A. Wagner, A. García, S. Degli Esposti, L.M. Miller, P. Jiménez, J. Pareto and C. Torras. Challenge 6: Ethical, legal, economic, and social implications. In Artificial Intelligence, Robotics & Data Science, 121-141. Consejo Superior de Investigaciones Científicas, 2021.
Abstract
Info
PDF
-
A. Cartas, E. Talavera, P. Radeva and M. Dimiccoli. Understanding event boundaries for egocentric activity recognition from photo-streams, 2021 ICPR International Workshops and Challenges, 2021, Milan, Italy (Virtual), in Pattern Recognition. ICPR International Workshops and Challenges. Proceedings, Part III, Vol 12663 of Lecture Notes in Computer Science, pp. 334-347, 2021, Springer International Publishing.
Abstract
Info
PDF
-
A. Chacón, P. Ponsa and C. Angulo. Cognitive interaction analysis in human–robot collaboration using an assembly task. Electronics, 10(11): 1317, 2021.
Abstract
Info
PDF
-
C. Torras. Ciència i ficció: quina inspira quina?. In ENTRE LA MANO Y LA CABEZA: Trece puntos de encuentro entre la ciencia y la literatura, 117-125. Inspiraciencia, CSIC Catalunya, 2021.
Abstract
Info
PDF
-
F. Manyà, A. Colomé, G. García, D. Ríos, A. Torres, E. Armengol, C. Blum, T. Flaminio, L. Godo, J. Levy, P. Meseguer and J. Segovia. Challenge 1: Integrating knowledge, reasoning and learning. In Artificial Intelligence, Robotics & Data Science, 19-37. Consejo Superior de Investigaciones Científicas, 2021.
Abstract
Info
PDF
-
A. Ruiz and J. Verbeek. Anytime inference with distilled hierarchical neural ensembles, 35th AAAI Conference on Artificial Intelligence, 2021, (Virtual), pp. 9463-9471.
Abstract
Info
PDF
-
A. Duarte, S. Palaskar, L. Ventura, D. Ghadiyaram, K. DeHaan, F. Metze, J. Torres and X. Giro-i-Nieto. How2Sign: A large-scale multimodal dataset for continuous American sign language, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, Nashville, TN, USA (Virtual), pp. 2734-2743, Computer Vision Foundation.
Abstract
Info
PDF
-
J. Sanchez, A. Pumarola and F. Moreno-Noguer. PhysXNet: A customizable approach for learning cloth dynamics on dressed people, 2021 International Conference on 3D Vision, 2021, London, UK (Virtual), pp. 879-888.
Abstract
Info
PDF
-
N. Osman, D. López, V. Gallego, D. Ríos, M. San Miguel, M.A. Toboso, P. Noriega, J.A. Rodríguez, J. Sabater, C.S. , D. Zurro, S. Degli Esposti and G. Alenyà. Challenge 2: Multiagent systems. In Artificial Intelligence, Robotics & Data Science, 39-52. Consejo Superior de Investigaciones Científicas, 2021.
Abstract
Info
PDF
-
A. Ruiz, A. Agudo and F. Moreno-Noguer. Generating attribution maps with disentangled masked backpropagation, 2021 International Conference on Computer Vision, 2021, (Virtual), pp. 885-894.
Abstract
Info
PDF
-
M. Arduengo, A. Arduengo, A. Colomé, J. Lobo and C. Torras. Human to robot whole-body motion transfer, 2020 IEEE-RAS International Conference on Humanoid Robots, 2021, Munich, Germany (Virtual), pp. 299-305.
Abstract
Info
PDF
-
E. Ramon, G. Triginer, J. Escur, A. Pumarola, J. García, X. Giro-i-Nieto and F. Moreno-Noguer. H3D-Net: Few-shot high-fidelity 3D head reconstruction, 2021 International Conference on Computer Vision, 2021, (Virtual), pp. 5620-5629, to appear.
Abstract
Info
PDF
-
G. Alenyà, J. Villagrá, R.E. Fernández, P. González, R.E. Haber, A.R. Jiménez, A. Ribeiro, E. Rocón, J. Borràs, F. Moreno-Noguer and C. Torras. Challenge 4: Intelligent robotics. In Artificial Intelligence, Robotics & Data Science, 81-99. Consejo Superior de Investigaciones Científicas, 2021.
Abstract
Info
PDF
-
A. Suárez, J. Segovia, C. Torras and G. Alenyà. Online action recognition, 35th AAAI Conference on Artificial Intelligence, 2021, (Virtual), pp. 11981-11989.
Abstract
Info
PDF
-
M. Dimiccoli, L. Garrido, G. Rodríguez and H. Wendt. Graph constrained data representation learning for human motion segmentation, 2021 International Conference on Computer Vision, 2021, (Virtual), pp. 1460-1469, to appear.
Abstract
Info
PDF
-
A. Hernandez Ruiz, A. Vilalta and F. Moreno-Noguer. Neural Cellular Automata manifold, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, Nashville, TN, USA (Virtual), pp. 10015-10023, Computer Vision Foundation.
Abstract
Info
PDF
-
Q. Guan, Z. Qu, M. Zeng, J. Shen and J. Du. CGP Box: An effective direction representation strategy for oriented object detection in remote sensing images. International Journal of Remote Sensing, 42(17): 6666-6687, 2021.
Abstract
Info
PDF
-
J. Pareto. Prolegómenos a una ética para la robótica social. DILEMATA, Revista Internacional de Éticas Aplicadas(34): 71-87, 2021.
Abstract
Info
PDF
-
B.M. Lopes, J. Sousa and G. Alenyà. Data acquisition and monitoring system for legacy injection machines, 9th IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications, 2021, Hong Kong, China (Virtual).
Abstract
Info
PDF
-
N. Ugrinovic, A. Ruiz, A. Agudo, A. Sanfeliu and F. Moreno-Noguer. Body size and depth disambiguation in multi-person reconstruction from single images, 2021 International Conference on 3D Vision, 2021, London, UK (Virtual), pp. 53-63.
Abstract
Info
PDF
-
M. Alberich-Carramiñana, A. Ferragut and J. Llibre. Quadratic planar differential systems with algebraic limit cycles via quadratic plane Cremona maps. Advances in Mathematics , 389: 107924, 2021.
Abstract
Info
PDF
Perception and Manipulation Laboratory
The Perception and Manipulation Laboratory is the main facility devoted to experimentation on the topics of the research line. It occupies 142 m² in the second floor of the Faculty, and a large part hosts a life-scale mock-up of a (quite) small apartment (35 m²). Two PAL one-armed mobile TIAGo robots dwell within the apartment, but are occasionally taken out for experimentation elsewhere. There is also a manipulation area equipped with two WAM robot arms and a KINOVA manipulator, and workplaces are distributed along the perimeter. Next to the laboratory, with a direct view through a window, there is the Scientific and Technical Lab support office.
The Laboratory is further equipped with commercial and self-developed grippers, sensing devices, and augmented reality appliances. Laboratory service offers quick experimental setup, several standardized software tools, and expertise in robot control and perception algorithms. It also hosted the Humanoids Lab Initiative in the past, and we still keep 15 small humanoid robots for educational or promotional purposes.


Researchers
-
Agudo Martínez, Antonio
aagudo (at) iri.upc.edu
-
Alberich Carramiñana, Maria
alberich (at) iri.upc.edu
-
Alenyà Ribas, Guillem
galenya (at) iri.upc.edu
-
Angulo Bahon, Cecilio
cangulo (at) iri.upc.edu
-
Barrue Subirana, Cristian
cbarrue (at) iri.upc.edu
-
Borràs Sol, Júlia
jborras (at) iri.upc.edu
-
Colomé Figueras, Adrià
acolome (at) iri.upc.edu
-
Dimiccoli, Mariella
mdimiccoli (at) iri.upc.edu
-
Foix Salmerón, Sergi
sfoix (at) iri.upc.edu
-
Giró i Nieto, Xavier
xgiro (at) iri.upc.edu
-
Grosch Obregon, Patrick John
pgrosch (at) iri.upc.edu
-
Jiménez Schlegl, Pablo
jimenez (at) iri.upc.edu
-
Moreno Noguer, Francesc
fmoreno (at) iri.upc.edu
-
Sanchez Riera, Jordi
jsanchez (at) iri.upc.edu
-
Torras Genís, Carme
torras (at) iri.upc.edu
PhD Students
-
Andriella, Antonio
aandriella (at) iri.upc.edu
-
Barbany Mayor, Oriol
obarbany (at) iri.upc.edu
-
Bueno Benito, Elena Belén
ebueno (at) iri.upc.edu
-
Caldarelli, Edoardo
ecaldarelli (at) iri.upc.edu
-
Caselles Rico, Pol
pcaselles (at) iri.upc.edu
-
Coltraro, Franco
fcoltraro (at) iri.upc.edu
-
Corona Puyané, Enric
ecorona (at) iri.upc.edu
-
Delgado Guerrero, Juan Antonio
jdelgado (at) iri.upc.edu
-
Delmas, Ginger Diana
gdelmas (at) iri.upc.edu
-
Gallart Agut, Roger
rgallart (at) iri.upc.edu
-
Garcia Camacho, Irene
igarcia (at) iri.upc.edu
-
Guo, Wen
wguo (at) iri.upc.edu
-
Hernández Ruiz, Alejandro José
ahernandez (at) iri.upc.edu
-
Izquierdo Badiola, Silvia
sizquierdo (at) iri.upc.edu
-
Lopes E Silva, Bruno Miguel
blopes (at) iri.upc.edu
-
Nocentini, Olivia
onocentini (at) iri.upc.edu
-
Olivares Alarcos, Alberto
aolivares (at) iri.upc.edu
-
Pareto Boada, Júlia
jpareto (at) iri.upc.edu
-
Peral Sánchez, Marc
mperal (at) iri.upc.edu
-
Pérez i Gonzalo, Raül
rperez (at) iri.upc.edu
-
Pérez Quintana, Marc
mperez (at) iri.upc.edu
-
Ponsa Cobas, Sergi
sponsa (at) iri.upc.edu
-
Shen, Jianxiong
jshen (at) iri.upc.edu
-
Suárez Hernández, Alejandro
asuarez (at) iri.upc.edu
-
Tzelepis, Georgios
gtzelepis (at) iri.upc.edu
-
Ugrinovic, Nicolás
nugrinovic (at) iri.upc.edu
Master Students
-
Bartoli, Ludovico
lbartoli (at) iri.upc.edu
-
Isgandarov, Elnur
eisgandarov (at) iri.upc.edu
-
Montoya de Paco, Sergio
smontoya (at) iri.upc.edu
-
Palacios Fidalgo, Leonardo
lpalacios (at) iri.upc.edu
-
Puntí Álvarez, Cristina
cpunti (at) iri.upc.edu
-
Seguí Torrandell, Marc
msegui (at) iri.upc.edu
-
Vidal Bazan, Sergi
svidal (at) iri.upc.edu
TFG Students
-
Domènech Olivé, Anna
adomenech (at) iri.upc.edu
-
Ortega Rodriguez, Carles
cortega (at) iri.upc.edu
-
Solsona Boada, Pau
psolsona (at) iri.upc.edu
Support Staff
-
Fatan Serj, Mehdi
mfatan (at) iri.upc.edu
-
Martínez Felipe, Ferran
fmartinez (at) iri.upc.edu
-
Martínez González, Judith
jmartinezg (at) iri.upc.edu
-
Martínez Sánchez, Sergi
smartinezs (at) iri.upc.edu
-
Ordoñez Apraez, Daniel Felipe
dordonez (at) iri.upc.edu
-
Salido Luis-Ravelo, Pablo
psalido (at) iri.upc.edu
-
Vaccher Gómez, Jordi
jvaccher (at) iri.upc.edu
Follow us!