Publication

PlanCollabNL: leveraging Large Language Models for adaptive plan generation in human-robot collaboration

Conference Article

Conference

IEEE International Conference on Robotics and Automation (ICRA)

Edition

2024

Pages

17344-17350

Doc link

https://doi.org/10.1109/ICRA57147.2024.10610055

File

Download the digital copy of the doc pdf document

Abstract

“Hey, robot. Let’s tidy up the kitchen. By the way, I have back pain today”. How can a robotic system devise a shared plan with an appropriate task allocation from this abstract goal and agent condition? Classical AI task planning has been explored for this purpose, but it involves a tedious definition of an inflexible planning problem. Large Language Models (LLMs) have shown promising generalisation capabilities in robotics decision-making through knowledge extraction from Natural Language (NL). However, the translation of NL information into constrained robotics domains remains a challenge. In this paper, we use LLMs as translators between NL information and a structured AI task planning problem, targeting human-robot collaborative plans. The LLM generates information that is encoded in the planning problem, including specific subgoals derived from an NL abstract goal, as well as recommendations for subgoal allocation based on NL agent conditions. The framework, PlanCollabNL, is evaluated for a number of goals and agent conditions, and the results show that correct and executable plans are found in most cases. With this framework, we intend to add flexibility and generalisation to HRC plan generation, eliminating the need for a manual and laborious definition of restricted planning problems and agent models.

Categories

artificial intelligence, cooperative systems, knowledge engineering, planning (artificial intelligence).

Scientific reference

S. Izquierdo, G. Canal, C. Rizzo and G. Alenyà. PlanCollabNL: leveraging Large Language Models for adaptive plan generation in human-robot collaboration, 2024 IEEE International Conference on Robotics and Automation, 2024, Yokohama (Japan), pp. 17344-17350.