Lemma: Learning language-conditioned multi-robot manipulation

R Gong, X Gao, Q Gao, S Shakiah… - IEEE Robotics and …, 2023 - ieeexplore.ieee.org
Complex manipulation tasks often require robots with complementary capabilities to
collaborate. We introduce a benchmark for L anguag E-Conditioned M ulti-robot MA …

From cooking recipes to robot task trees–improving planning correctness and task efficiency by leveraging llms with a knowledge network

MS Sakib, Y Sun - 2024 IEEE International Conference on …, 2024 - ieeexplore.ieee.org
Task planning for robotic cooking involves generating a sequence of actions for a robot to
prepare a meal successfully. This paper introduces a novel task tree generation pipeline …

Consolidating Trees of Robotic Plans Generated Using Large Language Models to Improve Reliability

MS Sakib, Y Sun - arXiv preprint arXiv:2401.07868, 2024 - arxiv.org
The inherent probabilistic nature of Large Language Models (LLMs) introduces an element
of unpredictability, raising concerns about potential discrepancies in their output. This paper …

MORPHeus: a Multimodal One-armed Robot-assisted Peeling system with Human Users in-the-loop

R Ye, Y Hu, YA Bian, L Kulm… - 2024 IEEE International …, 2024 - ieeexplore.ieee.org
Meal preparation is an important instrumental activity of daily living (IADL). While existing
research has explored robotic assistance in meal preparation tasks such as cutting and …

Task parse tree: Learning task policy from videos with task-irrelevant components

W Wang, M You, H Zhou, B He - Robotics and Autonomous Systems, 2023 - Elsevier
A good task policy should explicitly interpret the preconditions of actions and the
composition structure of task. We aim to automatically learn such a task policy from videos …

A Novel Robust Imitation Learning Framework for Dual-Arm Object-Moving Tasks

W Wang, C Zeng, Z Lu, C Yang - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Drawing inspiration from the mechanism of human skill acquisition, imitation learning has
demonstrated remarkable performance. Over recent years, modelbased imitation learning …

Recognition of heat-induced food state changes by time-series use of vision-language model for cooking robot

N Kanazawa, K Kawaharazuka, Y Obinata… - International Conference …, 2023 - Springer
Cooking tasks are characterized by large changes in the state of the food, which is one of
the major challenges in robot execution of cooking tasks. In particular, cooking using a stove …

Graph-Based Framework on Bimanual Manipulation Planning from Cooking Recipe

K Takata, T Kiyokawa, N Yamanobe… - Robotics, 2022 - mdpi.com
It is difficult to effectively operate a dual-arm robot using only the information written in a
cooking recipe. To cope with this problem, this paper proposes a graph-based approach on …

Robotics and Machine Vision for Primary Food Manipulation and Packaging: A Survey

S Vasudevan, ML Mekhalfi, C Blanes, M Lecca… - IEEE …, 2024 - ieeexplore.ieee.org
Vision and Robotic technologies are progressively becoming ubiquitous for automating and
digitizing quality control in the food industry. This paper examines the crucial role of …

Real-world cooking robot system from recipes based on food state recognition using foundation models and PDDL

N Kanazawa, K Kawaharazuka, Y Obinata… - Advanced …, 2024 - Taylor & Francis
Although there is a growing demand for cooking behaviors as one of the expected tasks for
robots, a series of cooking behaviors based on new recipe descriptions by robots in the real …