WS#11 Mobile Manipulation of rigid and deformable objects: Community Challenges and Opportunities

WS#11 Mobile Manipulation of rigid and deformable objects: Community Challenges and Opportunities

Marco Rosa (PAL Robotics), Ashok Meenakshi Sundaram (DLR), Florian Pokorny (KTH)Room 22-24

Questions to be answered

  • How will mobile manipulation impact real-world applications and benefit society? Providing specific examples or case studies from healthcare, agriculture, logistics, or manufacturing to illustrate the tangible impacts of MoMa technologies.
  • What are the most promising advancements or breakthroughs in mobile manipulation, and what challenges still need solutions? Highlight some of the most exciting recent developments — such as advancements in perception and dexterous manipulation of diverse object types (known/unknown, rigid/deformable), or innovative machine learning applications.
  • How can professionals and researchers from different backgrounds get involved or benefit from this field? How the exploitation of synergies across like-minded projects like the ones present in this WS can help R&I in the MoMa field?

Description

This workshop examines the evolving field of mobile manipulation (MoMa), a pivotal domain within robotics with applications spanning healthcare, agriculture, logistics, and manufacturing. Addressing the unique challenges of manipulating both rigid and deformable objects, MoMa demands advanced mobility and manipulation capabilities, which enable its critical role in diverse, strategically essential sectors across Europe.

MoMa technologies have advanced significantly, with robots increasingly able to perform complex tasks that require fine-grained manipulation and real-time adaptability. However, the field still faces limitations, especially in reliably handling diverse objects and environments, and in maintaining stability and precision across dynamic settings. Although recent advancements have shown promising improvements in machine learning, perception, and grasping technologies, achieving a high level of robustness, safety, and adaptability across varying tasks remains a central challenge. For instance, handling unknown or deformable objects in realistic settings outside laboratories is still an open problem. Also, developing and deploying transferable MoMa solutions applicable for multiple environmental settings or industries is crucial. Collaborative efforts across academia, industry, and public sectors are critical to accelerating these developments.

This workshop will present an in-depth examination of the current state of MoMa. It will focus on key technical and societal challenges, such as perception and handling of diverse objects, adapting to complex dynamics, and advancing human-robot interaction (HRI). It will do so by bringing to the table the perspectives and recent developments of MoMa centred Horizon Europe projects including PILLAR-Robots, AGIMUS, REGO, IntelliMan, CONVINCE, SestoSenso and SoftEnable, which will share strategic insights, highlighting community-driven solutions and future opportunities for advancing MoMa capabilities.

Organisation of the WS

Welcome & Introduction (5 minutes)

We'll kick things off by setting the stage for our deep dive into mobile manipulation (MoMa). This intro will outline what we mean by MoMa, its relevance across sectors like healthcare, agriculture, and logistics.

Project Spotlights: Exploring the Latest in Mobile Manipulation (30 minutes)

In this segment, we’ll explore a range of new and ongoing projects driving forward MoMa research and innovation. Several “sister projects”, including PILLAR-Robots, AGIMUS, REGO, IntelliMan, CONVINCE, SestoSenso and SoftEnable, will each share an overview of their work. You'll get a rapid look at the latest advancements and the specific problems each project is tackling in areas like rigid and deformable object handling, human-robot interaction, and adapting to dynamic environments.

Interactive Q&A, Panel, and Audience Engagement (45 minutes)

Next, we’re opening up the floor! This session is designed to be interactive and dynamic. Our panellists will start by discussing two key themes:

  • Mobile Manipulation: Expectations vs. Reality – Where are we seeing the most progress? What challenges remain?
  • Market Trends and Future Opportunities – What are the emerging needs in various sectors? How can MoMa adapt to them?

Afterward, it’s over to you! Whether you have questions for specific panellists, insights to share, or just want to know more about how these innovations might impact your field, this session is your chance to engage.

Intended outcome

Enhanced Understanding of Current Mobile Manipulation Advances and Challenges

Attendees will gain a well-rounded understanding of the latest innovations, real-world applications, and ongoing limitations in mobile manipulation. With insights from multiple projects and experts, participants will leave with a clearer picture of the field's current landscape and the technical hurdles yet to be overcome.

Identification of Collaborative Opportunities and Potential Partnerships

The interactive nature of the workshop, along with exposure to multiple Horizon Europe projects, can foster networking and collaboration among participants from different backgrounds. This can lead to future partnerships across academia, industry, and public sectors, helping drive forward specific research initiatives or pilot applications.

Strategic Insights for Aligning with Market Trends and Future Opportunities

Through discussions on market expectations and the gap between current capabilities and industry needs, attendees will gain valuable insights on where the field is headed and how to align their research or business strategies. This can help guide project directions, investment considerations, and future R&D initiatives aligned with evolving market demands.

Speakers, Panelists, etc

Project Presentations:

  • Richard Duro (PILLAR-Robots)
  • Nicolas Mansard (AGIMUS)
  • Gianluca Palli (IntelliMan)
  • Claudio Pacchierotti (REGO)
  • Lorenzo Natale (CONVINCE)
  • Florian Pokorny (SoftEnable)
  • Giorgio Cannata (SestoSenso)

Panel Discussion:

  • Francesco Ferro (PAL Robotics)
  • Enrico Mingo (INRIA / euROBIN)
  • Stephane Doncieux (Sorbonne / PILLAR-Robots)
  • Maximo Roa (DLR)
  • Radhika Gudipati (ARIA)

Moderators

  • Marco Rosa (PAL Robotics)
  • Ashok Meenakshi Sundaram (DLR)
  • Florian Pokorny (KTH)

Topic Groups and/or Innovation networks involved

-

Projects involved

Further information

-

Organisers

  • Marco Rosa (PAL Robotics), marco.rosa@pal-robotics.com
  • Ashok Meenakshi Sundaram (DLR), Ashok.MeenakshiSundaram@dlr.de
  • Florian Pokorny (KTH) fpokorny@kth.se
Wed 11:10 - 12:30
Deformable objects, Horizon Europe, Mobile manipulation, Perception, Vision