“Push-That-There”: Tabletop Multi-robot Object Manipulation via Multimodal ‘Object-level Instruction’

Keru Wang, Zhu Wang, Ken Nakagaki, Ken Perlin

The system enables users to intuitively control a multi-robot system to manipulate objects on tabletop surfaces through various modalities like gestures, GUI, tangible manipulation, and speech. The multi-robot system then autonomously anc collectively executes the instructions using a generalizable control algorithm. This approach emphasizes object-level interaction, allowing users to work at a higher level without managing individual robot movements.

Full paper access

Leave a Comment

Your email address will not be published. Required fields are marked *