RoboMP2: A Robotic Multimodal Perception-Planning Framework Leveraging Multimodal Large Language Models

RoboMP2 introduces a Goal-Conditioned Multimodal Perceptor (GCMP) and a Retrieval-Augmented Multimodal Planner (RAMP) to enhance the perception and planning capabilities of embodied agents by leveraging multimodal large language models.