Soft-Prompting with Aggregation-Graph-of-Thought for Enhancing Multi-modal Representation Learning

The proposed Aggregation-Graph-of-Thought (AGoT) mechanism models the human thought process as a chain of reasoning aggregation graphs to capture multiple aspects of thinking, outperforming existing chain-of-thought and prompt learning methods in multi-modal tasks.