Improving Multimodal Learning by Encouraging Balanced Modality Contributions
This research proposes a novel regularization technique that encourages multimodal models to effectively utilize information from all modalities when making decisions, mitigating the issues of modality-failure and modality dominance.