Understanding the Impact of Chain-of-Thought Reasoning on Multimodal LLMs' Robustness Against Adversarial Attacks

Multimodal LLMs with Chain-of-Thought reasoning show marginal improvement in robustness against adversarial attacks, but a novel stop-reasoning attack effectively bypasses this enhancement.