Large Multimodal Models face distractibility from typographic attacks, but can be mitigated by providing more informative prompts.