The study explores the impact of task-switches on LLM performance in conversational contexts. It introduces the concept of task-switch and evaluates the sensitivity of LLMs to different tasks. The experiments reveal that task-switches can lead to significant performance degradation in popular LLMs. The study emphasizes the importance of understanding and addressing vulnerabilities in LLMs caused by task-switches.
A otro idioma
del contenido fuente
arxiv.org
Ideas clave extraídas de
by Akash Gupta,... a las arxiv.org 02-29-2024
https://arxiv.org/pdf/2402.18216.pdfConsultas más profundas