The study explores the impact of task-switches on LLM performance in conversational contexts. It introduces the concept of task-switch and evaluates the sensitivity of LLMs to different tasks. The experiments reveal that task-switches can lead to significant performance degradation in popular LLMs. The study emphasizes the importance of understanding and addressing vulnerabilities in LLMs caused by task-switches.
Til et andet sprog
fra kildeindhold
arxiv.org
Vigtigste indsigter udtrukket fra
by Akash Gupta,... kl. arxiv.org 02-29-2024
https://arxiv.org/pdf/2402.18216.pdfDybere Forespørgsler