This study investigates the impact of conversation length on user satisfaction when interacting with LLM-powered chatbots. The key findings are:
For questions with high conversational potential, longer conversations led to increased user satisfaction and perceived helpfulness. As the number of conversational turns increased from 3 to 7, user satisfaction scores rose.
However, the MTurk evaluation suggests that beyond a certain point, more conversation does not necessarily lead to higher effectiveness. Helpfulness scores improved as the number of turns increased for high-conversability questions, but declined when the number of turns reached 7.
Participants had mixed reactions - some found longer conversations more engaging and nuanced, while others considered them repetitive and not useful. The ideal conversation length appears to be dynamic and context-dependent.
The study demonstrates LLMs' ability to change conversation length, but cautions that changes in text form may not necessarily imply changes in quality or content. Strategically adjusting conversation formats to user situations can offer benefits, but requires careful design.
To Another Language
from source content
arxiv.org
Önemli Bilgiler Şuradan Elde Edildi
by Shih-Hong Hu... : arxiv.org 04-29-2024
https://arxiv.org/pdf/2404.17025.pdfDaha Derin Sorular