InfiAgent-DABench is introduced as a benchmark for evaluating LLM-based agents on data analysis tasks. The paper outlines the challenges faced by LLMs in data analysis and the development of a specialized agent, DAAgent, surpassing GPT-3.5. The dataset DAEval consists of 257 questions from 52 CSV files, focusing on end-to-end task solving abilities. The process involves dataset construction, agent framework development, human assessment, and model evaluation. Key findings include the challenges for LLMs in data analysis tasks and the performance comparison of various models.
إلى لغة أخرى
من محتوى المصدر
arxiv.org
الرؤى الأساسية المستخلصة من
by Xueyu Hu,Ziy... في arxiv.org 03-12-2024
https://arxiv.org/pdf/2401.05507.pdfاستفسارات أعمق