
Utilizing relational databases and the ER model, ERBench provides a comprehensive evaluation of LLMs by generating complex and automatically verifiable questions.


coremsg

erbench-an-entity-relationship-based-automatically-verifiable-hallucination-benchmark-for-large-language-models


ERBench: An Entity-Relationship Based Automatically Verifiable Hallucination Benchmark for Large Language Models


title_rewrite


Large language models benefit from multi-turn interactions with tools and natural language feedback, as shown by the MINT evaluation benchmark.


mint-evaluating-llms-in-multi-turn-interaction-with-tools-and-language-feedback-at-iclr-2024


MINT: Evaluating LLMs in Multi-Turn Interaction with Tools and Language Feedback at ICLR 2024



Large Language Models (LLMs) performance in Multi-hop Question Answering tasks is evaluated through a new benchmark, MRKE, highlighting the need for trustworthy evaluation of reasoning abilities.


mrke-multi-hop-reasoning-evaluation-of-llms-by-knowledge-edition


MRKE: Multi-hop Reasoning Evaluation of LLMs by Knowledge Edition
