Evaluating the Capabilities and Limitations of ChatGPT: A Comprehensive Survey
ChatGPT, a large language model developed by OpenAI, has significantly impacted the AI and NLP community. However, its performance and capabilities are not fully understood, as it is a closed-source system. This survey examines recent studies that uncover the real performance levels of ChatGPT across various NLP tasks, reviews its social implications and safety issues, and highlights key challenges and opportunities for its evaluation.