Evaluating the Effectiveness of Chain-of-Thought Prompting: Insights from a Quantitative Meta-Analysis and Experiments Across Models and Datasets

Chain-of-thought prompting primarily helps on tasks involving mathematical, logical, or algorithmic reasoning, with limited benefits on other types of reasoning tasks.