Core Concepts
The author emphasizes the importance of critically evaluating social science research findings to distinguish between trustworthy and unreliable results, providing three key rules for assessing validity.
Abstract
In a world where social science research faces increasing scrutiny due to debunked experiments and unethical practices, the author delves into the challenges researchers encounter. The article highlights issues such as p-hacking, fraud, and flawed experimental designs that have plagued various disciplines. Despite these challenges, the author advocates for a cautious yet optimistic approach towards consuming research findings by offering practical guidelines for readers to discern credible studies from dubious ones. By emphasizing skepticism, critical thinking, and utility over novelty in research interpretation, the author aims to navigate through the complexities of modern academia and everyday life.
Stats
Journalists lapped up insights into how decent people given arbitrary power can become brutal.
Scholars reproduced 100 experiments finding only 36% consistent with original results.
John Ioannidis attributes study flaws in natural sciences to small experiments and poor designs.
Incentives in academia lead to cutting corners or cheating in research.
Senior researchers may fail to seek advice when receiving disconfirming feedback.
Quotes
"If it seems too good to be true, it probably is."
"Useful beats clever."
"I believe in personal progress."