Core Concepts
Language models can potentially serve as tools to support and enhance critical thinking in philosophy, but current models lack key capabilities that make them ineffective for this purpose.
Abstract
The article explores the potential for language models (LMs) to serve as critical thinking tools, particularly in the context of philosophy. It begins by highlighting how LMs have been used to accelerate and automate various cognitive tasks, but questions whether they can truly support deeper, more reflective forms of thinking that are central to philosophy.
The authors use philosophy as a case study, interviewing 21 professional philosophers to understand their thinking processes and views on current LMs. They find that philosophers do not find LMs to be useful critical thinking tools for two main reasons:
LMs are too neutral, detached, and nonjudgmental, often commenting on ideas in abstract and decontextualized ways. Philosophers value tools that provide substantive and well-defended perspectives, which current LMs lack.
LMs are too servile, passive, and incurious, restricting the variety of intellectual interactions possible. Philosophers find value in developing their own lines of inquiry in conversation and through texts, which current LMs fail to support.
The authors propose the "selfhood-initiative" model to characterize the key attributes that make a tool useful for critical thinking. This model explains why philosophers find conversations with other philosophers and reading philosophical texts more helpful than current LMs.
Using this model, the authors then describe three potential roles LMs could play as critical thinking tools: the Interlocutor (high selfhood, high initiative), the Monitor (low selfhood, high initiative), and the Respondent (high selfhood, low initiative). These roles could help address the limitations of current LMs and better support the kind of reflective, questioning, and conceptually challenging work that is central to philosophy.
The article also discusses how exploring the use of LMs as critical thinking tools raises interesting metaphilosophical questions and could potentially help address certain biases and limitations within the philosophical discipline. Finally, it outlines key technical and interaction design challenges that would need to be addressed to develop LMs as effective critical thinking tools.
Quotes
"But I like the inconveniences." — "We don't," responds the Controller. "We prefer to do things comfortably." — "But I don't want comfort," John gasps. "I want God, I want poetry, I want real danger, I want freedom, I want goodness. I want sin."
"It [conversations with LMs] ends up being unproductive and unsatisfying... they don't feel like persons because their language is often so bland and impersonal, non-Socratic, generic... they're boring"
"It's a question-answer platform. It won't follow up with a "what do you think?" "I'm a little puzzled, how it could be?" "Oh gosh, how does it work?" You can't have a conversation with [an LM] except one which is like an interview."