핵심 개념
Engaging prospective physics teachers in a criterion-based evaluation of ChatGPT-generated content shifts their perceptions of the tool's answer quality and helpfulness, highlighting the need for critical thinking and media literacy development in teacher training.
초록
The study explored how prospective physics teachers evaluated the quality of ChatGPT-generated content for didactical tasks using predefined criteria such as clarity, correctness, appropriateness, and precision.
Key findings:
- Students effectively applied their pedagogical knowledge to identify ChatGPT's deficiencies in using operational verbs for learning goals, but struggled to apply their knowledge of context-oriented teaching.
- Applying the evaluation criteria helped students critically reflect on ChatGPT's answers, identifying issues with clarity, correctness, appropriateness, and precision.
- Engaging in the criterion-based evaluation shifted students' perceptions of ChatGPT's answer quality and helpfulness, with a slight decrease observed.
- Some students exhibited confirmation bias, where their positive prior experiences with ChatGPT influenced their evaluations, despite recognizing the tool's limitations.
- Students had a varied understanding of ChatGPT's functionality, often comparing it to a database or search engine, highlighting the need to address the technological aspect of media literacy.
- The study suggests integrating the criterion-based evaluation approach into teacher training programs to promote critical thinking and media literacy when using AI tools like ChatGPT.
통계
"ChatGPT quickly provides a clear answer; in literature sources, the essential answers to the questions are more hidden and embedded in a context."
"The quality always depends on the question. The more complex the question, the worse the answer."
"On the subject of clarity, I think the wording is clear, it's just superficial, but you understand what the AI means."
인용구
"I wouldn't use it. So if it really stays with the quality as I've experienced it now, nope. Because I'd have to sit down there again to do more work ..."
"I found it important to discuss advantages and disadvantages of using ChatGPT with students. Because students will use it. And I definitely see it as my responsibility as a teacher that I have to address this ...."