Evaluating the Impact of Automation on Learning Outcomes: A Comparative Study of LLM Chatbots, Search Engines, and Textbooks

While LLM-based chatbots can support comprehensive understanding of key concepts, they are less effective than textbooks in promoting long-term knowledge retention. Academic performance impacts both learning outcomes and search patterns, with higher-competence learners engaging more deeply with content through reading-intensive behaviors.