查看文章

Chemistry education research demonstrates the value of open-ended writing tasks, such as writing-to-learn (WTL) assignments, for supporting students’ learning with topics including reasoning about reaction mechanisms. The emergence of generative artificial intelligence (AI) technology, such as chatbots ChatGPT and Bard, raises concerns regarding the value of open-ended writing tasks in the classroom; one concern involves academic integrity and whether students will use these chatbots to produce sufficient responses to open-ended writing tasks. The present study investigates the degree to which generative AI chatbots exhibit mechanistic reasoning in response to organic chemistry WTL assignments. We produced responses from three generative AI chatbots (ChatGPT-3.5, ChatGPT-4, and Bard) to two WTL assignments developed to elicit students’ mechanistic reasoning. Using previously reported machine …