Automated pyramid summarization evaluation

Y Gao, C Sun, RJ Passonneau - Proceedings of the 23rd Conference on …, 2019 - par.nsf.gov
Pyramid evaluation was developed to assess the content of paragraph length summaries of
source texts. A pyramid lists the distinct units of content found in several reference …

Learner experience in artificial intelligence-scaffolded argumentation

MK Kim, NJ Kim, A Heidari - Assessment & Evaluation in Higher …, 2022 - Taylor & Francis
Writing academic arguments is a complex and demanding task, even for proficient tertiary
students. At the same time, providing prompt support for individual students working on …

Analytical techniques for developing argumentative writing in STEM: A pilot study

PM Davies, RJ Passonneau… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Contribution: Demonstrates how to use experiential learning (EL) to improve argumentative
writing. Presents the design and development of a natural language processing (NLP) …

Assessing the content quality of essays in content and language integrated learning: Exploring the construct from subject specialists' perspectives

T Sato - Language Testing, 2024 - journals.sagepub.com
Assessing the content of learners' compositions is a common practice in second language
(L2) writing assessment. However, the construct definition of content in L2 writing …

A comparison between ai and human evaluation with a focus on generative ai

J Kim, TH Lee, Y Bae, MK Kim - Proceedings of the 18th …, 2024 - repository.isls.org
This study aims to explore the utility of generative AI in providing formative assessment and
feedback. Using data from 43 learners in an instructional technology class, we assessed …

[PDF][PDF] A Test of Learning Progress Models Using an AI-Enabled Knowledge Representation System

MK Kim, NJ Kim, G Haddadian… - Proceedings of the 17th …, 2023 - academia.edu
This study tested two competing learning progress models-the three-stage and twostage
models-based on an AI-enabled formative assessment tool. Additionally, human-rated …

Analytical Techniques for Developing Argumentative Writing in STEM

P Davies, Y Gao, S Muresan, R Passonneau - Authorea Preprints, 2023 - techrxiv.org
This article demonstrates how experiential learning could be used to develop argumentative
essay writing skills in STEM students. Written feedback, when delivered in a timely manner …

Automated assessment of quality and coverage of ideas in students' source-based writing

Y Gao, RJ Passonneau - … Conference on Artificial Intelligence in Education, 2021 - Springer
Source-based writing is an important academic skill in higher education, as it helps
instructors evaluate students' understanding of subject matter. To assess the potential for …

AI and Ambitious Learning Practices

CE Hmelo-Silver, S Puntambekar, K Glazewski… - 2022 - digitalcommons.usu.edu
This symposium will provide opportunities for discussion about how Artificial Intelligence can
support ambitious learning practices in CSCL. To the extent that CSCL can be a lever for …

[PDF][PDF] An Investigation of Knowledge-Based AI vs. Human Evaluation in the Context of Academic Summary Evaluation: Similarities, Dissimilarities, and Being Toward …

J Kim, G Haddadian, MK Kim - … Sciences-ICLS 2023, pp. 994-997, 2023 - repository.isls.org
This study aims to explore the similarities and dissimilarities of knowledge-based AI
evaluations vs. human evaluations and discuss how they can be utilized for formative …