Justification for the use of Cohen's Kappa statistic in experimental studies of NLP and text mining

AS Kolesnyk, NF Khairova - Cybernetics and Systems Analysis, 2022 - Springer
Modern metrics for evaluating agreement coefficients between the experimental results and
expert opinion are compared, and the possibility of using these metrics in experimental …

Predicting wetland area and water depth of Ganges moribund deltaic parts of India

S Paul, S Pal - Remote Sensing Applications: Society and …, 2020 - Elsevier
Wetland area and depth of wetland in the moribund Ganges delta of India is simulated and
predicted up to 2037. Normalized Difference Water Index (NDWI) map from 1987 to 2017 is …

Statistical inference of Gwet's AC1 coefficient for multiple raters and binary outcomes

T Ohyama - Communications in Statistics-Theory and Methods, 2021 - Taylor & Francis
Cohen's kappa and intraclass kappa are widely used for assessing the degree of agreement
between two raters with binary outcomes. However, many authors have pointed out its …

[HTML][HTML] Homogeneity score test of AC1 statistics and estimation of common AC1 in multiple or stratified inter-rater agreement studies

C Honda, T Ohyama - BMC medical research methodology, 2020 - Springer
Background Cohen's κ coefficient is often used as an index to measure the agreement of
inter-rater determinations. However, κ varies greatly depending on the marginal distribution …

[HTML][HTML] Homogeneity Test of the First-Order Agreement Coefficient in a Stratified Design

M Xu, Z Li, K Mou, KM Shuaib - Entropy, 2023 - mdpi.com
Gwet's first-order agreement coefficient (AC 1) is widely used to assess the agreement
between raters. This paper proposes several asymptotic statistics for a homogeneity test of …

Using metacognition to promote active learning in large business management classes

MF Rodríguez, M Nussbaum, J Pertuzé… - … in Education and …, 2022 - Taylor & Francis
Using active learning methodologies with large classes in higher education is a complex
task. Lecturers often lack the tools they need to guide their students, while also taking into …

Benchmarking procedures for characterizing the extent of rater agreement: a comparative study

A Vanacore, MS Pellegrino - Quality and Reliability …, 2022 - Wiley Online Library
Decision making processes often rely on subjective evaluations provided by human raters.
In the absence of a gold standard against which check evaluation trueness, rater's …

The skill qualification system for portal hypertension in Japan

M Ohta, N Murashima, T Ohyama, T Yoshida… - DEN …, 2022 - Wiley Online Library
Objectives The diverse treatments available for portal hypertension require specialized
knowledge of hemodynamics and include endoscopic treatments, interventional radiology …

Development of a Flipped Classroom Model for Initial Teacher Training

CB Millacura - 2021 - search.proquest.com
Current educational practices in university teaching mostly falls under paradigms
centeredon the role of the teacher, who transmits the contents in an expository lecture and …

Desarrollo del Pensamiento Crítico en Large Classes de Educación Superior

MFR Palma - 2021 - search.proquest.com
El desarrollo de habilidades superiores, como el pensamiento crítico, en el contexto de la
educación superior es necesario para que los estudiantes se puedan desenvolver de …