An empirical comparative assessment of inter-rater agreement of binary outcomes and multiple raters

M Konstantinidis, LW Le, X Gao - Symmetry, 2022 - mdpi.com
… to evaluate how well two or more medical experts agree on a set of outcomes. The objective
… multiple raters with binary outcomes. Methods: We simulated the responses of several raters

Statistical inference of agreement coefficient between two raters with binary outcomes

T Ohyama - Communications in Statistics-Theory and Methods, 2020 - Taylor & Francis
… In this article, we restrict the discussion to the case of two raters with binary outcomes. In
Section 2, we introduce a likelihood function, and then the maximum likelihood estimator of γ …

A better confidence interval for kappa (κ) on measuring agreement between two raters with binary outcomes

JJ Lee, ZN Tu - Journal of Computational and Graphical Statistics, 1994 - Taylor & Francis
… From Equations (2.2) and (2.3) we can consider K as a measure of agreement between
two raters given the marginal probabilities of a positive rating 81 and 82. By studying the …

Statistical inference of Gwet's AC1 coefficient for multiple raters and binary outcomes

T Ohyama - Communications in Statistics-Theory and Methods, 2021 - Taylor & Francis
… the degree of agreement between two raters with binary outcomes. However, many authors
… 1 in the case of multiple raters and binary outcomes. Construction of confidence intervals is …

Sample size requirements for interval estimation of the kappa statistic for interobserver agreement studies with a binary outcome and multiple raters

A Donner, MA Rotondi - The international journal of biostatistics, 2010 - degruyter.com
two raters using a confidence interval approach were also presented by Donner (1999) for
the case of a binary outcome… studies involving two or more raters and a binary outcome from a …

Powerful exact unconditional tests for agreement between two raters with binary endpoints

G Shan, GE Wilding - PloS one, 2014 - journals.plos.org
… In this article we consider four exact testing procedures for testing agreement between two
raters with binary outcomes. The efficient unconditional C+M and E+M approaches not only …

Assessing method agreement for paired repeated binary measurements administered by multiple raters

W Wang, N Lin, JD Oberhaus… - Statistics in medicine, 2020 - Wiley Online Library
… the situation where the rater's effect is assumed random, but the two measuring methods for
… independently in order to remain blind to the outcome of the other assessment. The dataset …

Inference procedures for assessing interobserver agreement among multiple raters

M Altaye, A Dormer, N Klar - Biometrics, 2001 - Wiley Online Library
… in studies involving a binary outcome and multiple raters. The … -1519) for the case of two
raters. The new procedure is shown … the use of more than two raters to classify subjects into one …

Modeling rater diagnostic skills in binary classification processes

X Lin, H Chen, D Edwards, KP Nelson - Statistics in medicine, 2018 - Wiley Online Library
… Every radiologist interpreted all mammograms in a controlled reading environment during
two 3-… model where rater decisions are linked with patient true disease outcome through a …

Decision making using rating systems: When scale meets binary

AE Bargagliotti, L Li - Decision Sciences, 2013 - Wiley Online Library
… that reports a rater's opinion consistently with the binary system is … two types of rating
systems, the decision maker must make a decision. Typically, this decision has a binary outcome