Many studies of interobserver agreement yield outcome measures on more than one binary
trait. For example, Becker et al.(Int. J. Psychiatry Med. 2002; 32 (3): 271–283) reported on a …

We consider inference methods for interobserver agreement studies characterized by two
raters and several outcome categories that one can naturally combine to address a series of …

We propose a new procedure for constructing inferences about a measure of interobserver
agreement in studies involving a binary outcome and multiple raters. The proposed …

I provide sample size formulae and tables for the design of studies that compare two or more
coefficients of inter‐observer agreement or concordance. Such studies may arise, for …

Scott's pi and Cohen's kappa are widely used for assessing the degree of agreement
between two raters with binary outcomes. However, many authors have pointed out its …

Agreement among at least two evaluators is an issue of prime importance to statisticians,
clinicians, epidemiologists, psychologists, and many other scientists. Measuring …

Most statistical methods for interobserver agreement studies involving categorical data focus
on dichotomous outcome variables, whereas only a limited number of methods have been …

The reliability of binary assessments is often measured by the proportion of agreement
above chance, as estimated by the kappa statistic. In this paper, we develop a model to …

The kappa coefficient measures chance-corrected agreement between two observers in the
dichotomous classification of subjects. The marginal probability of classification by each …

We consider the problem of assessing agreement between two instruments and test whether
the normally distributed bivariate data have evidence to claim satisfactory agreement. We …