Background Reliability of measurements is a prerequisite of medical research. For nominal
data, Fleiss' kappa (in the following labelled as Fleiss' K) and Krippendorff's alpha provide …

Measurement of the interrater agreement (IRA) is critical in various disciplines. To correct for
potential confounding chance agreement in IRA, Cohen's kappa and many other methods …

Agreement between a pair of raters for binary outcome data is typically assessed by using
the κ-coefficient. When the total sample size is small to moderate, and the proportion of …

There has been substantial statistical literature in the last several decades on assessing
agreement, and coverage probability approach was selected as a preferred index for …

Agreement studies are of paramount importance in various scientific domains. When several
observers classify objects on categorical scales, agreement can be quantified through …

Cohen's kappa coefficient, κ, is a statistical measure of inter-rater agreement or inter-
annotator agreement for qualitative items. In this paper, we focus on interval estimation of κ …

In Study 1 of this two-part investigation, we present a “central tendency approach” and
procedures for assessing overall interrater agreement across multiple groups. We define …

It is valuable in many studies to assess both intrarater and interrater agreement. Most
measures of intrarater agreement do not adjust for unequal estimates of prevalence …

Background Assessment of disagreement among multiple measurements for the same
subject by different observers remains an important problem in medicine. Several measures …

Many studies of interobserver agreement yield outcome measures on more than one binary
trait. For example, Becker et al.(Int. J. Psychiatry Med. 2002; 32 (3): 271–283) reported on a …