Cohen's kappa and weighted kappa are popular statistics of degree of agreement between
two raters on a nominal scale. Lin's concordance correlation coefficient (CCC) is a measure …

As measures of interobserver agreement for both nominal and ordinal categories, Cohen's
kappa coefficients appear to be the most widely used with simple and meaningful …

Several authors have noted the dependence of kappa measures of inter‐rater agreement on
the marginal distributions of contingency tables displaying the joint ratings. This paper …

Reliability and agreement are two notions of paramount importance in medical and
behavioral sciences. They provide information about the quality of the measurements. When …

Researchers have criticized chance-corrected agreement statistics, particularly the Kappa
statistic, as being very sensitive to raters' classification probabilities (marginal probabilities) …

In Study 1 of this two-part investigation, we present a “central tendency approach” and
procedures for assessing overall interrater agreement across multiple groups. We define …

Interrater agreement on binary measurements with more than two raters is often assessed
using Fleiss' κ, which is known to be difficult to interpret. In situations where the same raters …

Agreement studies commonly occur in medical research, for example, in the review of X-rays
by radiologists, blood tests by a panel of pathologists and the evaluation of psychopathology …

Intraclass correlation (ICC) is an established tool to assess inter‐rater reliability. In a seminal
paper published in 1979, Shrout and Fleiss considered three statistical models for inter‐rater …

A comparison between six rater agreement measures obtained using three different
approaches was achieved by means of a simulation study. Rater coefficients suggested by …