Pi (π) and kappa (κ) statistics are widely used in the areas of psychiatry and psychological
testing to compute the extent of agreement between raters on nominally scaled data. It is a …

When studying the degree of overall agreement between the nominal responses of two
raters, it is customary to use the coefficient kappa. A more detailed analysis requires the …

MOMENTS OF THE STATISTICS KAPPA AND WEIGHTED KAPPA Page 1 Vol. Part 1 97-103
The British Journal of Mathematical and Statistical Psychology May 1968 MOMENTS OF THE …

Many indices of interrater agreement on binary tasks have been proposed to assess
reliability, but none has escaped criticism. In a series of Monte Carlo simulations, five such …

Current methods of assessing nominal scale response agreement between two raters allow
each rater to make only a single response per object. When raters are uncertain in their …

Abstract Objectives: Fleiss' Kappa (FK) has been commonly, but incorrectly, employed as the
“standard” for evaluating chance-removed inter-rater agreement with ordinal data. This …

Evaluating the extent of agreement between 2 or between several raters is common in
social, behavioral and medical sciences. The objective of this paper is to provide a detailed …

Cohen's kappa statistic is frequently used to measure agreement between two observers
employing categorical polytomies. In this paper, Cohen's statistic is shown to be inherently …

Agreement among raters is of great importance in many domains. For example, in medicine,
diagnoses are often provided by more than one doctor to make sure the proposed treatment …

The Holley‐Guilford G index for 2× 2 contingency tables has spatial properties which
suggest that, as with other such indices, problems may arise in factor analysis of G matrices …