Pi (π) and kappa (κ) statistics are widely used in the areas of psychiatry and psychological
testing to compute the extent of agreement between raters on nominally scaled data. It is a …

In 1960, Cohen introduced the kappa coefficient to measure chance‐corrected nominal
scale agreement between two raters. Since then, numerous extensions and generalizations …

This paper gives a method for determining a sample size that will achieve a prespecified
bound on confidence interval width for the interrater agreement measure, κ. The same …

Evaluating the extent of agreement between 2 or between several raters is common in
social, behavioral and medical sciences. The objective of this paper is to provide a detailed …

Whenever two or more raters evaluate a patient or student, it may be necessary to determine
the degree to which they assign the same label or rating to the subject. The major problem in …

The Fleiss' kappa statistic is a well-known index for assessing the reliability of agreement
between raters. It is used both in the psychological and in the psychiatric field. Unfortunately …

In mental health and psychosocial studies it is often necessary to report on the between-
rater agreement of measures used in the study. This paper discusses the concept of …

The kappa statistic is commonly used for quantifying inter-rater agreement on a nominal
scale. In this review article we discuss five interpretations of this popular coefficient. Kappa is …

Reliability and agreement studies are of paramount importance. They do contribute to the
quality of studies by providing information about the amount of error inherent to any …

Most inter-rater reliability studies using nominal scales suggest the existence of two
populations of inference: the population of subjects (collection of objects or persons to be …