The kappa statistic is commonly used for quantifying inter-rater agreement on a nominal
scale. In this review article we discuss five interpretations of this popular coefficient. Kappa is …

Cohen's Kappa is a measure of the over-all agreement between two raters classifying items
into a given set of categories. This communication describes a simple computational method …

In mental health and psychosocial studies it is often necessary to report on the between-
rater agreement of measures used in the study. This paper discusses the concept of …

Reliability and agreement studies are of paramount importance. They do contribute to the
quality of studies by providing information about the amount of error inherent to any …

Whenever two or more raters evaluate a patient or student, it may be necessary to determine
the degree to which they assign the same label or rating to the subject. The major problem in …

The Cohen (1960) kappa interrater agreement coefficient has been criticized for penalizing
raters (eg, diagnosticians) for their a priori agreement about the base rates of categories (eg …

It frequently occurs in psychological research that an investigator is interested in assessing
the ex tent of interrater agreement when the data are measured on an ordinal scale. This …

In 1960, Cohen introduced the kappa coefficient to measure chance‐corrected nominal
scale agreement between two raters. Since then, numerous extensions and generalizations …

Kappa coefficient is a statistic which measures inter-rater agreement for categorical items. It
is generally thought to be a more robust measure than simple percent agreement …

Evaluating the extent of agreement between 2 or between several raters is common in
social, behavioral and medical sciences. The objective of this paper is to provide a detailed …