Assessing binary diagnoses of bio-behavioral disorders: the clinical relevance of Cohen's Kappa

DV Cicchetti, A Klin, FR Volkmar - The Journal of Nervous and …, 2017 - journals.lww.com
Abstract Cohen's (Educ Psychol Meth. 1960; 23: 37–40) kappa statistic has been criticized
recently for providing low chance-corrected coefficients (< 0.40) despite high levels of …

Sample size for kappa

D Hadzi-Pavlovic - Acta Neuropsychiatrica, 2010 - cambridge.org
In the previous issue, we looked at Cohen's kappa (κ), a statistic that is very often used to
measure agreement between raters for both nominal and ordinal ratings. An important …

Kappa coefficient

M Franzen - Encyclopedia of Clinical Neuropsychology, 2012 - academia.edu
The kappa coefficient, sometimes known as Cohen's kappa after its originator, is a
nonparametric statistic that assesses the degree of association between categorical …

[PDF][PDF] Comparing correlated kappas by resampling: is one level of agreement significantly different from another?

DP McKenzie, AJ Mackinnon, N Péladeau… - Journal of psychiatric …, 1996 - academia.edu
Researchers comparing diagnostic systems or screening tests frequently need to compare
indices of agreement such as the kappa coeffi~ lent. While asymptotic methods exist for …

Interrater agreement statistics with skewed data: Evaluation of alternatives to Cohen's kappa.

S Xu, MF Lorber - Journal of consulting and clinical psychology, 2014 - psycnet.apa.org
Objective: In this study, we aimed to evaluate interrater agreement statistics (IRAS) for use in
research on low base rate clinical diagnoses or observed behaviors. Establishing and …

[HTML][HTML] Bayesian alternatives for common null-hypothesis significance tests in psychiatry: a non-technical guide using JASP

DS Quintana, DR Williams - BMC psychiatry, 2018 - Springer
Background Despite its popularity as an inferential framework, classical null hypothesis
significance testing (NHST) has several restrictions. Bayesian analysis can be used to …

Non-standard diagnostic assessment reliability in psychiatry: a study in a Brazilian outpatient setting using Kappa

HG Rocha Neto, JLM Lessa, LM Koiller… - European Archives of …, 2023 - Springer
Abstract The use of Structured Diagnostic Assessments (SDAs) is a solution for unreliability
in psychiatry and the gold standard for diagnosis. However, except for studies between the …

The reliability and validity of discrete and continuous measures of psychopathology: a quantitative review.

KE Markon, M Chmielewski, CJ Miller - Psychological bulletin, 2011 - psycnet.apa.org
Abstract [Correction Notice: An erratum for this article was reported in Vol 137 (6) of
Psychological Bulletin (see record 2011-24066-002). In the Samples section of Meta …

Review of doing Bayesian data analysis: a tutorial with R, JAGS, and Stan

CE Gaudet - 2017 - Taylor & Francis
Base rate information, in conjunction with sensitivity and specificity estimates are
fundamental to appraising the diagnostic accuracy of neuropsychological tests. When …

A design-independent method for measuring the reliability of psychiatric diagnosis

JS Uebersax - Journal of Psychiatric Research, 1982 - Elsevier
The several different versions of the kappa coefficient currently in use can be seen as
variants of a single basic computational method. This paper present general formulas for …