Reliability and inter-rater reliability in qualitative research: Norms and guidelines for CSCW and HCI practice

N McDonald, S Schoenebeck, A Forte - … of the ACM on human-computer …, 2019 - dl.acm.org
What does reliability mean for building a grounded theory? What about when writing an auto-
ethnography? When is it appropriate to use measures like inter-rater reliability (IRR) …

Inter-rater reliability methods in qualitative case study research

R Cole - Sociological Methods & Research, 2023 - journals.sagepub.com
The use of inter-rater reliability (IRR) methods may provide an opportunity to improve the
transparency and consistency of qualitative case study data analysis in terms of the rigor of …

Validity and reliability in qualitative research

HIL Brink - Curationis, 1993 - curationis.org.za
Validity and reliability are key aspects of all research. Meticulous attention to these two
aspects can make the difference between good research and poor research and can help to …

Intercoder reliability in qualitative research: debates and practical guidelines

C O'Connor, H Joffe - International journal of qualitative …, 2020 - journals.sagepub.com
Evaluating the intercoder reliability (ICR) of a coding frame is frequently recommended as
good practice in qualitative analysis. ICR is a somewhat controversial topic in the qualitative …

Interrater reliability in systematic review methodology: exploring variation in coder decision-making

J Belur, L Tompson, A Thornton… - Sociological methods & …, 2021 - journals.sagepub.com
A methodologically sound systematic review is characterized by transparency, replicability,
and a clear inclusion criterion. However, little attention has been paid to reporting the details …

Achieving rigor in literature reviews: Insights from qualitative data analysis and tool-support

W Bandara, E Furtmueller, E Gorbacheva… - … of the Association for …, 2015 - aisel.aisnet.org
It is important for researchers to efficiently conduct quality literature studies. Hence, a
structured and efficient approach is essential. We overview work that has demonstrated the …

Examining design and inter-rater reliability of a rubric measuring research quality across multiple disciplines

MJ Bresciani, M Oakleaf, F Kolkhorst… - Practical …, 2019 - scholarworks.umass.edu
The paper presents a rubric to help evaluate the quality of research projects. The rubric was
applied in a competition across a variety of disciplines during a two-day research …

The current state of methods for establishing reliability in qualitative chemistry education research articles

FM Watts, SA Finkenstaedt-Quinn - Chemistry Education Research …, 2021 - pubs.rsc.org
The tradition of qualitative research drives much of chemistry education research activity.
When performing qualitative studies, researchers must demonstrate the trustworthiness of …

[HTML][HTML] A meta-review demonstrates improved reporting quality of qualitative reviews following the publication of COREQ-and ENTREQ-checklists, regardless of …

Y De Jong, EM Van Der Willik, J Milders… - BMC medical research …, 2021 - Springer
Background Reviews of qualitative studies allow for deeper understanding of concepts and
findings beyond the single qualitative studies. Concerns on study reporting quality led to the …

Evaluation beyond usability: Validating sustainable HCI research

C Remy, O Bates, A Dix, V Thomas, M Hazas… - Proceedings of the …, 2018 - dl.acm.org
The evaluation of research artefacts is an important step to validate research contributions.
Sub-disciplines of HCI often pursue primary goals other than usability, such as Sustainable …