Problematic machine behavior: A systematic literature review of algorithm audits

J Bandy - Proceedings of the acm on human-computer …, 2021 - dl.acm.org
While algorithm audits are growing rapidly in commonality and public importance, relatively
little scholarly work has gone toward synthesizing prior work and strategizing future research …

Understanding Practices, Challenges, and Opportunities for User-Engaged Algorithm Auditing in Industry Practice

WH Deng, B Guo, A Devrio, H Shen, M Eslami… - Proceedings of the …, 2023 - dl.acm.org
Recent years have seen growing interest among both researchers and practitioners in user-
engaged approaches to algorithm auditing, which directly engage users in detecting …

A survey on ChatGPT: AI-generated contents, challenges, and solutions

Y Wang, Y Pan, M Yan, Z Su… - IEEE Open Journal of the …, 2023 - ieeexplore.ieee.org
With the widespread use of large artificial intelligence (AI) models such as ChatGPT, AI-
generated content (AIGC) has garnered increasing attention and is leading a paradigm shift …

Auditing algorithms: Understanding algorithmic systems from the outside in

D Metaxa, JS Park, RE Robertson… - … and Trends® in …, 2021 - nowpublishers.com
Algorithms are ubiquitous and critical sources of information online, increasingly acting as
gatekeepers for users accessing or sharing information about virtually any topic, including …

Exploring how machine learning practitioners (try to) use fairness toolkits

WH Deng, M Nagireddy, MSA Lee, J Singh… - Proceedings of the …, 2022 - dl.acm.org
Recent years have seen the development of many open-source ML fairness toolkits aimed
at helping ML practitioners assess and address unfairness in their systems. However, there …

Building and auditing fair algorithms: A case study in candidate screening

C Wilson, A Ghosh, S Jiang, A Mislove… - Proceedings of the …, 2021 - dl.acm.org
Academics, activists, and regulators are increasingly urging companies to develop and
deploy sociotechnical systems that are fair and unbiased. Achieving this goal, however, is …

Everyday algorithm auditing: Understanding the power of everyday users in surfacing harmful algorithmic behaviors

H Shen, A DeVos, M Eslami, K Holstein - Proceedings of the ACM on …, 2021 - dl.acm.org
A growing body of literature has proposed formal approaches to audit algorithmic systems
for biased and harmful behaviors. While formal auditing approaches have been greatly …

Auditing for discrimination in algorithms delivering job ads

B Imana, A Korolova, J Heidemann - Proceedings of the web conference …, 2021 - dl.acm.org
Ad platforms such as Facebook, Google and LinkedIn promise value for advertisers through
their targeted advertising. However, multiple studies have shown that ad delivery on such …

Toward User-Driven Algorithm Auditing: Investigating users' strategies for uncovering harmful algorithmic behavior

A DeVos, A Dhabalia, H Shen, K Holstein… - Proceedings of the 2022 …, 2022 - dl.acm.org
Recent work in HCI suggests that users can be powerful in surfacing harmful algorithmic
behaviors that formal auditing approaches fail to detect. However, it is not well understood …

Reframing data ethics in research methods education: a pathway to critical data literacy

J Atenas, L Havemann, C Timmermann - International Journal of …, 2023 - Springer
This paper presents an ethical framework designed to support the development of critical
data literacy for research methods courses and data training programmes in higher …