Human-ai collaboration via conditional delegation: A case study of content moderation

V Lai, S Carton, R Bhatnagar, QV Liao… - Proceedings of the …, 2022 - dl.acm.org
Despite impressive performance in many benchmark datasets, AI models can still make
mistakes, especially among out-of-distribution examples. It remains an open question how …

Exploring how machine learning practitioners (try to) use fairness toolkits

WH Deng, M Nagireddy, MSA Lee, J Singh… - Proceedings of the …, 2022 - dl.acm.org
Recent years have seen the development of many open-source ML fairness toolkits aimed
at helping ML practitioners assess and address unfairness in their systems. However, there …

Demystifying mlops and presenting a recipe for the selection of open-source tools

P Ruf, M Madan, C Reich, D Ould-Abdeslam - Applied Sciences, 2021 - mdpi.com
Nowadays, machine learning projects have become more and more relevant to various real-
world use cases. The success of complex Neural Network models depends upon many …

How ai developers overcome communication challenges in a multidisciplinary team: A case study

D Piorkowski, S Park, AY Wang, D Wang… - Proceedings of the …, 2021 - dl.acm.org
The development of AI applications is a multidisciplinary effort, involving multiple roles
collaborating with the AI developers, an umbrella term we use to include data scientists and …

Autods: Towards human-centered automation of data science

D Wang, J Andres, JD Weisz, E Oduor… - Proceedings of the 2021 …, 2021 - dl.acm.org
Data science (DS) projects often follow a lifecycle that consists of laborious tasks for data
scientists and domain experts (eg, data exploration, model training, etc.). Only till recently …

Slide4n: Creating presentation slides from computational notebooks with human-ai collaboration

F Wang, X Liu, O Liu, A Neshati, T Ma, M Zhu… - Proceedings of the 2023 …, 2023 - dl.acm.org
Data scientists often have to use other presentation tools (eg, Microsoft PowerPoint) to
create slides to communicate their analysis obtained using computational notebooks. Much …

Documentation matters: Human-centered ai system to assist data science code documentation in computational notebooks

AY Wang, D Wang, J Drozdal, M Muller, S Park… - ACM Transactions on …, 2022 - dl.acm.org
Computational notebooks allow data scientists to express their ideas through a combination
of code and documentation. However, data scientists often pay attention only to the code …

Telling stories from computational notebooks: Ai-assisted presentation slides creation for presenting data science work

C Zheng, D Wang, AY Wang, X Ma - … of the 2022 CHI Conference on …, 2022 - dl.acm.org
Creating presentation slides is a critical but time-consuming task for data scientists. While
researchers have proposed many AI techniques to lift data scientists' burden on data …

Why is ai not a panacea for data workers? an interview study on human-ai collaboration in data storytelling

H Li, Y Wang, QV Liao, H Qu - arXiv preprint arXiv:2304.08366, 2023 - arxiv.org
Data storytelling plays an important role in data workers' daily jobs since it boosts team
collaboration and public communication. However, to make an appealing data story, data …

Do large language models perform the way people expect? measuring the human generalization function

K Vafa, A Rambachan, S Mullainathan - arXiv preprint arXiv:2406.01382, 2024 - arxiv.org
What makes large language models (LLMs) impressive is also what makes them hard to
evaluate: their diversity of uses. To evaluate these models, we must understand the …