Human-ai collaboration via conditional delegation: A case study of content moderation
Despite impressive performance in many benchmark datasets, AI models can still make
mistakes, especially among out-of-distribution examples. It remains an open question how …
mistakes, especially among out-of-distribution examples. It remains an open question how …
Exploring how machine learning practitioners (try to) use fairness toolkits
Recent years have seen the development of many open-source ML fairness toolkits aimed
at helping ML practitioners assess and address unfairness in their systems. However, there …
at helping ML practitioners assess and address unfairness in their systems. However, there …
Demystifying mlops and presenting a recipe for the selection of open-source tools
Nowadays, machine learning projects have become more and more relevant to various real-
world use cases. The success of complex Neural Network models depends upon many …
world use cases. The success of complex Neural Network models depends upon many …
How ai developers overcome communication challenges in a multidisciplinary team: A case study
The development of AI applications is a multidisciplinary effort, involving multiple roles
collaborating with the AI developers, an umbrella term we use to include data scientists and …
collaborating with the AI developers, an umbrella term we use to include data scientists and …
Autods: Towards human-centered automation of data science
Data science (DS) projects often follow a lifecycle that consists of laborious tasks for data
scientists and domain experts (eg, data exploration, model training, etc.). Only till recently …
scientists and domain experts (eg, data exploration, model training, etc.). Only till recently …
Slide4n: Creating presentation slides from computational notebooks with human-ai collaboration
Data scientists often have to use other presentation tools (eg, Microsoft PowerPoint) to
create slides to communicate their analysis obtained using computational notebooks. Much …
create slides to communicate their analysis obtained using computational notebooks. Much …
Documentation matters: Human-centered ai system to assist data science code documentation in computational notebooks
Computational notebooks allow data scientists to express their ideas through a combination
of code and documentation. However, data scientists often pay attention only to the code …
of code and documentation. However, data scientists often pay attention only to the code …
Telling stories from computational notebooks: Ai-assisted presentation slides creation for presenting data science work
Creating presentation slides is a critical but time-consuming task for data scientists. While
researchers have proposed many AI techniques to lift data scientists' burden on data …
researchers have proposed many AI techniques to lift data scientists' burden on data …
Why is ai not a panacea for data workers? an interview study on human-ai collaboration in data storytelling
Data storytelling plays an important role in data workers' daily jobs since it boosts team
collaboration and public communication. However, to make an appealing data story, data …
collaboration and public communication. However, to make an appealing data story, data …
Do large language models perform the way people expect? measuring the human generalization function
What makes large language models (LLMs) impressive is also what makes them hard to
evaluate: their diversity of uses. To evaluate these models, we must understand the …
evaluate: their diversity of uses. To evaluate these models, we must understand the …