[PDF][PDF] Ai transparency in the age of llms: A human-centered research roadmap

QV Liao, JW Vaughan - arXiv preprint arXiv:2306.01941, 2023 - assets.pubpub.org
The rise of powerful large language models (LLMs) brings about tremendous opportunities
for innovation but also looming risks for individuals and society at large. We have reached a …

A survey on large language models: Applications, challenges, limitations, and practical usage

MU Hadi, R Qureshi, A Shah, M Irfan, A Zafar… - Authorea …, 2023 - techrxiv.org
Within the vast expanse of computerized language processing, a revolutionary entity known
as Large Language Models (LLMs) has emerged, wielding immense power in its capacity to …

Supporting human-ai collaboration in auditing llms with llms

C Rastogi, M Tulio Ribeiro, N King, H Nori… - Proceedings of the 2023 …, 2023 - dl.acm.org
Large language models (LLMs) are increasingly becoming all-powerful and pervasive via
deployment in sociotechnical systems. Yet these language models, be it for classification or …

Large language models: a comprehensive survey of its applications, challenges, limitations, and future prospects

MU Hadi, R Qureshi, A Shah, M Irfan, A Zafar… - Authorea …, 2023 - techrxiv.org
Within the vast expanse of computerized language processing, a revolutionary entity known
as Large Language Models (LLMs) has emerged, wielding immense power in its capacity to …

Ai chains: Transparent and controllable human-ai interaction by chaining large language model prompts

T Wu, M Terry, CJ Cai - Proceedings of the 2022 CHI conference on …, 2022 - dl.acm.org
Although large language models (LLMs) have demonstrated impressive potential on simple
tasks, their breadth of scope, lack of transparency, and insufficient controllability can make …

Relying on the Unreliable: The Impact of Language Models' Reluctance to Express Uncertainty

K Zhou, JD Hwang, X Ren, M Sap - arXiv preprint arXiv:2401.06730, 2024 - arxiv.org
As natural language becomes the default interface for human-AI interaction, there is a critical
need for LMs to appropriately communicate uncertainties in downstream applications. In this …

Inadequacies of large language model benchmarks in the era of generative artificial intelligence

TR McIntosh, T Susnjak, T Liu, P Watters… - arXiv preprint arXiv …, 2024 - arxiv.org
The rapid rise in popularity of Large Language Models (LLMs) with emerging capabilities
has spurred public curiosity to evaluate and compare different LLMs, leading many …

Citation: A key to building responsible and accountable large language models

J Huang, KCC Chang - arXiv preprint arXiv:2307.02185, 2023 - arxiv.org
Large Language Models (LLMs) bring transformative benefits alongside unique challenges,
including intellectual property (IP) and ethical concerns. This position paper explores a …

" I'm Not Sure, But...": Examining the Impact of Large Language Models' Uncertainty Expression on User Reliance and Trust

SSY Kim, QV Liao, M Vorvoreanu, S Ballard… - The 2024 ACM …, 2024 - dl.acm.org
Widely deployed large language models (LLMs) can produce convincing yet incorrect
outputs, potentially misleading users who may rely on them as if they were correct. To …

Evaluating human-language model interaction

M Lee, M Srivastava, A Hardy, J Thickstun… - arXiv preprint arXiv …, 2022 - arxiv.org
Many real-world applications of language models (LMs), such as writing assistance and
code autocomplete, involve human-LM interaction. However, most benchmarks are non …