Understanding user satisfaction with intelligent assistants

J Kiseleva, K Williams, J Jiang… - Proceedings of the …, 2016 - dl.acm.org
Voice-controlled intelligent personal assistants, such as Cortana, Google Now, Siri and
Alexa, are increasingly becoming a part of users' daily lives, especially on mobile devices …

Setrank: Learning a permutation-invariant ranking model for information retrieval

L Pang, J Xu, Q Ai, Y Lan, X Cheng, J Wen - Proceedings of the 43rd …, 2020 - dl.acm.org
In learning-to-rank for information retrieval, a ranking model is automatically learned from
the data and then utilized to rank the sets of retrieved documents. Therefore, an ideal …

Predicting user satisfaction with intelligent assistants

J Kiseleva, K Williams, A Hassan Awadallah… - Proceedings of the 39th …, 2016 - dl.acm.org
There is a rapid growth in the use of voice-controlled intelligent personal assistants on
mobile devices, such as Microsoft's Cortana, Google Now, and Apple's Siri. They …

Learning groupwise multivariate scoring functions using deep neural networks

Q Ai, X Wang, S Bruch, N Golbandi… - Proceedings of the …, 2019 - dl.acm.org
While in a classification or a regression setting a label or a value is assigned to each
individual document, in a ranking setting we determine the relevance ordering of the entire …

Online evaluation for information retrieval

K Hofmann, L Li, F Radlinski - Foundations and Trends® in …, 2016 - nowpublishers.com
Online evaluation is one of the most common approaches to measure the effectiveness of an
information retrieval system. It involves fielding the information retrieval system to real users …

Measuring the utility of search engine result pages: an information foraging based measure

L Azzopardi, P Thomas, N Craswell - The 41st International ACM SIGIR …, 2018 - dl.acm.org
Web Search Engine Result Pages (SERPs) are complex responses to queries, containing
many heterogeneous result elements (web results, advertisements, and specialised" …

List-aware reranking-truncation joint model for search and retrieval-augmented generation

S Xu, L Pang, J Xu, H Shen, X Cheng - Proceedings of the ACM on Web …, 2024 - dl.acm.org
The results of information retrieval (IR) are usually presented in the form of a ranking list of
candidate documents, such as web search for humans and retrieval-augmented generation …

When does relevance mean usefulness and user satisfaction in web search?

J Mao, Y Liu, K Zhou, JY Nie, J Song, M Zhang… - Proceedings of the 39th …, 2016 - dl.acm.org
Relevance is a fundamental concept in information retrieval (IR) studies. It is however often
observed that relevance as annotated by secondary assessors may not necessarily mean …

Understanding and predicting graded search satisfaction

J Jiang, A Hassan Awadallah, X Shi… - Proceedings of the eighth …, 2015 - dl.acm.org
Understanding and estimating satisfaction with search engines is an important aspect of
evaluating retrieval performance. Research to date has modeled and predicted search …

Incorporating user expectations and behavior into the measurement of search effectiveness

A Moffat, P Bailey, F Scholer, P Thomas - ACM Transactions on …, 2017 - dl.acm.org
Information retrieval systems aim to help users satisfy information needs. We argue that the
goal of the person using the system, and the pattern of behavior that they exhibit as they …