What is wrong with you?: Leveraging user sentiment for automatic dialog evaluation

S Ghazarian, B Hedayatnia, A Papangelis, Y Liu… - arXiv preprint arXiv …, 2022 - arxiv.org
Accurate automatic evaluation metrics for open-domain dialogs are in high demand. Existing
model-based metrics for system response evaluation are trained on human annotated data …

[HTML][HTML] Harnessing AI and NLP Tools for Innovating Brand Name Generation and Evaluation: A Comprehensive Review

M Lemos, PJS Cardoso, JMF Rodrigues - Multimodal Technologies and …, 2024 - mdpi.com
The traditional approach of single-word brand names faces constraints due to trademarks,
prompting a shift towards fusing two or more words to craft unique and memorable brands …

Improving open-domain dialogue evaluation with a causal inference model

CP Le, L Dai, M Johnston, Y Liu, M Walker… - arXiv preprint arXiv …, 2023 - arxiv.org
Effective evaluation methods remain a significant challenge for research on open-domain
conversational dialogue systems. Explicit satisfaction ratings can be elicited from users, but …

Quietly angry, loudly happy: Self-reported customer satisfaction vs. automatically detected emotion in contact center calls

E Bolo, M Samoul, N Seichepine… - Interaction …, 2023 - jbe-platform.com
Phone calls are an essential communication channel in today's contact centers, but they are
more difficult to analyze than written or form-based interactions. To that end, companies …

A Transformer-based Response Evaluator for Open-Domain Spoken Conversation

V Harrison, R Rajasekaran, M Walker - arXiv preprint arXiv:2302.04424, 2023 - arxiv.org
Many open-domain dialogue systems rely on multiple response generators, any of which
can contribute a response to the dialogue in a particular context. Thus the ability to compare …

Customer satisfaction estimation using unsupervised representation learning with multi-format prediction loss

A Ando, Y Murata, R Masumura… - ICASSP 2022-2022 …, 2022 - ieeexplore.ieee.org
We propose a new Customer Satisfaction Estimation (CSE) method that utilizes
unsupervised representation learning. Though conventional methods have improved both …

A Visual-Based Energy Efficient Chatbot: Relationship between Sentiment Analysis and Customer Satisfaction

NM Johari, HB Zaman, H Baharin… - International Visual …, 2023 - Springer
The evolution of Chatbots today has been seen to be popular in various service sectors such
as education, business, as well as banking. The assistance provided by the system has …

User response and sentiment prediction for automatic dialogue evaluation

S Ghazarian, B Hedayatnia, A Papangelis, Y Liu… - arXiv preprint arXiv …, 2021 - arxiv.org
Automatic evaluation is beneficial for open-domain dialog system development. However,
standard word-overlap metrics (BLEU, ROUGE) do not correlate well with human …

When a voice assistant asks for feedback: An empirical study on customer experience with a/b testing and causal inference methods

Y Deng, S Murari - Companion Publication of the 2021 International …, 2021 - dl.acm.org
Intelligent Voice Assistant (IVA) systems, such as Alexa, Google Assistant and Siri, allow us
to interact with them using just the voice commands. IVA systems can seek voice feedback …

[PDF][PDF] Cross-transfer Knowledge between Speech and Text Encoders to Evaluate Customer Satisfaction

LF Parra-Gallego, T Purohit, B Vlasenko… - publications.idiap.ch
Customer Satisfaction (CS) in call centers influences customer loyalty and the company's
reputation. Traditionally, CS evaluations were conducted manually or with classical machine …