Representation in AI evaluations

AS Bergman, LA Hendricks, M Rauh, B Wu… - Proceedings of the …, 2023 - dl.acm.org
representation in evaluation datasets for AI models, both due to the prevalence of poor
representation … pressing need for an understanding of representation that is aligned with the goal …

Dices dataset: Diversity in conversational ai evaluation for safety

L Aroyo, A Taylor, M Diaz, C Homan… - Advances in …, 2023 - proceedings.neurips.cc
AI Evaluation for Safety), that offers a framework for the fine-grained representation and …
opinions of safety in model training and evaluation, the primary contributions of this paper and …

A framework for the evaluation of music representation systems

G Wiggins, E Miranda, A Smaill, M Harris - Computer Music Journal, 1993 - JSTOR
… of artificial intelligence (AI), not specifically targeted at musical applications. We then consider
a representative selection of music representation … notion of representation from most of …

Understanding the representation and representativeness of age in AI data sets

JS Park, MS Bernstein, RN Brewer, E Kamar… - … /ACM Conference on AI …, 2021 - dl.acm.org
… creating inclusive AI systems that work for a diverse group of users is ensuring representation
of … A growing number of evaluations have explored AI systems’ performance disparities for …

From anecdotal evidence to quantitative evaluation methods: A systematic review on evaluating explainable ai

M Nauta, J Trienes, S Pathak, E Nguyen… - ACM Computing …, 2023 - dl.acm.org
… of quantitative XAI evaluation methods. Our systematic collection of evaluation methods
provides … The Co-12 categorization scheme and our identified evaluation methods open up …

A framework for the comparative analysis and evaluation of knowledge representation schemes

R Bingi, D Khazanchi, SB Yadav - Information processing & management, 1995 - Elsevier
… In fact, both the notions of knowfedge and representation … Since AI research methodology
involves the design of programs that exhibit intelligent behavior, researchers have often taken …

Representation engineering: A top-down approach to ai transparency

A Zou, L Phan, S Chen, J Campbell, P Guo… - arXiv preprint arXiv …, 2023 - arxiv.org
… When assessing new models obtained through Representation Reading, we prioritize a
holistic evaluation approach by combining the following methods to gauge the depth and nature …

[PDF][PDF] Evaluation Methods for Representation Learning: A Survey.

K Nozawa, I Sato - IJCAI, 2022 - ijcai.org
… of representation learning. To understand the current applications of representation learning,
we review evaluation methods of representation learning algorithms. On the basis of our …

Is there a future for AI without representation?

VC Müller - Minds and Machines, 2007 - Springer
… recent years concerning cognition and representation. At the same … AI without representation
will be useful in the evaluation of the various philosophical theories about representation

[HTML][HTML] Notions of explainability and evaluation approaches for explainable artificial intelligence

G Vilone, L Longo - Information Fusion, 2021 - Elsevier
… ) graphical integrity - the representations should highlight the … should be visible in the
representation, (iii) morphological … layer separation - the representation cannot occlude the raw …