Scaling vision transformers to 22 billion parameters

M Dehghani, J Djolonga, B Mustafa… - International …, 2023 - proceedings.mlr.press
The scaling of Transformers has driven breakthrough capabilities for language models. At
present, the largest large language models (LLMs) contain upwards of 100B parameters …

Pali-x: On scaling up a multilingual vision and language model

X Chen, J Djolonga, P Padlewski, B Mustafa… - arXiv preprint arXiv …, 2023 - arxiv.org
We present the training recipe and results of scaling up PaLI-X, a multilingual vision and
language model, both in terms of size of the components and the breadth of its training task …

The hitchhiker's guide to bias and fairness in facial affective signal processing: Overview and techniques

J Cheong, S Kalkan, H Gunes - IEEE Signal Processing …, 2021 - ieeexplore.ieee.org
Given the increasing prevalence of facial analysis technology, the problem of bias in the
tools is now becoming an even greater source of concern. Several studies have highlighted …

On Scaling Up a Multilingual Vision and Language Model

X Chen, J Djolonga, P Padlewski… - Proceedings of the …, 2024 - openaccess.thecvf.com
We explore the boundaries of scaling up a multilingual vision and language model both in
terms of size of the components and the breadth of its training task mixture. Our model …

Anatomizing bias in facial analysis

R Singh, P Majumdar, S Mittal, M Vatsa - Proceedings of the AAAI …, 2022 - ojs.aaai.org
Existing facial analysis systems have been shown to yield biased results against certain
demographic subgroups. Due to its impact on society, it has become imperative to ensure …

Female, white, 27? bias evaluation on data and algorithms for affect recognition in faces

J Pahl, I Rieger, A Möller, T Wittenberg… - Proceedings of the 2022 …, 2022 - dl.acm.org
Nowadays, Artificial Intelligence (AI) algorithms show a strong performance for many use
cases, making them desirable for real-world scenarios where the algorithms provide high …

A reduction to binary approach for debiasing multiclass datasets

IM Alabdulmohsin, J Schrouff… - Advances in Neural …, 2022 - proceedings.neurips.cc
We propose a novel reduction-to-binary (R2B) approach that enforces demographic parity
for multiclass classification with non-binary sensitive attributes via a reduction to a sequence …

CLIP the Bias: How Useful is Balancing Data in Multimodal Learning?

I Alabdulmohsin, X Wang, A Steiner, P Goyal… - arXiv preprint arXiv …, 2024 - arxiv.org
We study the effectiveness of data-balancing for mitigating biases in contrastive language-
image pretraining (CLIP), identifying areas of strength and limitation. First, we reaffirm prior …

Metrics for Dataset Demographic Bias: A Case Study on Facial Expression Recognition

I Dominguez-Catena, D Paternain… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Demographic biases in source datasets have been shown as one of the causes of
unfairness and discrimination in the predictions of Machine Learning models. One of the …

Gender stereotyping impact in facial expression recognition

I Dominguez-Catena, D Paternain, M Galar - Joint European Conference …, 2022 - Springer
Abstract Facial Expression Recognition (FER) uses images of faces to identify the emotional
state of users, allowing for a closer interaction between humans and autonomous systems …