Scaling vision transformers to 22 billion parameters
The scaling of Transformers has driven breakthrough capabilities for language models. At
present, the largest large language models (LLMs) contain upwards of 100B parameters …
present, the largest large language models (LLMs) contain upwards of 100B parameters …
Pali-x: On scaling up a multilingual vision and language model
We present the training recipe and results of scaling up PaLI-X, a multilingual vision and
language model, both in terms of size of the components and the breadth of its training task …
language model, both in terms of size of the components and the breadth of its training task …
The hitchhiker's guide to bias and fairness in facial affective signal processing: Overview and techniques
Given the increasing prevalence of facial analysis technology, the problem of bias in the
tools is now becoming an even greater source of concern. Several studies have highlighted …
tools is now becoming an even greater source of concern. Several studies have highlighted …
On Scaling Up a Multilingual Vision and Language Model
X Chen, J Djolonga, P Padlewski… - Proceedings of the …, 2024 - openaccess.thecvf.com
We explore the boundaries of scaling up a multilingual vision and language model both in
terms of size of the components and the breadth of its training task mixture. Our model …
terms of size of the components and the breadth of its training task mixture. Our model …
Anatomizing bias in facial analysis
Existing facial analysis systems have been shown to yield biased results against certain
demographic subgroups. Due to its impact on society, it has become imperative to ensure …
demographic subgroups. Due to its impact on society, it has become imperative to ensure …
Female, white, 27? bias evaluation on data and algorithms for affect recognition in faces
Nowadays, Artificial Intelligence (AI) algorithms show a strong performance for many use
cases, making them desirable for real-world scenarios where the algorithms provide high …
cases, making them desirable for real-world scenarios where the algorithms provide high …
A reduction to binary approach for debiasing multiclass datasets
IM Alabdulmohsin, J Schrouff… - Advances in Neural …, 2022 - proceedings.neurips.cc
We propose a novel reduction-to-binary (R2B) approach that enforces demographic parity
for multiclass classification with non-binary sensitive attributes via a reduction to a sequence …
for multiclass classification with non-binary sensitive attributes via a reduction to a sequence …
CLIP the Bias: How Useful is Balancing Data in Multimodal Learning?
We study the effectiveness of data-balancing for mitigating biases in contrastive language-
image pretraining (CLIP), identifying areas of strength and limitation. First, we reaffirm prior …
image pretraining (CLIP), identifying areas of strength and limitation. First, we reaffirm prior …
Metrics for Dataset Demographic Bias: A Case Study on Facial Expression Recognition
I Dominguez-Catena, D Paternain… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Demographic biases in source datasets have been shown as one of the causes of
unfairness and discrimination in the predictions of Machine Learning models. One of the …
unfairness and discrimination in the predictions of Machine Learning models. One of the …
Gender stereotyping impact in facial expression recognition
Abstract Facial Expression Recognition (FER) uses images of faces to identify the emotional
state of users, allowing for a closer interaction between humans and autonomous systems …
state of users, allowing for a closer interaction between humans and autonomous systems …