Fairness in deep learning: A survey on vision and language research
Despite being responsible for state-of-the-art results in several computer vision and natural
language processing tasks, neural networks have faced harsh criticism due to some of their …
language processing tasks, neural networks have faced harsh criticism due to some of their …
Weak-to-strong generalization: Eliciting strong capabilities with weak supervision
Widely used alignment techniques, such as reinforcement learning from human feedback
(RLHF), rely on the ability of humans to supervise model behavior-for example, to evaluate …
(RLHF), rely on the ability of humans to supervise model behavior-for example, to evaluate …
Flexivit: One model for all patch sizes
Vision Transformers convert images to sequences by slicing them into patches. The size of
these patches controls a speed/accuracy tradeoff, with smaller patches leading to higher …
these patches controls a speed/accuracy tradeoff, with smaller patches leading to higher …
A survey on model compression for large language models
Large Language Models (LLMs) have revolutionized natural language processing tasks with
remarkable success. However, their formidable size and computational demands present …
remarkable success. However, their formidable size and computational demands present …
Fedrolex: Model-heterogeneous federated learning with rolling sub-model extraction
Most cross-device federated learning (FL) studies focus on the model-homogeneous setting
where the global server model and local client models are identical. However, such …
where the global server model and local client models are identical. However, such …
Efficient methods for natural language processing: A survey
Recent work in natural language processing (NLP) has yielded appealing results from
scaling model parameters and training data; however, using only scale to improve …
scaling model parameters and training data; however, using only scale to improve …
Learning generalizable models for vehicle routing problems via knowledge distillation
Recent neural methods for vehicle routing problems always train and test the deep models
on the same instance distribution (ie, uniform). To tackle the consequent cross-distribution …
on the same instance distribution (ie, uniform). To tackle the consequent cross-distribution …
A survey on green deep learning
In recent years, larger and deeper models are springing up and continuously pushing state-
of-the-art (SOTA) results across various fields like natural language processing (NLP) and …
of-the-art (SOTA) results across various fields like natural language processing (NLP) and …
Generalizable heterogeneous federated cross-correlation and instance similarity learning
Federated learning is an important privacy-preserving multi-party learning paradigm,
involving collaborative learning with others and local updating on private data. Model …
involving collaborative learning with others and local updating on private data. Model …
Hoiclip: Efficient knowledge transfer for hoi detection with vision-language models
Abstract Human-Object Interaction (HOI) detection aims to localize human-object pairs and
recognize their interactions. Recently, Contrastive Language-Image Pre-training (CLIP) has …
recognize their interactions. Recently, Contrastive Language-Image Pre-training (CLIP) has …