With the urgent demand for generalized deep models, many pre-trained big models are
proposed, such as bidirectional encoder representations (BERT), vision transformer (ViT) …

Large-scale multi-modal contrastive learning frameworks like CLIP typically require a large
amount of image-text samples for training. However, these samples are always collected …

Abstract Language model pre-training and the derived general-purpose methods have
reshaped machine learning research. However, there remains considerable uncertainty …

Continual learning has emerged as a crucial paradigm for learning from sequential data
while preserving previous knowledge. In the realm of continual graph learning, where …