A comprehensive survey on pretrained foundation models: A history from bert to chatgpt

C Zhou, Q Li, C Li, J Yu, Y Liu, G Wang… - arXiv preprint arXiv …, 2023 - arxiv.org
Pretrained Foundation Models (PFMs) are regarded as the foundation for various
downstream tasks with different data modalities. A PFM (eg, BERT, ChatGPT, and GPT-4) is …

Trirank: Review-aware explainable recommendation by modeling aspects

X He, T Chen, MY Kan, X Chen - … of the 24th ACM international on …, 2015 - dl.acm.org
Most existing collaborative filtering techniques have focused on modeling the binary relation
of users to items by extracting from user ratings. Aside from users' ratings, their affiliated …

A survey on text classification: From traditional to deep learning

Q Li, H Peng, J Li, C Xia, R Yang, L Sun… - ACM Transactions on …, 2022 - dl.acm.org
Text classification is the most fundamental and essential task in natural language
processing. The last decade has seen a surge of research in this area due to the …

Artificial intelligence in recommender systems

Q Zhang, J Lu, Y Jin - Complex & Intelligent Systems, 2021 - Springer
Recommender systems provide personalized service support to users by learning their
previous behaviors and predicting their current preferences for particular products. Artificial …

Is attention interpretable?

S Serrano, NA Smith - arXiv preprint arXiv:1906.03731, 2019 - arxiv.org
Attention mechanisms have recently boosted performance on a range of NLP tasks.
Because attention layers explicitly weight input components' representations, it is also often …

Knowledge graph convolutional networks for recommender systems

H Wang, M Zhao, X Xie, W Li, M Guo - The world wide web conference, 2019 - dl.acm.org
To alleviate sparsity and cold start problem of collaborative filtering based recommender
systems, researchers and engineers usually collect attributes of users and items, and design …

DKN: Deep knowledge-aware network for news recommendation

H Wang, F Zhang, X Xie, M Guo - Proceedings of the 2018 world wide …, 2018 - dl.acm.org
Online news recommender systems aim to address the information explosion of news and
make personalized recommendation for users. In general, news language is highly …

Fastformer: Additive attention can be all you need

C Wu, F Wu, T Qi, Y Huang, X Xie - arXiv preprint arXiv:2108.09084, 2021 - arxiv.org
Transformer is a powerful model for text understanding. However, it is inefficient due to its
quadratic complexity to input sequence length. Although there are many methods on …

A survey on text classification: From shallow to deep learning

Q Li, H Peng, J Li, C Xia, R Yang, L Sun, PS Yu… - arXiv preprint arXiv …, 2020 - arxiv.org
Text classification is the most fundamental and essential task in natural language
processing. The last decade has seen a surge of research in this area due to the …

Neural attentional rating regression with review-level explanations

C Chen, M Zhang, Y Liu, S Ma - Proceedings of the 2018 world wide …, 2018 - dl.acm.org
Reviews information is dominant for users to make online purchasing decisions in e-
commerces. However, the usefulness of reviews is varied. We argue that less-useful reviews …