A review on the attention mechanism of deep learning

Z Niu, G Zhong, H Yu - Neurocomputing, 2021 - Elsevier
Attention has arguably become one of the most important concepts in the deep learning
field. It is inspired by the biological systems of humans that tend to focus on the distinctive …

SG-Net: Syntax-guided machine reading comprehension

Z Zhang, Y Wu, J Zhou, S Duan, H Zhao… - Proceedings of the AAAI …, 2020 - aaai.org
For machine reading comprehension, the capacity of effectively modeling the linguistic
knowledge from the detail-riddled and lengthy passages and getting ride of the noises is …

Attention-based transactional context embedding for next-item recommendation

S Wang, L Hu, L Cao, X Huang, D Lian… - Proceedings of the AAAI …, 2018 - ojs.aaai.org
To recommend the next item to a user in a transactional context is practical yet challenging
in applications such as marketing campaigns. Transactional context refers to the items that …

[图书][B] Text data mining

C Zong, R Xia, J Zhang - 2021 - Springer
With the rapid development and popularization of Internet and mobile communication
technologies, text data mining has attracted much attention. In particular, with the wide use …

Sequence classification with human attention

M Barrett, J Bingel, N Hollenstein, M Rei… - Proceedings of the …, 2018 - aclanthology.org
Learning attention functions requires large volumes of data, but many NLP tasks simulate
human behavior, and in this paper, we show that human attention really does provide a …

Improving natural language processing tasks with human gaze-guided neural attention

E Sood, S Tannert, P Müller… - Advances in Neural …, 2020 - proceedings.neurips.cc
A lack of corpora has so far limited advances in integrating human gaze data as a
supervisory signal in neural attention mechanisms for natural language processing (NLP) …

SG-Net: Syntax guided transformer for language representation

Z Zhang, Y Wu, J Zhou, S Duan… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
Understanding human language is one of the key themes of artificial intelligence. For
language representation, the capacity of effectively modeling the linguistic knowledge from …

Fusing external knowledge resources for natural language understanding techniques: A survey

Y Wang, W Wang, Q Chen, K Huang, A Nguyen, S De… - Information …, 2023 - Elsevier
Abstract Knowledge resources, eg knowledge graphs, which formally represent essential
semantics and information for logic inference and reasoning, can compensate for the …

Towards sentence-level brain decoding with distributed representations

J Sun, S Wang, J Zhang, C Zong - … of the AAAI Conference on Artificial …, 2019 - ojs.aaai.org
Decoding human brain activities based on linguistic representations has been actively
studied in recent years. However, most previous studies exclusively focus on word-level …

Measuring the short text similarity based on semantic and syntactic information

J Yang, Y Li, C Gao, Y Zhang - Future Generation Computer Systems, 2021 - Elsevier
Determining the similarity between short texts plays an important role in natural language
processing applications such as search, query suggestion and automatic summary, which …