Attention in natural language processing

A Galassi, M Lippi, P Torroni - IEEE transactions on neural …, 2020 - ieeexplore.ieee.org
Attention is an increasingly popular mechanism used in a wide range of neural
architectures. The mechanism itself has been realized in a variety of formats. However …

Opportunities and challenges of ChatGPT for design knowledge management

X Hu, Y Tian, K Nagato, M Nakao, A Liu - Procedia CIRP, 2023 - Elsevier
Abstract Recent advancements in Natural Language Processing have opened up new
possibilities for the development of large language models like ChatGPT, which can …

A survey on text classification: From traditional to deep learning

Q Li, H Peng, J Li, C Xia, R Yang, L Sun… - ACM Transactions on …, 2022 - dl.acm.org
Text classification is the most fundamental and essential task in natural language
processing. The last decade has seen a surge of research in this area due to the …

Improving multi-hop question answering over knowledge graphs using knowledge base embeddings

A Saxena, A Tripathi, P Talukdar - … of the 58th annual meeting of …, 2020 - aclanthology.org
Abstract Knowledge Graphs (KG) are multi-relational graphs consisting of entities as nodes
and relations among them as typed edges. Goal of the Question Answering over KG (KGQA) …

Rotate: Knowledge graph embedding by relational rotation in complex space

Z Sun, ZH Deng, JY Nie, J Tang - arXiv preprint arXiv:1902.10197, 2019 - arxiv.org
We study the problem of learning representations of entities and relations in knowledge
graphs for predicting missing links. The success of such a task heavily relies on the ability of …

Attention, please! A survey of neural attention models in deep learning

A de Santana Correia, EL Colombini - Artificial Intelligence Review, 2022 - Springer
In humans, Attention is a core property of all perceptual and cognitive operations. Given our
limited ability to process competing sources, attention mechanisms select, modulate, and …

Knowledge graph embedding based question answering

X Huang, J Zhang, D Li, P Li - … conference on web search and data …, 2019 - dl.acm.org
Question answering over knowledge graph (QA-KG) aims to use facts in the knowledge
graph (KG) to answer natural language questions. It helps end users more efficiently and …

Unifying knowledge graph learning and recommendation: Towards a better understanding of user preferences

Y Cao, X Wang, X He, Z Hu, TS Chua - The world wide web conference, 2019 - dl.acm.org
Incorporating knowledge graph (KG) into recommender system is promising in improving the
recommendation accuracy and explainability. However, existing methods largely assume …

A novel embedding model for knowledge base completion based on convolutional neural network

DQ Nguyen, TD Nguyen, DQ Nguyen… - arXiv preprint arXiv …, 2017 - arxiv.org
In this paper, we propose a novel embedding model, named ConvKB, for knowledge base
completion. Our model ConvKB advances state-of-the-art models by employing a …

Leveraging meta-path based context for top-n recommendation with a neural co-attention model

B Hu, C Shi, WX Zhao, PS Yu - Proceedings of the 24th ACM SIGKDD …, 2018 - dl.acm.org
Heterogeneous information network (HIN) has been widely adopted in recommender
systems due to its excellence in modeling complex context information. Although existing …