Knowledge graphs meet multi-modal learning: A comprehensive survey

Z Chen, Y Zhang, Y Fang, Y Geng, L Guo… - arXiv preprint arXiv …, 2024 - arxiv.org
Knowledge Graphs (KGs) play a pivotal role in advancing various AI applications, with the
semantic web community's exploration into multi-modal dimensions unlocking new avenues …

Multi-modal knowledge graph construction and application: A survey

X Zhu, Z Li, X Wang, X Jiang, P Sun… - … on Knowledge and …, 2022 - ieeexplore.ieee.org
Recent years have witnessed the resurgence of knowledge engineering which is featured
by the fast growth of knowledge graphs. However, most of existing knowledge graphs are …

Clip-event: Connecting text and images with event structures

M Li, R Xu, S Wang, L Zhou, X Lin… - Proceedings of the …, 2022 - openaccess.thecvf.com
Abstract Vision-language (V+ L) pretraining models have achieved great success in
supporting multimedia applications by understanding the alignments between images and …

Mukea: Multimodal knowledge extraction and accumulation for knowledge-based visual question answering

Y Ding, J Yu, B Liu, Y Hu, M Cui… - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
Abstract Knowledge-based visual question answering requires the ability of associating
external knowledge for open-ended cross-modal scene understanding. One limitation of …

COVID-19 literature knowledge graph construction and drug repurposing report generation

Q Wang, M Li, X Wang, N Parulian, G Han, J Ma… - arXiv preprint arXiv …, 2020 - arxiv.org
To combat COVID-19, both clinicians and scientists need to digest vast amounts of relevant
biomedical knowledge in scientific literature to understand the disease mechanism and …

A survey of multi-modal knowledge graphs: Technologies and trends

W Liang, PD Meo, Y Tang, J Zhu - ACM Computing Surveys, 2024 - dl.acm.org
In recent years, Knowledge Graphs (KGs) have played a crucial role in the development of
advanced knowledge-intensive applications, such as recommender systems and semantic …

Envisioning narrative intelligence: A creative visual storytelling anthology

BA Halperin, SM Lukin - Proceedings of the 2023 CHI Conference on …, 2023 - dl.acm.org
In this paper, we collect an anthology of 100 visual stories from authors who participated in
our systematic creative process of improvised story-building based on image sequences …

A two-stream AMR-enhanced model for document-level event argument extraction

R Xu, P Wang, T Liu, S Zeng, B Chang, Z Sui - arXiv preprint arXiv …, 2022 - arxiv.org
Most previous studies aim at extracting events from a single sentence, while document-level
event extraction still remains under-explored. In this paper, we focus on extracting event …

Construction of knowledge graphs: State and challenges

M Hofer, D Obraczka, A Saeedi, H Köpcke… - arXiv preprint arXiv …, 2023 - arxiv.org
With knowledge graphs (KGs) at the center of numerous applications such as recommender
systems and question answering, the need for generalized pipelines to construct and …

On generalization in coreference resolution

S Toshniwal, P Xia, S Wiseman, K Livescu… - arXiv preprint arXiv …, 2021 - arxiv.org
While coreference resolution is defined independently of dataset domain, most models for
performing coreference resolution do not transfer well to unseen domains. We consolidate a …