Knowledge graphs meet multi-modal learning: A comprehensive survey
Knowledge Graphs (KGs) play a pivotal role in advancing various AI applications, with the
semantic web community's exploration into multi-modal dimensions unlocking new avenues …
semantic web community's exploration into multi-modal dimensions unlocking new avenues …
Multi-modal knowledge graph construction and application: A survey
Recent years have witnessed the resurgence of knowledge engineering which is featured
by the fast growth of knowledge graphs. However, most of existing knowledge graphs are …
by the fast growth of knowledge graphs. However, most of existing knowledge graphs are …
Clip-event: Connecting text and images with event structures
Abstract Vision-language (V+ L) pretraining models have achieved great success in
supporting multimedia applications by understanding the alignments between images and …
supporting multimedia applications by understanding the alignments between images and …
Mukea: Multimodal knowledge extraction and accumulation for knowledge-based visual question answering
Abstract Knowledge-based visual question answering requires the ability of associating
external knowledge for open-ended cross-modal scene understanding. One limitation of …
external knowledge for open-ended cross-modal scene understanding. One limitation of …
COVID-19 literature knowledge graph construction and drug repurposing report generation
To combat COVID-19, both clinicians and scientists need to digest vast amounts of relevant
biomedical knowledge in scientific literature to understand the disease mechanism and …
biomedical knowledge in scientific literature to understand the disease mechanism and …
A survey of multi-modal knowledge graphs: Technologies and trends
In recent years, Knowledge Graphs (KGs) have played a crucial role in the development of
advanced knowledge-intensive applications, such as recommender systems and semantic …
advanced knowledge-intensive applications, such as recommender systems and semantic …
Envisioning narrative intelligence: A creative visual storytelling anthology
BA Halperin, SM Lukin - Proceedings of the 2023 CHI Conference on …, 2023 - dl.acm.org
In this paper, we collect an anthology of 100 visual stories from authors who participated in
our systematic creative process of improvised story-building based on image sequences …
our systematic creative process of improvised story-building based on image sequences …
A two-stream AMR-enhanced model for document-level event argument extraction
Most previous studies aim at extracting events from a single sentence, while document-level
event extraction still remains under-explored. In this paper, we focus on extracting event …
event extraction still remains under-explored. In this paper, we focus on extracting event …
Construction of knowledge graphs: State and challenges
With knowledge graphs (KGs) at the center of numerous applications such as recommender
systems and question answering, the need for generalized pipelines to construct and …
systems and question answering, the need for generalized pipelines to construct and …
On generalization in coreference resolution
While coreference resolution is defined independently of dataset domain, most models for
performing coreference resolution do not transfer well to unseen domains. We consolidate a …
performing coreference resolution do not transfer well to unseen domains. We consolidate a …