A metaverse: Taxonomy, components, applications, and open challenges

SM Park, YG Kim - IEEE access, 2022 - ieeexplore.ieee.org
Unlike previous studies on the Metaverse based on Second Life, the current Metaverse is
based on the social value of Generation Z that online and offline selves are not different …

Earthquake transformer—an attentive deep-learning model for simultaneous earthquake detection and phase picking

SM Mousavi, WL Ellsworth, W Zhu, LY Chuang… - Nature …, 2020 - nature.com
Earthquake signal detection and seismic phase picking are challenging tasks in the
processing of noisy data and the monitoring of microearthquakes. Here we present a global …

An introductory survey on attention mechanisms in NLP problems

D Hu - Intelligent Systems and Applications: Proceedings of …, 2020 - Springer
First derived from human intuition, later adapted to machine translation for automatic token
alignment, attention mechanism, a simple method that can be used for encoding sequence …

Storytelling with image data: A systematic review and comparative analysis of methods and tools

F Lotfi, A Beheshti, H Farhood, M Pooshideh… - Algorithms, 2023 - mdpi.com
In our digital age, data are generated constantly from public and private sources, social
media platforms, and the Internet of Things. A significant portion of this information comes in …

Trends in integration of vision and language research: A survey of tasks, datasets, and methods

A Mogadala, M Kalimuthu, D Klakow - Journal of Artificial Intelligence …, 2021 - jair.org
Abstract Interest in Artificial Intelligence (AI) and its applications has seen unprecedented
growth in the last few years. This success can be partly attributed to the advancements made …

No metrics are perfect: Adversarial reward learning for visual storytelling

X Wang, W Chen, YF Wang, WY Wang - arXiv preprint arXiv:1804.09160, 2018 - arxiv.org
Though impressive results have been achieved in visual captioning, the task of generating
abstract stories from photo streams is still a little-tapped problem. Different from captions …

Envisioning narrative intelligence: A creative visual storytelling anthology

BA Halperin, SM Lukin - Proceedings of the 2023 CHI Conference on …, 2023 - dl.acm.org
In this paper, we collect an anthology of 100 visual stories from authors who participated in
our systematic creative process of improvised story-building based on image sequences …

Hierarchically structured reinforcement learning for topically coherent visual story generation

Q Huang, Z Gan, A Celikyilmaz, D Wu… - Proceedings of the AAAI …, 2019 - ojs.aaai.org
We propose a hierarchically structured reinforcement learning approach to address the
challenges of planning for generating coherent multi-sentence stories for the visual …

What makes a good story? designing composite rewards for visual storytelling

J Hu, Y Cheng, Z Gan, J Liu, J Gao… - Proceedings of the AAAI …, 2020 - ojs.aaai.org
Previous storytelling approaches mostly focused on optimizing traditional metrics such as
BLEU, ROUGE and CIDEr. In this paper, we re-examine this problem from a different angle …

[PDF][PDF] Knowledgeable Storyteller: A Commonsense-Driven Generative Model for Visual Storytelling.

P Yang, F Luo, P Chen, L Li, Z Yin, X He, X Sun - IJCAI, 2019 - ijcai.org
The visual storytelling (VST) task aims at generating a reasonable and coherent paragraph-
level story with the image stream as input. Different from caption that is a direct and literal …