Multimodal procedural planning via dual text-image prompting

Y Lu, P Lu, Z Chen, W Zhu, XE Wang… - arXiv preprint arXiv …, 2023 - arxiv.org
Embodied agents have achieved prominent performance in following human instructions to
complete tasks. However, the potential of providing instructions informed by texts and …

BERT-enhanced relational sentence ordering network

B Cui, Y Li, Z Zhang - Proceedings of the 2020 conference on …, 2020 - aclanthology.org
In this paper, we introduce a novel BERT-enhanced Relational Sentence Ordering Network
(referred to as BRSON) by leveraging BERT for capturing better dependency relationship …

Understanding multimodal procedural knowledge by sequencing multimodal instructional manuals

TL Wu, A Spangher, P Alipoormolabashi… - arXiv preprint arXiv …, 2021 - arxiv.org
The ability to sequence unordered events is an essential skill to comprehend and reason
about real world task procedures, which often requires thorough understanding of temporal …

Leveraging Weak Cross-Modal Guidance for Coherence Modelling via Iterative Learning

Y Bin, J Liao, Y Ding, H Li, Y Yang, SK Ng… - Proceedings of the 32nd …, 2024 - dl.acm.org
Cross-modal coherence modeling is essential for intelligent systems to help them organize
and structure information, thereby understanding and creating content of the physical world …

Improving graph-based sentence ordering with iteratively predicted pairwise orderings

S Lai, A Wang, F Meng, J Zhou, Y Ge, J Zeng… - arXiv preprint arXiv …, 2021 - arxiv.org
Dominant sentence ordering models can be classified into pairwise ordering models and set-
to-sequence models. However, there is little attempt to combine these two types of models …

An overview of sentence ordering task

Y Shi, H Zhang, N Li, T Yang - International Journal of Data Science and …, 2024 - Springer
The sentence ordering task aims to organize complex, unordered sentences into readable
text. This improves accuracy, validity, and reliability in various natural language processing …

Seq2Seq models for recommending short text conversations

J Torres, C Vaca, L Terán, CL Abad - Expert Systems with Applications, 2020 - Elsevier
The massive amounts of data on social media networks can be overwhelming for users; for
this reason, recommending relevant content becomes an essential task to avoid information …

Non-autoregressive sentence ordering

Y Bin, W Shi, B Ji, J Zhang, Y Ding, Y Yang - arXiv preprint arXiv …, 2023 - arxiv.org
Existing sentence ordering approaches generally employ encoder-decoder frameworks with
the pointer net to recover the coherence by recurrently predicting each sentence step-by …

Is everything in order? a simple way to order sentences

SBR Chowdhury, F Brahman, S Chaturvedi - arXiv preprint arXiv …, 2021 - arxiv.org
The task of organizing a shuffled set of sentences into a coherent text has been used to
evaluate a machine's understanding of causal and temporal relations. We formulate the …

[HTML][HTML] Positional diffusion: Graph-based diffusion models for set ordering

F Giuliari, G Scarpellini, S Fiorini, S James… - Pattern Recognition …, 2024 - Elsevier
Positional reasoning is the process of ordering an unsorted set of parts into a consistent
structure. To address this problem, we present Positional Diffusion, a plug-and-play graph …