Connecting Vision and Language plays an essential role in Generative Intelligence. For this
reason, large research efforts have been devoted to image captioning, ie describing images …

Accurately predicting the magnitude and timing of floods is an extremely challenging
problem for watershed management, as it aims to provide early warning and save lives …

Despite considerable progress, image captioning still suffers from the huge difference in
quality between easy and hard examples, which is left unexploited in existing methods. To …

People say," A picture is worth a thousand words". Then how can we get the rich information
out of the image? We argue that by using visual clues to bridge large pretrained vision …

Video paragraph captioning aims to describe multiple events in untrimmed videos with
descriptive paragraphs. Existing approaches mainly solve the problem in two steps: event …

Deep cross-modal retrieval techniques have recently achieved remarkable performance,
which also poses severe threats to data privacy potentially. Nowadays, enormous user …

Domain adaptation techniques, which focus on adapting models between distributionally
different domains, are rarely explored in the video recognition area due to the significant …

In this article, we tackle the cross-modal video moment localization issue, namely, localizing
the most relevant video moment in an untrimmed video given a sentence as the query. The …

Generalized Zero-Shot Learning (GZSL) is the task of leveraging semantic information to
recognize seen and unseen samples, where unseen classes are not observable during …

In this paper, we present a regularization-based image paragraph generation method. We
propose a novel multimodal encoding generator (MEG) to generate effective multimodal …