In this paper, we study a novel problem in egocentric action recognition, which we term as"
Multimodal Generalization"(MMG). MMG aims to study how systems can generalize when …

Abstract Vision-and-Language Pre-trained (VLP) models have demonstrated their powerful
zero-shot ability in multiple downstream tasks. Most of these models are designed to learn …

Storytelling is multi-modal in the real world. When one tells a story, one may use all of the
visualizations and sounds along with the story itself. However, prior studies on storytelling …

With the exponential growth of multi-modal data in the field of computer vision, the ability to
do inference effectively among multiple modalities—such as visual, textual, and auditory …

Storytelling is multi-modal in the real world. When one tells a story, one may use all of the
visualizations and sounds along with the story itself. However, prior studies on storytelling …