Deep Multimodal Data Fusion

F Zhao, C Zhang, B Geng - ACM Computing Surveys, 2024 - dl.acm.org
Multimodal Artificial Intelligence (Multimodal AI), in general, involves various types of data
(eg, images, texts, or data collected from different sensors), feature engineering (eg …

Against opacity: Explainable ai and large language models for effective digital advertising

Q Yang, M Ongpin, S Nikolenko, A Huang… - Proceedings of the 31st …, 2023 - dl.acm.org
The opaqueness of modern digital advertising, exemplified by platforms such as Meta Ads,
raises concerns regarding their autonomous control over audience targeting, pricing …

Contrastive intra-and inter-modality generation for enhancing incomplete multimedia recommendation

Z Lin, Y Tan, Y Zhan, W Liu, F Wang, C Chen… - Proceedings of the 31st …, 2023 - dl.acm.org
With the rapid growth of multimedia-sharing platforms (eg Twitter and TikTok), multimedia
recommender systems have become fundamental for helping users alleviate information …

Data Augmented Graph Neural Networks for Personality Detection

Y Zhu, Y Xia, M Li, T Zhang, B Wu - … of the AAAI Conference on Artificial …, 2024 - ojs.aaai.org
Personality detection is a fundamental task for user psychology research. One of the biggest
challenges in personality detection lies in the quantitative limitation of labeled data collected …

AlignGroup: Learning and Aligning Group Consensus with Member Preferences for Group Recommendation

J Xu, Z Chen, J Li, S Yang, H Wang… - Proceedings of the 33rd …, 2024 - dl.acm.org
Group activities are important behaviors in human society, providing personalized
recommendations for groups is referred to as the group recommendation task. Existing …

Sensing Micro-Motion Human Patterns using Multimodal mmRadar and Video Signal for Affective and Psychological Intelligence

Y Ru, P Li, M Sun, Y Wang, K Zhang, Q Li… - Proceedings of the 31st …, 2023 - dl.acm.org
Affective and psychological perception are pivotal in human-machine interaction and
essential domains within artificial intelligence. Existing physiological signal-based affective …

"Just To See You Smile": SMILEY, a Voice-Guided GUY GAN

Q Yang, C Tzelepis, S Nikolenko, I Patras… - Proceedings of the …, 2023 - dl.acm.org
In this technical demonstration, we present SMILEY, a voice-guided virtual assistant. The
system utilizes a deep neural architecture ContraCLIP to manipulate facial attributes using …

SoCraft: Advertiser-level Predictive Scoring for Creative Performance on Meta

A Huang, Q Yang, S Nikolenko, M Ongpin… - Proceedings of the …, 2023 - dl.acm.org
In this technical demonstration, we present SoCraft, a framework to build an advertiser-level
multimedia ad content scoring platform for Meta Ads. The system utilizes a multimodal deep …

PCENet: Psychological Clues Exploration Network for Multimodal Personality Assessment

Y Zhu, Y Wei, M Li, T Zhang, S Wei, B Wu - Proceedings of the 32nd …, 2023 - dl.acm.org
Multimodal personality assessment aims to identify and express human personality traits in
videos. Existing methods primarily focus on multimodal fusion while ignoring the inherent …

Personality Analysis from Online Short Video Platforms with Multi-domain Adaptation

S An, X Sun, Y Li, Y Yang, G Xu - arXiv preprint arXiv:2411.00813, 2024 - arxiv.org
Personality analysis from online short videos has gained prominence due to its applications
in personalized recommendation systems, sentiment analysis, and human-computer …