Deep audio-visual learning: A survey

H Zhu, MD Luo, R Wang, AH Zheng, R He - International Journal of …, 2021 - Springer
Audio-visual learning, aimed at exploiting the relationship between audio and visual
modalities, has drawn considerable attention since deep learning started to be used …

Bailando: 3d dance generation by actor-critic gpt with choreographic memory

L Siyao, W Yu, T Gu, C Lin, Q Wang… - Proceedings of the …, 2022 - openaccess.thecvf.com
Driving 3D characters to dance following a piece of music is highly challenging due to the
spatial constraints applied to poses by choreography norms. In addition, the generated …

Ai choreographer: Music conditioned 3d dance generation with aist++

R Li, S Yang, DA Ross… - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
We present AIST++, a new multi-modal dataset of 3D dance motion and music, along with
FACT, a Full-Attention Cross-modal Transformer network for generating 3D dance motion …

Dance revolution: Long-term dance generation with music via curriculum learning

R Huang, H Hu, W Wu, K Sawada, M Zhang… - arXiv preprint arXiv …, 2020 - arxiv.org
Dancing to music is one of human's innate abilities since ancient times. In machine learning
research, however, synthesizing dance movements from music is a challenging problem …

Deepdance: music-to-dance motion choreography with adversarial learning

G Sun, Y Wong, Z Cheng… - IEEE Transactions …, 2020 - ieeexplore.ieee.org
The creation of improvised dancing choreographies is an important research field of cross-
modal analysis. A key point of this task is how to effectively create and correlate music and …

A brand new dance partner: Music-conditioned pluralistic dancing controlled by multiple dance genres

J Kim, H Oh, S Kim, H Tong… - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
When coming up with phrases of movement, choreographers all have their habits as they
are used to their skilled dance genres. Therefore, they tend to return certain patterns of the …

Music-driven group choreography

N Le, T Pham, T Do, E Tjiputra… - Proceedings of the …, 2023 - openaccess.thecvf.com
Music-driven choreography is a challenging problem with a wide variety of industrial
applications. Recently, many methods have been proposed to synthesize dance motions …

Music2dance: Dancenet for music-driven dance generation

W Zhuang, C Wang, J Chai, Y Wang, M Shao… - ACM Transactions on …, 2022 - dl.acm.org
Synthesize human motions from music (ie, music to dance) is appealing and has attracted
lots of research interests in recent years. It is challenging because of the requirement for …

Aigc for various data modalities: A survey

LG Foo, H Rahmani, J Liu - arXiv preprint arXiv:2308.14177, 2023 - arxiv.org
AI-generated content (AIGC) methods aim to produce text, images, videos, 3D assets, and
other media using AI algorithms. Due to its wide range of applications and the demonstrated …

Choreonet: Towards music to dance synthesis with choreographic action unit

Z Ye, H Wu, J Jia, Y Bu, W Chen, F Meng… - Proceedings of the 28th …, 2020 - dl.acm.org
Dance and music are two highly correlated artistic forms. Synthesizing dance motions has
attracted much attention recently. Most previous works conduct music-to-dance synthesis via …