We study Neural Foley, the automatic generation of high-quality sound effects synchronizing
with videos, enabling an immersive audio-visual experience. Despite its wide range of …

It is an open challenge to obtain high quality training data, especially captions, for text-to-
audio models. Although prior methods have leveraged\textit {text-only language models} to …

Spectrograms are 2D representations of sound that look very different from the images found
in our visual world. And natural images, when played as spectrograms, make unnatural …

We introduce Audio-Agent, a multimodal framework for audio generation, editing and
composition based on text or video inputs. Conventional approaches for text-to-audio (TTA) …

With recent advances of AIGC, video generation have gained a surge of research interest in
both academia and industry (eg, Sora). However, it remains a challenge to produce …

Despite significant advancements in neural text-to-audio generation, challenges persist in
controllability and evaluation. This paper addresses these issues through the Sound Scene …

Generating combined visual and auditory sensory experiences is critical for the consumption
of immersive content. Recent advances in neural generative models have enabled the …

Despite the significant progress in controllable music generation and editing, challenges
remain in the quality and length of generated music due to the use of Mel-spectrogram …

Recent advancements in text-to-audio (TTA) models have demonstrated their ability to
generate sound that aligns with user intentions. Despite this advancement, a notable …

Diffusion-based text-to-audio (TTA) generation has made substantial progress, leveraging
latent diffusion model (LDM) to produce high-quality, diverse and instruction-relevant …