Mesh2ir: Neural acoustic impulse response generator for complex 3d scenes
We propose a mesh-based neural network (MESH2IR) to generate acoustic impulse
responses (IRs) for indoor 3D scenes represented using a mesh. The IRs are used to create …
responses (IRs) for indoor 3D scenes represented using a mesh. The IRs are used to create …
Realimpact: A dataset of impact sound fields for real objects
Abstract Objects make unique sounds under different perturbations, environment conditions,
and poses relative to the listener. While prior works have modeled impact sounds and sound …
and poses relative to the listener. While prior works have modeled impact sounds and sound …
Dance-to-music generation with encoder-based textual inversion of diffusion models
The harmonious integration of music with dance movements is pivotal in vividly conveying
the artistic essence of dance. This alignment also significantly elevates the immersive quality …
the artistic essence of dance. This alignment also significantly elevates the immersive quality …
Dance-to-Music Generation with Encoder-based Textual Inversion
The seamless integration of music with dance movements is essential for communicating the
artistic intent of a dance piece. This alignment also significantly improves the immersive …
artistic intent of a dance piece. This alignment also significantly improves the immersive …
Rigid-body sound synthesis with differentiable modal resonators
Physical models of rigid bodies are used for sound synthesis in applications from virtual
environments to music production. Traditional methods, such as modal synthesis, often rely …
environments to music production. Traditional methods, such as modal synthesis, often rely …
Differentiable Modal Synthesis for Physical Modeling of Planar String Sound and Motion Simulation
While significant advancements have been made in music generation and differentiable
sound synthesis within machine learning and computer audition, the simulation of …
sound synthesis within machine learning and computer audition, the simulation of …
DiffSound: Differentiable Modal Sound Rendering and Inverse Rendering for Diverse Inference Tasks
Accurately estimating and simulating the physical properties of objects from real-world
sound recordings is of great practical importance in the fields of vision, graphics, and …
sound recordings is of great practical importance in the fields of vision, graphics, and …
Interactive Neural Resonators
In this work, we propose a method for the controllable synthesis of real-time contact sounds
using neural resonators. Previous works have used physically inspired statistical methods …
using neural resonators. Previous works have used physically inspired statistical methods …
AutoSFX: Automatic Sound Effect Generation for Videos
Y Wang, Z Wang, H Huang - Proceedings of the 32nd ACM International …, 2024 - dl.acm.org
Sound Effect (SFX) generation, primarily aims to automatically produce sound waves for
sounding visual objects in images or videos. Rather than learning an automatic solution to …
sounding visual objects in images or videos. Rather than learning an automatic solution to …
SonifyAR: Context-Aware Sound Generation in Augmented Reality
Sound plays a crucial role in enhancing user experience and immersiveness in Augmented
Reality (AR). However, current platforms lack support for AR sound authoring due to limited …
Reality (AR). However, current platforms lack support for AR sound authoring due to limited …