Real acoustic fields: An audio-visual room acoustics dataset and benchmark

Z Chen, ID Gebru, C Richardt… - Proceedings of the …, 2024 - openaccess.thecvf.com
We present a new dataset called Real Acoustic Fields (RAF) that captures real acoustic
room data from multiple modalities. The dataset includes high-quality and densely captured …

MAGIC: Map-Guided Few-Shot Audio-Visual Acoustics Modeling

D Huang, K Lin, P Chen, Q Du, M Tan - arXiv preprint arXiv:2405.13860, 2024 - arxiv.org
Few-shot audio-visual acoustics modeling seeks to synthesize the room impulse response
in arbitrary locations with few-shot observations. To sufficiently exploit the provided few-shot …

AV-GS: Learning Material and Geometry Aware Priors for Novel View Acoustic Synthesis

S Bhosale, H Yang, D Kanojia, J Deng… - arXiv preprint arXiv …, 2024 - arxiv.org
Novel view acoustic synthesis (NVAS) aims to render binaural audio at any target viewpoint,
given a mono audio emitted by a sound source at a 3D scene. Existing methods have …

SEE-2-SOUND: Zero-Shot Spatial Environment-to-Spatial Sound

R Dagli, S Prakash, R Wu, H Khosravani - arXiv preprint arXiv:2406.06612, 2024 - arxiv.org
Generating combined visual and auditory sensory experiences is critical for the consumption
of immersive content. Recent advances in neural generative models have enabled the …

RIR-in-a-Box: Estimating Room Acoustics from 3D Mesh Data through Shoebox Approximation

L Kelley, D Di Carlo, AA Nugraha… - …, 2024 - telecom-paris.hal.science
his paper describes a method for estimating the room impulse response (RIR) for a
microphone and a sound source located at arbitrary positions from the 3D mesh data of the …

An end-to-end approach for blindly rendering a virtual sound source in an audio augmented reality environment

S Saini, I Engel, J Peissig - EURASIP Journal on Audio, Speech, and …, 2024 - Springer
Audio augmented reality (AAR), a prominent topic in the field of audio, requires
understanding the listening environment of the user for rendering an authentic virtual …