We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.SD

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Sound

Title: Scene-Aware Audio Rendering via Deep Acoustic Analysis

Abstract: We present a new method to capture the acoustic characteristics of real-world rooms using commodity devices, and use the captured characteristics to generate similar sounding sources with virtual models. Given the captured audio and an approximate geometric model of a real-world room, we present a novel learning-based method to estimate its acoustic material properties. Our approach is based on deep neural networks that estimate the reverberation time and equalization of the room from recorded audio. These estimates are used to compute material properties related to room reverberation using a novel material optimization objective. We use the estimated acoustic material characteristics for audio rendering using interactive geometric sound propagation and highlight the performance on many real-world scenarios. We also perform a user study to evaluate the perceptual similarity between the recorded sounds and our rendered audio.
Comments: conditionally accepted to IEEE VR 2020 Journal Track
Subjects: Sound (cs.SD); Graphics (cs.GR); Multimedia (cs.MM); Audio and Speech Processing (eess.AS)
Cite as: arXiv:1911.06245 [cs.SD]
  (or arXiv:1911.06245v1 [cs.SD] for this version)

Submission history

From: Zhenyu Tang [view email]
[v1] Thu, 14 Nov 2019 17:04:00 GMT (8346kb,D)

Link back to: arXiv, form interface, contact.