Scene-Aware Audio Rendering via Deep Acoustic Analysis

We present a new method to capture the acoustic characteristics of real-world rooms using commodity devices, and use the captured characteristics to generate similar sounding sources with virtual models. Given the captured audio and an approximate geometric model of a real-world room, we present a n...

Ausführliche Beschreibung

Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on visualization and computer graphics. - 1998. - 26(2020), 5 vom: 12. Mai, Seite 1991-2001
1. Verfasser: Tang, Zhenyu (VerfasserIn)
Weitere Verfasser: Bryan, Nicholas J, Li, Dingzeyu, Langlois, Timothy R, Manocha, Dinesh
Format: Online-Aufsatz
Sprache:English
Veröffentlicht: 2020
Zugriff auf das übergeordnete Werk:IEEE transactions on visualization and computer graphics
Schlagworte:Journal Article
LEADER 01000caa a22002652c 4500
001 NLM306649322
003 DE-627
005 20250226185655.0
007 cr uuu---uuuuu
008 231225s2020 xx |||||o 00| ||eng c
024 7 |a 10.1109/TVCG.2020.2973058  |2 doi 
028 5 2 |a pubmed25n1022.xml 
035 |a (DE-627)NLM306649322 
035 |a (NLM)32070967 
040 |a DE-627  |b ger  |c DE-627  |e rakwb 
041 |a eng 
100 1 |a Tang, Zhenyu  |e verfasserin  |4 aut 
245 1 0 |a Scene-Aware Audio Rendering via Deep Acoustic Analysis 
264 1 |c 2020 
336 |a Text  |b txt  |2 rdacontent 
337 |a ƒaComputermedien  |b c  |2 rdamedia 
338 |a ƒa Online-Ressource  |b cr  |2 rdacarrier 
500 |a Date Revised 06.04.2020 
500 |a published: Print-Electronic 
500 |a Citation Status PubMed-not-MEDLINE 
520 |a We present a new method to capture the acoustic characteristics of real-world rooms using commodity devices, and use the captured characteristics to generate similar sounding sources with virtual models. Given the captured audio and an approximate geometric model of a real-world room, we present a novel learning-based method to estimate its acoustic material properties. Our approach is based on deep neural networks that estimate the reverberation time and equalization of the room from recorded audio. These estimates are used to compute material properties related to room reverberation using a novel material optimization objective. We use the estimated acoustic material characteristics for audio rendering using interactive geometric sound propagation and highlight the performance on many real-world scenarios. We also perform a user study to evaluate the perceptual similarity between the recorded sounds and our rendered audio 
650 4 |a Journal Article 
700 1 |a Bryan, Nicholas J  |e verfasserin  |4 aut 
700 1 |a Li, Dingzeyu  |e verfasserin  |4 aut 
700 1 |a Langlois, Timothy R  |e verfasserin  |4 aut 
700 1 |a Manocha, Dinesh  |e verfasserin  |4 aut 
773 0 8 |i Enthalten in  |t IEEE transactions on visualization and computer graphics  |d 1998  |g 26(2020), 5 vom: 12. Mai, Seite 1991-2001  |w (DE-627)NLM098269445  |x 1941-0506  |7 nnas 
773 1 8 |g volume:26  |g year:2020  |g number:5  |g day:12  |g month:05  |g pages:1991-2001 
856 4 0 |u http://dx.doi.org/10.1109/TVCG.2020.2973058  |3 Volltext 
912 |a GBV_USEFLAG_A 
912 |a SYSFLAG_A 
912 |a GBV_NLM 
912 |a GBV_ILN_350 
951 |a AR 
952 |d 26  |j 2020  |e 5  |b 12  |c 05  |h 1991-2001