Binaural reproduction from microphone array recordings

Binaural reproduction is a spatial audio technology that reproduces sounds at two ear positions by using headphones and head-related transfer functions (HRTFs). The binaural sounds in a VR space are simply reproduced by numerical acoustic simulations using given source positions and signals. However, the binaural reproduction of a real environment is not straightforward. We develop a technology to estimate a sound field using a microphone array and reproduce it as binaural sounds, which can be applied to VR systems requiring a large listening area.

Demo

References

• N. Iijima, S. Koyama, and H. Saruwatari, “Binaural Rendering from Microphone Array Signals of Arbitrary Geometry,” J. Acoust. Soc. Amer., vol. 150, no. 4, pp. 2479-2491, 2021.
• N. Ueno, S. Koyama, and H. Saruwatari, “Sound Field Recording Using Distributed Microphones Based on Harmonic Analysis of Infinite Order,” IEEE Signal Process. Lett., vol. 25, no. 1, pp. 135-139, 2018.