Binaural reproduction from microphone array recordings

Binaural reproduction is a spatial audio technology that reproduces sounds at two ear positions by using headphones and head-related transfer functions (HRTFs). The binaural sounds in a VR space are simply reproduced by numerical acoustic simulations using given source positions and signals. However, the binaural reproduction of a real environment is not straightforward. We develop a technology to estimate a sound field using a microphone array and reproduce it as binaural sounds, which can be applied to VR systems requiring a large listening area.

Demo
References

2021

  1. Binaural Rendering from Microphone Array Signals of Arbitrary Geometry
    Naoto Iijima, Shoichi Koyama, and Hiroshi Saruwatari
    Journal of the Acoustical Society of America, 2021

2018

  1. Sound Field Recording Using Distributed Microphones Based on Harmonic Analysis of Infinite Order
    IEEE Signal Processing Letters, 2018