Physics-informed machine learning for audio processing

In many machine learning techniques, a model is trained on a large amount of data to accomplish a specific task. However, in audio processing, it is often difficult to collect a large amount of data for such training. On the other hand, acoustic phenomena are supposed to obey physical laws, and such physical constraints can provide useful prior information for machine learning models. The governing equations of sound propagation, such as the wave equation, are the best example. In addition, there are various other constraints based on physical properties that can be considered depending on the target or task, and we aim to build new audio processing technology by efficiently incorporating them into machine learning models. This is expected to enable technology that requires less data than conventional machine learning technology and is more flexible than technology based solely on physical models.

References

2025

Physics-Informed Machine Learning For Sound Field Estimation: Fundamentals, state of the art, and challenges

Shoichi Koyama, Juliano G. C. Ribeiro, Tomohiko Nakamura, Natsuki Ueno, and Mirco Pezzoli

IEEE Signal Processing Magazine, 2025

arXiv Bib HTML Code

@article{Koyama:IEEE_M_SP2025,
  author = {Koyama, Shoichi and Ribeiro, Juliano G. C. and Nakamura, Tomohiko and Ueno, Natsuki and Pezzoli, Mirco},
  title = {Physics-Informed Machine Learning For Sound Field Estimation: Fundamentals, state of the art, and challenges},
  journal = {{IEEE} Signal Processing Magazine},
  volume = {41},
  number = {6},
  pages = {60-71},
  year = {2025},
  doi = {10.1109/MSP.2024.3465896},
}

2024

IEEE TASLP

Sound Field Estimation Based on Physics-Constrained Kernel Interpolation Adapted to Environment

Juliano G. C. Ribeiro, Shoichi Koyama, Ryosuke Horiuchi, and Hiroshi Saruwatari

IEEE/ACM Transactions on Audio, Speech, and Language Processing, 2024

Bib HTML PDF Code

@article{Ribeiro:IEEE_ACM_J_ASLP2024,
  author = {Ribeiro, Juliano G. C. and Koyama, Shoichi and Horiuchi, Ryosuke and Saruwatari, Hiroshi},
  title = {Sound Field Estimation Based on Physics-Constrained Kernel Interpolation Adapted to Environment},
  journal = {{IEEE/ACM} Transactions on Audio, Speech, and Language Processing},
  volume = {32},
  pages = {4369-4383},
  year = {2024},
  doi = {10.1109/TASLP.2024.3467951},
}

2025

Sound Field Estimation: Theories and Applications (Foundations and Trends® in Signal Processing)

Natsuki Ueno, and Shoichi Koyama

2025

arXiv Bib HTML

@book{Ueno:FnT_SP2025,
  author = {Ueno, Natsuki and Koyama, Shoichi},
  title = {Sound Field Estimation: Theories and Applications (Foundations and Trends® in Signal Processing)},
  volume = {19},
  number = {1},
  pages = {1-98},
  year = {2025},
  publisher = {Now Publishers},
  doi = {10.1561/2000000121},
  isbn = {1638285241},
}