Audio Inpainting of Music by Means of Neural Networks
Published in
(2018)External Links:
TL
TL;DR
For music, the DNN significantly outperformed the reference method, demonstrating a generally good usability of the proposed DNN structure for inpainting complex audio signals like music.
Abstract
We studied the ability of deep neural networks (DNNs) to restore missing audio content based on its context, a process usually referred to as audio inpainting. We focused on gaps in the range of tens of milliseconds. The proposed DNN structure was trained on audio signals containing music and musical instruments, separately, with 64-ms long gaps. The input to the DNN was the context, i.e., the signal surrounding the gap, transformed into time-frequency (TF) coefficients. Our results were compared to those obtained from a reference method based on linear predictive coding (LPC). For music, our DNN significantly outperformed the reference method, demonstrating a generally good usability of the proposed DNN structure for inpainting complex audio signals like music.
References48 items
1
Audio inpainting: Evaluation of time-frequency representations and structured sparsity approaches
2
The challenge of realistic music generation: modelling raw audio at scale
3
Sparse Non-Local Similarity Modeling for Audio Inpainting
4
Synthesizing Audio with Generative Adversarial Networks
5