3260 papers • 126 benchmarks • 313 datasets
Filling in holes in audio data
(Image credit: Papersgraph)
These leaderboards are used to track progress in audio-inpainting-10
No benchmarks available.
Use these libraries to find audio-inpainting-10 models and implementations
No datasets available.
No subtasks available.
The paper presents a unified, flexible framework for the tasks of audio inpainting, declipping, and dequantization that is extended to cover analogous degradation models in a transformed domain, e.g. quantization of the signal's time-frequency coefficients.
This paper proposes to structure the spectrogram with nonnegative matrix factorization (NMF) in a probabilistic framework, and derives two expectation-maximization algorithms for estimating the parameters of the model, depending on whether the problem in the time- or time-frequency domain.
For music, the DNN significantly outperformed the reference method, demonstrating a generally good usability of the proposed DNN structure for inpainting complex audio signals like music.
The proposed model outperforms the classical WGAN model and improves the reconstruction of high-frequency content and better results for instruments where the frequency spectrum is mainly in the lower range where small noises are less annoying for human ear and the inpainting part is more perceptible.
Surprisingly, in most cases, such an approximation is shown to provide even better numerical results in audio inpainting compared to its proper counterpart, while being computationally much more effective.
The results show that CQT-Diff outperforms the compared baselines and ablations in audio bandwidth extension and, without retraining, delivers competitive performance against modern baselines in audio inpainting and declipping.
This work presents Msanii, a novel diffusion-based model for synthesizing long-context, high-fidelity music efficiently that combines the expressiveness of mel spectrograms, the generative capabilities of diffusion models, and the vocoding capabilities of neural vocoders.
The proposed method using an unconditionally trained generative model, which can be conditioned in a zero-shot fashion for audio inpainting, and is able to regenerate gaps of any size, can be applied to restoring sound recordings that suffer from severe local disturbances or dropouts, which must be reconstructed.
Adding a benchmark result helps the community track progress.