Recurrent neural networks for polyphonic sound event detection in real life recordings (2016-03-20T00:00:00.000000Z)

TL;DR

This paper presents an approach to polyphonic sound event detection in real life recordings based on bi-directional long short term memory (BLSTM) recurrent neural networks (RNNs).

Abstract

In this paper we present an approach to polyphonic sound event detection in real life recordings based on bi-directional long short term memory (BLSTM) recurrent neural networks (RNNs). A single multilabel BLSTM RNN is trained to map acoustic features of a mixture signal consisting of sounds from multiple classes, to binary activity indicators of each event class. Our method is tested on a large database of real-life recordings, with 61 classes (e.g. music, car, speech) from 10 different everyday contexts. The proposed method outperforms previous approaches by a large margin, and the results are further improved using data augmentation techniques. Overall, our system reports an average F1-score of 65.5% on 1 second blocks and 64.7% on single frames, a relative improvement over previous state-of-the-art approach of 6.8% and 15.1% respectively.

Authors

Tuomas Virtanen

17 papers

Giambattista Parascandolo

5 papers

H. Huttunen

3 papers

TL;DR

Abstract

Authors

References27 items

Exploring Data Augmentation for Improved Singing Voice Detection with Neural Networks

Polyphonic sound event detection using multi label deep neural networks

Sound event detection in real life recordings using coupled matrix factorization of spectral representations and class activity annotations

Sound event detection using non-negative dictionaries learned from annotated overlapping events

Supervised model training for overlapping sound events based on unsupervised source separation

Speech recognition with deep recurrent neural networks

Context-dependent sound event detection

NMF-based environmental sound source separation using time-variant gain features

Polyphonic piano note transcription with recurrent neural networks

Audio context recognition using audio event histograms

Acoustic event detection in real life recordings

Environmental Sound Recognition With Time–Frequency Audio Features

A Novel Connectionist System for Unconstrained Handwriting Recognition

Audio keywords generation for sports video analysis

Automatic surveillance of the acoustic activity in our living environment

2005 Special Issue: Framewise phoneme classification with bidirectional LSTM and other neural network architectures

Bidirectional recurrent neural networks

Long Short-Term Memory

Learning long-term dependencies with gradient descent is difficult

Backpropagation Through Time: What It Does and How to Do It

Speech recognition using noise-adaptive prototypes

Introducing CURRENNT: the munich open-source CUDA recurrent neural network toolkit

A Software Framework for Musical Data Augmentation

Real-Time Detection of Overlapping Sound Events with Non-Negative Matrix Factorization

Overlapping Sound Event Recognition using Local Spectrogram Features with the Generalised Hough Transform

Universal Onset Detection with Bidirectional Long Short-Term Memory Neural Networks

Lecture 6.5-rmsprop: Divide the gradient by a running average of its recent magnitude

Field of Study

Journal Information

Name

Page

Venue Information

Name

Type

URL

Alternate Names