Sample-level Deep Convolutional Neural Networks for Music Auto-tagging Using Raw Waveforms (2017-03-06T00:00:00.000000Z)

TL;DR

The experiments show how deep architectures with sample-level filters improve the accuracy in music auto-tagging and they provide results comparable to previous state-of-the-art performances for the Magnatagatune dataset and Million Song Dataset.

Abstract

Recently, the end-to-end approach that learns hierarchical representations from raw data using deep convolutional neural networks has been successfully explored in the image, text and speech domains. This approach was applied to musical signals as well but has been not fully explored yet. To this end, we propose sample-level deep convolutional neural networks which learn representations from very small grains of waveforms (e.g. 2 or 3 samples) beyond typical frame-level input representations. Our experiments show how deep architectures with sample-level filters improve the accuracy in music auto-tagging and they provide results comparable to previous state-of-the-art performances for the Magnatagatune dataset and Million Song Dataset. In addition, we visualize filters learned in a sample-level DCNN in each layer to identify hierarchically learned features and show that they are sensitive to log-scaled frequency along layer, such as mel-frequency spectrogram that is widely used in music classification systems.

Authors

Juhan Nam

16 papers

Jongpil Lee

7 papers

Jiyoung Park

3 papers

Sample-level Deep Convolutional Neural Networks for Music Auto-tagging Using Raw Waveforms

TL;DR

Abstract

Authors

References25 items

Multi-Level and Multi-Scale Feature Aggregation Using Pretrained Convolutional Neural Networks for Music Auto-Tagging

Convolutional recurrent neural networks for music classification

WaveNet: A Generative Model for Raw Audio

Wav2Letter: an End-to-End ConvNet-based Speech Recognition System

Applying Topological Persistence in Convolutional Neural Network for Music Audio Signals

Experimenting with musically motivated convolutional neural networks

Automatic Tagging Using Deep Convolutional Neural Networks

Character-level Convolutional Networks for Text Classification

Character-Aware Neural Language Models

Convolutional Neural Networks-based continuous speech recognition using raw speech signal

Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift

Deep neural networks are easily fooled: High confidence predictions for unrecognizable images

Very Deep Convolutional Networks for Large-Scale Image Recognition

End-to-end learning for music audio

Visualizing and Understanding Convolutional Networks

Distributed Representations of Words and Phrases and their Compositionality

ImageNet classification with deep convolutional neural networks

Audio Deepdream: Optimizing raw audio with convolutional networks

Analysis of CNN-based speech recognition system using raw speech as input

Learning the speech front-end with raw waveform CLDNNs

Temporal Pooling and Multiscale Learning for Automatic Annotation and Ranking of Music Audio

The Million Song Dataset

Evaluation of Algorithms Using Games: The Case of Music Tagging

Visualizing Higher-Layer Features of a Deep Network

REFERENCES

Field of Study

Journal Information

Name

Volume

Venue Information

Name

Type

URL

Alternate Names