About

( Image credit: R-Transformer )

Benchmarks

TREND DATASET BEST METHOD PAPER TITLE PAPER CODE COMPARE

Datasets

Greatest papers with code

An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling

4 Mar 2018locuslab/TCN

Our results indicate that a simple convolutional architecture outperforms canonical recurrent networks such as LSTMs across a diverse range of tasks and datasets, while demonstrating longer effective memory.

LANGUAGE MODELLING MACHINE TRANSLATION MUSIC MODELING SEQUENTIAL IMAGE CLASSIFICATION

Pop Music Transformer: Beat-based Modeling and Generation of Expressive Pop Piano Compositions

1 Feb 2020YatingMusic/remi

In contrast with this general approach, this paper shows that Transformers can do even better for music modeling, when we improve the way a musical score is converted into the data fed to a Transformer model.

HIERARCHICAL STRUCTURE MUSIC MODELING

Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling

11 Dec 2014michaelfarrell76/End-To-End-Generative-Dialogue

In this paper we compare different types of recurrent units in recurrent neural networks (RNNs).

MUSIC MODELING

Sequential Neural Models with Stochastic Layers

NeurIPS 2016 marcofraccaro/srnn

How can we efficiently propagate uncertainty in a latent state representation with recurrent neural networks?

MUSIC MODELING VARIATIONAL INFERENCE

LSTM: A Search Space Odyssey

13 Mar 2015flukeskywalker/highway-networks

Several variants of the Long Short-Term Memory (LSTM) architecture for recurrent neural networks have been proposed since its inception in 1995.

HANDWRITING RECOGNITION MUSIC MODELING SPEECH RECOGNITION

Enabling Factorized Piano Music Modeling and Generation with the MAESTRO Dataset

ICLR 2019 BShakhovsky/PolyphonicPianoTranscription

Generating musical audio directly with neural networks is notoriously difficult because it requires coherently modeling structure at many different timescales.

MUSIC MODELING PIANO MUSIC MODELING

Music Transformer

ICLR 2019 scpark20/Music-GPT-2

This is impractical for long sequences such as musical compositions since their memory complexity for intermediate relative information is quadratic in the sequence length.

MUSIC MODELING

Improving Polyphonic Music Models with Feature-Rich Encoding

26 Nov 2019omarperacha/TonicNet

We show that training a neural network to predict a seemingly more complex sequence, with extra features included in the series being modelled, can improve overall model performance significantly.

MUSIC GENERATION MUSIC MODELING

Diagonal RNNs in Symbolic Music Modeling

18 Apr 2017ycemsubakan/diagonal_rnns

In this paper, we propose a new Recurrent Neural Network (RNN) architecture.

MUSIC MODELING