Search Results for author: Gus Xia

Found 36 papers, 25 papers with code

MusicMagus: Zero-Shot Text-to-Music Editing via Diffusion Models

no code implementations9 Feb 2024 Yixiao Zhang, Yukara Ikemiya, Gus Xia, Naoki Murata, Marco Martínez, Wei-Hsiang Liao, Yuki Mitsufuji, Simon Dixon

This paper introduces a novel approach to the editing of music generated by such models, enabling the modification of specific attributes, such as genre, mood and instrument, while maintaining other aspects unchanged.

Music Generation Text-to-Music Generation

Content-based Controls For Music Large Language Modeling

no code implementations26 Oct 2023 Liwei Lin, Gus Xia, Junyan Jiang, Yixiao Zhang

We aim to further equip the models with direct and content-based controls on innate music languages such as pitch, chords and drum track.

Language Modelling Music Generation +1

AccoMontage-3: Full-Band Accompaniment Arrangement via Sequential Style Transfer and Multi-Track Function Prior

1 code implementation25 Oct 2023 Jingwei Zhao, Gus Xia, Ye Wang

The first component is a piano arranger that generates piano accompaniment for the lead sheet by transferring texture styles to the chords using latent chord-texture disentanglement and heuristic retrieval of texture donors.

Disentanglement Retrieval +1

Motif-Centric Representation Learning for Symbolic Music

1 code implementation19 Sep 2023 Yuxuan Wu, Roger B. Dannenberg, Gus Xia

Music motif, as a conceptual building block of composition, is crucial for music structure analysis and automatic composition.

Contrastive Learning Information Retrieval +3

Polyffusion: A Diffusion Model for Polyphonic Score Generation with Internal and External Controls

1 code implementation19 Jul 2023 Lejun Min, Junyan Jiang, Gus Xia, Jingwei Zhao

We propose Polyffusion, a diffusion model that generates polyphonic music scores by regarding music as image-like piano roll representations.

Music Generation

On the Effectiveness of Speech Self-supervised Learning for Music

no code implementations11 Jul 2023 Yinghao Ma, Ruibin Yuan, Yizhi Li, Ge Zhang, Xingran Chen, Hanzhi Yin, Chenghua Lin, Emmanouil Benetos, Anton Ragni, Norbert Gyenge, Ruibo Liu, Gus Xia, Roger Dannenberg, Yike Guo, Jie Fu

Our findings suggest that training with music data can generally improve performance on MIR tasks, even when models are trained using paradigms designed for speech.

Information Retrieval Music Information Retrieval +2

Calliffusion: Chinese Calligraphy Generation and Style Transfer with Diffusion Modeling

no code implementations30 May 2023 Qisheng Liao, Gus Xia, Zhinuo Wang

In this paper, we propose Calliffusion, a system for generating high-quality Chinese calligraphy using diffusion models.

Denoising Style Transfer +1

Learning Interpretable Low-dimensional Representation via Physical Symmetry

1 code implementation NeurIPS 2023 Xuanjie Liu, Daniel Chin, Yichen Huang, Gus Xia

We have recently seen great progress in learning interpretable music representations, ranging from basic factors, such as pitch and timbre, to high-level concepts, such as chord and texture.

counterfactual Time Series

Vis2Mus: Exploring Multimodal Representation Mapping for Controllable Music Generation

1 code implementation10 Nov 2022 Runbang Zhang, Yixiao Zhang, Kai Shao, Ying Shan, Gus Xia

In this study, we explore the representation mapping from the domain of visual arts to the domain of music, with which we can use visual arts as an effective handle to control music generation.

Music Generation Representation Learning +1

Self-Supervised Hierarchical Metrical Structure Modeling

1 code implementation31 Oct 2022 Junyan Jiang, Gus Xia

We propose a novel method to model hierarchical metrical structures for both symbolic music and audio signals in a self-supervised manner with minimal domain knowledge.

Learning Hierarchical Metrical Structure Beyond Measures

1 code implementation21 Sep 2022 Junyan Jiang, Daniel Chin, Yixiao Zhang, Gus Xia

In this paper, we explore a data-driven approach to automatically extract hierarchical metrical structures from scores.

Information Retrieval Music Information Retrieval +1

Modeling Perceptual Loudness of Piano Tone: Theory and Applications

1 code implementation21 Sep 2022 Yang Qu, Yutian Qin, Lecheng Chao, Hangkai Qian, Ziyu Wang, Gus Xia

The relationship between perceptual loudness and physical attributes of sound is an important subject in both computer music and psychoacoustics.

AccoMontage2: A Complete Harmonization and Accompaniment Arrangement System

1 code implementation1 Sep 2022 Li Yi, Haochen Hu, Jingwei Zhao, Gus Xia

We propose AccoMontage2, a system capable of doing full-length song harmonization and accompaniment arrangement based on a lead melody.

Retrieval Template Matching

Interpreting Song Lyrics with an Audio-Informed Pre-trained Language Model

1 code implementation24 Aug 2022 Yixiao Zhang, Junyan Jiang, Gus Xia, Simon Dixon

Lyric interpretations can help people understand songs and their lyrics quickly, and can also make it easier to manage, retrieve and discover songs efficiently from the growing mass of music archives.

Language Modelling Retrieval

Learning long-term music representations via hierarchical contextual constraints

no code implementations13 Feb 2022 Shiqi Wei, Gus Xia

Learning symbolic music representations, especially disentangled representations with probabilistic interpretations, has been shown to benefit both music understanding and generation.

Contrastive Learning Disentanglement

AccoMontage: Accompaniment Arrangement via Phrase Selection and Style Transfer

1 code implementation25 Aug 2021 Jingwei Zhao, Gus Xia

Accompaniment arrangement is a difficult music generation task involving intertwined constraints of melody, harmony, texture, and music structure.

Music Generation Style Transfer

A Unified Model for Zero-shot Music Source Separation, Transcription and Synthesis

1 code implementation7 Aug 2021 Liwei Lin, Qiuqiang Kong, Junyan Jiang, Gus Xia

We propose a unified model for three inter-related tasks: 1) to \textit{separate} individual sound sources from a mixed music audio, 2) to \textit{transcribe} each sound source to MIDI notes, and 3) to\textit{ synthesize} new pieces based on the timbre of separated sources.

Disentanglement Music Source Separation +2

POP909: A Pop-song Dataset for Music Arrangement Generation

1 code implementation17 Aug 2020 Ziyu Wang, Ke Chen, Junyan Jiang, Yiyi Zhang, Maoran Xu, Shuqi Dai, Xianbin Gu, Gus Xia

The main body of the dataset contains the vocal melody, the lead instrument melody, and the piano accompaniment for each song in MIDI format, which are aligned to the original audio files.

Music Generation

Learning Interpretable Representation for Controllable Polyphonic Music Generation

2 code implementations17 Aug 2020 Ziyu Wang, Dingsu Wang, Yixiao Zhang, Gus Xia

While deep generative models have become the leading methods for algorithmic composition, it remains a challenging problem to control the generation process because the latent variables of most deep-learning models lack good interpretability.

Disentanglement Music Generation +1

PIANOTREE VAE: Structured Representation Learning for Polyphonic Music

2 code implementations17 Aug 2020 Ziyu Wang, Yiyi Zhang, Yixiao Zhang, Junyan Jiang, Ruihan Yang, Junbo Zhao, Gus Xia

The dominant approach for music representation learning involves the deep unsupervised model family variational autoencoder (VAE).

Music Generation Representation Learning

Word Representation for Rhythms

1 code implementation21 Jul 2020 Tongyu Lu, Lyucheng Yan, Gus Xia

This paper proposes a word representation strategy for rhythm patterns.

Continuous Melody Generation via Disentangled Short-Term Representations and Structural Conditions

1 code implementation5 Feb 2020 Ke Chen, Gus Xia, Shlomo Dubnov

Automatic music generation is an interdisciplinary research topic that combines computational creativity and semantic analysis of music to create automatic machine improvisations.

Disentanglement Music Generation

Deep Music Analogy Via Latent Representation Disentanglement

3 code implementations9 Jun 2019 Ruihan Yang, Dingsu Wang, Ziyu Wang, Tianyao Chen, Junyan Jiang, Gus Xia

Analogy-making is a key method for computer algorithms to generate both natural and creative music pieces.


Inspecting and Interacting with Meaningful Music Representations using VAE

no code implementations18 Apr 2019 Ruihan Yang, Tianyao Chen, Yiyi Zhang, Gus Xia

Variational Autoencoders(VAEs) have already achieved great results on image generation and recently made promising progress on music generation.

Disentanglement Image Generation +2

A Framework for Automated Pop-song Melody Generation with Piano Accompaniment Arrangement

no code implementations28 Dec 2018 Ziyu Wang, Gus Xia

Second, the melody generation model generates the lead melody and other voices (melody lines) of the accompaniment using seasonal ARMA (Autoregressive Moving Average) processes.

The Effect of Explicit Structure Encoding of Deep Neural Networks for Symbolic Music Generation

1 code implementation20 Nov 2018 Ke Chen, Weilin Zhang, Shlomo Dubnov, Gus Xia, Wei Li

With recent breakthroughs in artificial neural networks, deep generative models have become one of the leading techniques for computational creativity.

Music Generation

Melodic Phrase Segmentation By Deep Neural Networks

no code implementations14 Nov 2018 Yixing Guan, Jinyu Zhao, Yiqin Qiu, Zheng Zhang, Gus Xia

Automated melodic phrase detection and segmentation is a classical task in content-based music information retrieval and also the key towards automated music structure analysis.

Information Retrieval Music Information Retrieval +2

Cannot find the paper you are looking for? You can Submit a new open access paper.