Search Results for author:
Found 12 papers, 8 papers with code
MuChin: A Chinese Colloquial Description Benchmark for Evaluating Language Models in the Field of Music
To this end, we present MuChin, the first open-source music description benchmark in Chinese colloquial language, designed to evaluate the performance of multimodal LLMs in understanding and describing music.
End-to-end Learnable Clustering for Intent Learning in Recommendation
Concretely, we encode users' behavior sequences and initialize the cluster centers (latent intents) as learnable neurons.
MelodyGLM: Multi-task Pre-training for Symbolic Melody Generation
In particular, subjective evaluations show that, on the melody continuation task, MelodyGLM gains average improvements of 0. 82, 0. 87, 0. 78, and 0. 94 in consistency, rhythmicity, structure, and overall quality, respectively.
REMAST: Real-time Emotion-based Music Arrangement with Soft Transition
Music as an emotional intervention medium has important applications in scenarios such as music therapy, games, and movies.
WuYun: Exploring hierarchical skeleton-guided melody generation using knowledge-enhanced deep learning
Although deep learning has revolutionized music generation, existing methods for structured melody generation follow an end-to-end left-to-right note-by-note generative paradigm and treat each note equally.
SongDriver: Real-time Music Accompaniment Generation without Logical Latency nor Exposure Bias
In this paper, we propose SongDriver, a real-time music accompaniment generation system without logical latency nor exposure bias.
Automatic Song Translation for Tonal Languages
This paper develops automatic song translation (AST) for tonal languages and addresses the unique challenge of aligning words' tones with melody of a song in addition to conveying the original meaning.
S3T: Self-Supervised Pre-training with Swin Transformer for Music Classification
To our knowledge, S3T is the first method combining the Swin Transformer with a self-supervised learning method for music classification.
TeleMelody: Lyric-to-Melody Generation with a Template-Based Two-Stage Method
In this paper, we develop TeleMelody, a two-stage lyric-to-melody generation system with music template (e. g., tonality, chord progression, rhythm pattern, and cadence) to bridge the gap between lyrics and melodies (i. e., the system consists of a lyric-to-template module and a template-to-melody module).
PDAugment: Data Augmentation by Pitch and Duration Adjustments for Automatic Lyrics Transcription
Considering that there is a large amount of ASR training data, a straightforward method is to leverage ASR data to enhance ALT training.
Automatic Lyrics Transcription
Automatic Speech Recognition
+3
Denoising Text to Speech with Frame-Level Noise Modeling
In DenoiSpeech, we handle real-world noisy speech by modeling the fine-grained frame-level noise with a noise condition module, which is jointly trained with the TTS model.
A Efficient Multimodal Framework for Large Scale Emotion Recognition by Fusing Music and Electrodermal Activity Signals
In this paper, our work makes an attempt to fuse the subject individual EDA features and the external evoked music features.
