no code implementations • 29 Feb 2024 • Shangda Wu, Xu Tan, Zili Wang, Rui Wang, Xiaobing Li, Maosong Sun
Traditional deep learning often overlooks bytes, the basic units of the digital world, where all forms of information and operations are encoded and manipulated in binary format.
1 code implementation • 10 May 2022 • Jiafeng Liu, Yuanliang Dong, Zehua Cheng, Xinran Zhang, Xiaobing Li, Feng Yu, Maosong Sun
In this work, we propose a permutation invariant language model, SymphonyNet, as a solution for symbolic symphony music generation.
Ranked #1 on Audio Generation on Symphony music
1 code implementation • 17 Feb 2022 • Shangda Wu, Xiaobing Li, Maosong Sun
Melody harmonization has long been closely associated with chorales composed by Johann Sebastian Bach.
no code implementations • 27 Aug 2021 • Xinran Zhang, Maosong Sun, Jiafeng Liu, Xiaobing Li
We propose nucleus sampling with randomized head (NS-RH) algorithm, which randomizes the high frequency part ("head") of the predicted distribution, in order to emphasize on the "comparatively low frequency" words.
no code implementations • 13 Mar 2021 • Xinran Zhang, Maosong Sun, Jiafeng Liu, Xiaobing Li
In natural language processing (NLP), the semantic similarity task requires large-scale, high-quality human-annotated labels for fine-tuning or evaluation.
no code implementations • 13 Mar 2021 • Xinran Zhang, Maosong Sun, Jiafeng Liu, Xiaobing Li
Traditional stochastic sampling methods only focus on truncating the unreliable "tail" of the distribution, and do not address the "head" part, which we show might contain tedious or even repetitive candidates with high probability that lead to repetition loops.