no code implementations • 17 Sep 2024 • Yongjing Yin, Junran Ding, Kai Song, Yue Zhang
In this paper, we introduce Semformer, a novel method of training a Transformer language model that explicitly models the semantic planning of response.
2 code implementations • 14 Mar 2024 • Yongyu Mu, Peinan Feng, Zhiquan Cao, Yuzhang Wu, Bei Li, Chenglong Wang, Tong Xiao, Kai Song, Tongran Liu, Chunliang Zhang, Jingbo Zhu
In this study, we reveal an in-context learning (ICL) capability of multilingual large language models (LLMs): by translating the input to several languages, we provide Parallel Input in Multiple Languages (PiM) to LLMs, which significantly enhances their comprehension abilities.
no code implementations • 14 Mar 2024 • Yinggui Wang, Yuanqing Huang, Jianshu Li, Le Yang, Kai Song, Lei Wang
Specifically, face images are masked in the frequency domain using an adaptive MixUp strategy.
no code implementations • 11 Feb 2024 • Chao Wang, Zhuo Chen, Ziyan Zhang, Chiyi Li, Kai Song
In this paper, we address the challenge of learning with limited fault data for power transformers.
no code implementations • 25 Oct 2023 • Kai Song, Yaoxing Bian, Ku Wu, Hongrui Liu, Shuangping Han, Jiaming Li, Jiazhao Tian, Chengbin Qin, Jianyong Hu, Liantuan Xiao
Single-pixel imaging can collect images at the wavelengths outside the reach of conventional focal plane array detectors.
no code implementations • 3 Jul 2023 • Yueen Ma, Dafeng Chi, Jingjing Li, Kai Song, Yuzheng Zhuang, Irwin King
The natural language generation domain has witnessed great success thanks to Transformer models.
no code implementations • 8 Apr 2023 • Kai Song, Shaofeng Wang, Ziwei Xie, Shanyu Wang, Jiahong Li, Yongqiang Yang
In the offline stage, to construct the graph, user IDs and specific side information combinations of the shows are chosen to be the nodes, and click/co-click relations and view time are used to build the edges.
no code implementations • 22 Mar 2022 • Kai Song, Biqian Feng, Yongpeng Wu, Wenjun Zhang
Finally, with our work, a PLC network based on E-PMAC mechanism can be realized.
1 code implementation • 10 Dec 2019 • Shuaicheng Liu, Zehao Zhang, Kai Song, Bing Zeng
The unprecedented performance achieved by deep convolutional neural networks for image classification is linked primarily to their ability of capturing rich structural features at various layers within networks.
1 code implementation • NAACL 2019 • Kai Song, Yue Zhang, Heng Yu, Weihua Luo, Kun Wang, Min Zhang
Leveraging user-provided translation to constrain NMT has practical significance.
no code implementations • WS 2018 • Yongchao Deng, Shanbo Cheng, Jun Lu, Kai Song, Jingang Wang, Shenglan Wu, Liang Yao, Guchun Zhang, Haibo Zhang, Pei Zhang, Changfeng Zhu, Boxing Chen
We participated in 5 translation directions including English ↔ Russian, English ↔ Turkish in both directions and English → Chinese.
no code implementations • 11 Jan 2018 • Kai Song, Yue Zhang, Min Zhang, Weihua Luo
Neural machine translation (NMT) suffers a performance deficiency when a limited vocabulary fails to cover the source or target side adequately, which happens frequently when dealing with morphologically rich languages.