no code implementations • 11 Nov 2024 • Xin Zhang, Victor S. Sheng
This paper provides an in-depth analysis of Token2Wave, a novel token representation method derived from the Wave Network, designed to capture both global and local semantics of input text through wave-inspired complex vectors.
no code implementations • 7 Nov 2024 • Xin Zhang, Victor S. Sheng
Neuro-symbolic AI is an effective method for improving the overall performance of AI models by combining the advantages of neural networks and symbolic learning.
no code implementations • 7 Nov 2024 • Xin Zhang, Victor S. Sheng
Explainability is an essential reason limiting the application of neural networks in many vital fields.
no code implementations • 4 Nov 2024 • Xin Zhang, Victor S. Sheng
We propose an innovative token representation and update method in a new ultra-small language model: the Wave network.
no code implementations • 11 Oct 2024 • Zhenyu Xu, Kun Zhang, Victor S. Sheng
Additionally, we have devised a method to efficiently gather logic-error-prone programs during the syntax error correction process and compile these into a dataset that includes single and multiple line logic errors, complete with indices of the erroneous lines.
no code implementations • 10 Oct 2024 • Zhenyu Xu, Victor S. Sheng
In this paper, we introduce LecPrompt to localize and repair logical errors, an prompt-based approach that harnesses the capabilities of CodeBERT, a transformer-based large language model trained on code.
1 code implementation • 9 Oct 2024 • Zhenyu Xu, Victor S. Sheng
As Large Language Models (LLMs) become increasingly sophisticated, they raise significant security concerns, including the creation of fake news and academic misuse.
no code implementations • 9 Oct 2024 • Zhenyu Xu, Kun Zhang, Victor S. Sheng
The increasing use of Large Language Models (LLMs) for generating highly coherent and contextually relevant text introduces new risks, including misuse for unethical purposes such as disinformation or academic dishonesty.
no code implementations • 9 Oct 2024 • Zhenyu Xu, Victor S. Sheng
And program error diagnosis can often be too abstract or technical for developers to understand, especially for beginners.
1 code implementation • 23 Oct 2023 • Tianshi Che, Ji Liu, Yang Zhou, Jiaxiang Ren, Jiwen Zhou, Victor S. Sheng, Huaiyu Dai, Dejing Dou
This paper proposes a Parameter-efficient prompt Tuning approach with Adaptive Optimization, i. e., FedPepTAO, to enable efficient and effective FL of LLMs.
1 code implementation • 22 Oct 2023 • Xiuyuan Qin, Huanhuan Yuan, Pengpeng Zhao, Guanfeng Liu, Fuzhen Zhuang, Victor S. Sheng
In this paper, Intent contrastive learning with Cross Subsequences for sequential Recommendation (ICSRec) is proposed to model users' latent intentions.
no code implementations • 21 Oct 2023 • Yongjing Hao, Pengpeng Zhao, Junhua Fang, Jianfeng Qu, Guanfeng Liu, Fuzhen Zhuang, Victor S. Sheng, Xiaofang Zhou
In this paper, we propose a Meta-optimized Seq2Seq Generator and Contrastive Learning (Meta-SGCL) for sequential recommendation, which applies the meta-optimized two-step training strategy to adaptive generate contrastive views.
1 code implementation • 7 May 2023 • Xinyu Du, Huanhuan Yuan, Pengpeng Zhao, Junhua Fang, Guanfeng Liu, Yanchi Liu, Victor S. Sheng, Xiaofang Zhou
Sequential recommendation (SR) aims to model user preferences by capturing behavior patterns from their item historical interaction data.
1 code implementation • 28 Apr 2023 • Hanwen Du, Huanhuan Yuan, Pengpeng Zhao, Fuzhen Zhuang, Guanfeng Liu, Lei Zhao, Victor S. Sheng
Our framework adopts multiple parallel networks as an ensemble of sequence encoders and recommends items based on the output distributions of all these networks.
1 code implementation • 22 Apr 2023 • Huanhuan Yuan, Pengpeng Zhao, Xuefeng Xian, Guanfeng Liu, Victor S. Sheng, Lei Zhao
To better capture the uncertainty and evolution of user tastes, SR-PLR embeds users and items with a probabilistic method and conducts probabilistic logical reasoning on users' interaction patterns.
1 code implementation • 18 Apr 2023 • Xinyu Du, Huanhuan Yuan, Pengpeng Zhao, Jianfeng Qu, Fuzhen Zhuang, Guanfeng Liu, Victor S. Sheng
However, many recent studies represent that current self-attention based models are low-pass filters and are inadequate to capture high-frequency information.
no code implementations • 9 Feb 2023 • Huixin Zhan, Victor S. Sheng
Finally, I will study a privacy-preserving deterministic differentially private alternating direction method of multiplier to learn secure representation outputs from SNNs that capture multi-scale relationships and facilitate the passage from local structure to global invariant features on text-attributed networks.
no code implementations • 8 Feb 2023 • Huixin Zhan, Kun Zhang, Keyi Lu, Victor S. Sheng
In this paper, we measure the privacy leakage via studying whether graph representations can be inverted to recover the graph used to generate them via graph reconstruction attack (GRA).
no code implementations • 12 Dec 2022 • Himel Das Gupta, Victor S. Sheng
Many machine learning algorithms have been developed in recent years to enhance the performance of a model in different aspects of artificial intelligence.
1 code implementation • 12 Aug 2022 • Xusheng Ai, Victor S. Sheng, Chunhua Li, Zhiming Cui
In order to deal with variant-length long videos, prior works extract multi-modal features and fuse them to predict students' engagement intensity.
1 code implementation • 8 Aug 2022 • Hanwen Du, Hui Shi, Pengpeng Zhao, Deqing Wang, Victor S. Sheng, Yanchi Liu, Guanfeng Liu, Lei Zhao
Contrastive learning with Transformer-based sequence encoder has gained predominance for sequential recommendation.
no code implementations • 23 Jun 2022 • Durga Prasad Ganta, Himel Das Gupta, Victor S. Sheng
In this research, we have shown that using multiple teaching assistant models, the student model (the smaller model) can be further improved.
no code implementations • 21 Apr 2022 • Yongjing Hao, Pengpeng Zhao, Xuefeng Xian, Guanfeng Liu, Deqing Wang, Lei Zhao, Yanchi Liu, Victor S. Sheng
To this end, in this paper, we propose a Learnable Model Augmentation self-supervised learning for sequential Recommendation (LMA4Rec).
no code implementations • 20 Nov 2021 • Yaxing Fang, Pengpeng Zhao, Guanfeng Liu, Yanchi Liu, Victor S. Sheng, Lei Zhao, Xiaofang Zhou
Graph Convolution Network (GCN) has been widely applied in recommender systems for its representation learning capability on user and item embeddings.
no code implementations • 20 Nov 2021 • Yunyi Li, Pengpeng Zhao, Guanfeng Liu, Yanchi Liu, Victor S. Sheng, Jiajie Xu, Xiaofang Zhou
In this paper, we propose an Edge-Enhanced Global Disentangled Graph Neural Network (EGD-GNN) model to capture the relation information between items for global item representation and local user intention learning.
no code implementations • 26 Dec 2020 • Fan Lyu, Fuyuan Hu, Victor S. Sheng, Zhengtian Wu, Qiming Fu, Baochuan Fu
Since multi-label image classification is very complicated, people seek to use the attention mechanism to guide the classification process.
no code implementations • 29 May 2019 • Jian Liu, Pengpeng Zhao, Yanchi Liu, Victor S. Sheng, Fuzheng Zhuang, Jiajie Xu, Xiaofang Zhou, Hui Xiong
Then, we integrate the aesthetic features into a cross-domain network to transfer users' domain independent aesthetic preferences.
no code implementations • 18 Jun 2018 • Pengpeng Zhao, Haifeng Zhu, Yanchi Liu, Zhixu Li, Jiajie Xu, Victor S. Sheng
Furthermore, to reduce the number of parameters and improve efficiency, we further integrate coupled input and forget gates with our proposed model.