Search Results for author: Victor S. Sheng

Found 28 papers, 9 papers with code

Token2Wave

no code implementations11 Nov 2024 Xin Zhang, Victor S. Sheng

This paper provides an in-depth analysis of Token2Wave, a novel token representation method derived from the Wave Network, designed to capture both global and local semantics of input text through wave-inspired complex vectors.

Language Modelling

Bridging the Gap: Representation Spaces in Neuro-Symbolic AI

no code implementations7 Nov 2024 Xin Zhang, Victor S. Sheng

Neuro-symbolic AI is an effective method for improving the overall performance of AI models by combining the advantages of neural networks and symbolic learning.

Neuro-Symbolic AI: Explainability, Challenges, and Future Trends

no code implementations7 Nov 2024 Xin Zhang, Victor S. Sheng

Explainability is an essential reason limiting the application of neural networks in many vital fields.

Wave Network: An Ultra-Small Language Model

no code implementations4 Nov 2024 Xin Zhang, Victor S. Sheng

We propose an innovative token representation and update method in a new ultra-small language model: the Wave network.

Language Modelling text-classification +1

Logic Error Localization in Student Programming Assignments Using Pseudocode and Graph Neural Networks

no code implementations11 Oct 2024 Zhenyu Xu, Kun Zhang, Victor S. Sheng

Additionally, we have devised a method to efficiently gather logic-error-prone programs during the syntax error correction process and compile these into a dataset that includes single and multiple line logic errors, complete with indices of the erroneous lines.

Graph Neural Network

LecPrompt: A Prompt-based Approach for Logical Error Correction with CodeBERT

no code implementations10 Oct 2024 Zhenyu Xu, Victor S. Sheng

In this paper, we introduce LecPrompt to localize and repair logical errors, an prompt-based approach that harnesses the capabilities of CodeBERT, a transformer-based large language model trained on code.

Language Modelling Large Language Model +1

Signal Watermark on Large Language Models

1 code implementation9 Oct 2024 Zhenyu Xu, Victor S. Sheng

As Large Language Models (LLMs) become increasingly sophisticated, they raise significant security concerns, including the creation of fake news and academic misuse.

Text Generation

FreqMark: Frequency-Based Watermark for Sentence-Level Detection of LLM-Generated Text

no code implementations9 Oct 2024 Zhenyu Xu, Kun Zhang, Victor S. Sheng

The increasing use of Large Language Models (LLMs) for generating highly coherent and contextually relevant text introduces new risks, including misuse for unethical purposes such as disinformation or academic dishonesty.

Sentence

Multi-Task Program Error Repair and Explanatory Diagnosis

no code implementations9 Oct 2024 Zhenyu Xu, Victor S. Sheng

And program error diagnosis can often be too abstract or technical for developers to understand, especially for beginners.

Graph Neural Network Language Modelling

Federated Learning of Large Language Models with Parameter-Efficient Prompt Tuning and Adaptive Optimization

1 code implementation23 Oct 2023 Tianshi Che, Ji Liu, Yang Zhou, Jiaxiang Ren, Jiwen Zhou, Victor S. Sheng, Huaiyu Dai, Dejing Dou

This paper proposes a Parameter-efficient prompt Tuning approach with Adaptive Optimization, i. e., FedPepTAO, to enable efficient and effective FL of LLMs.

Federated Learning

Intent Contrastive Learning with Cross Subsequences for Sequential Recommendation

1 code implementation22 Oct 2023 Xiuyuan Qin, Huanhuan Yuan, Pengpeng Zhao, Guanfeng Liu, Fuzhen Zhuang, Victor S. Sheng

In this paper, Intent contrastive learning with Cross Subsequences for sequential Recommendation (ICSRec) is proposed to model users' latent intentions.

Contrastive Learning Data Augmentation +1

Meta-optimized Joint Generative and Contrastive Learning for Sequential Recommendation

no code implementations21 Oct 2023 Yongjing Hao, Pengpeng Zhao, Junhua Fang, Jianfeng Qu, Guanfeng Liu, Fuzhen Zhuang, Victor S. Sheng, Xiaofang Zhou

In this paper, we propose a Meta-optimized Seq2Seq Generator and Contrastive Learning (Meta-SGCL) for sequential recommendation, which applies the meta-optimized two-step training strategy to adaptive generate contrastive views.

Contrastive Learning Sequential Recommendation

Contrastive Enhanced Slide Filter Mixer for Sequential Recommendation

1 code implementation7 May 2023 Xinyu Du, Huanhuan Yuan, Pengpeng Zhao, Junhua Fang, Guanfeng Liu, Yanchi Liu, Victor S. Sheng, Xiaofang Zhou

Sequential recommendation (SR) aims to model user preferences by capturing behavior patterns from their item historical interaction data.

Contrastive Learning Sequential Recommendation

Ensemble Modeling with Contrastive Knowledge Distillation for Sequential Recommendation

1 code implementation28 Apr 2023 Hanwen Du, Huanhuan Yuan, Pengpeng Zhao, Fuzhen Zhuang, Guanfeng Liu, Lei Zhao, Victor S. Sheng

Our framework adopts multiple parallel networks as an ensemble of sequence encoders and recommends items based on the output distributions of all these networks.

Attribute Contrastive Learning +3

Sequential Recommendation with Probabilistic Logical Reasoning

1 code implementation22 Apr 2023 Huanhuan Yuan, Pengpeng Zhao, Xuefeng Xian, Guanfeng Liu, Victor S. Sheng, Lei Zhao

To better capture the uncertainty and evolution of user tastes, SR-PLR embeds users and items with a probabilistic method and conducts probabilistic logical reasoning on users' interaction patterns.

Logical Reasoning Sequential Recommendation

Frequency Enhanced Hybrid Attention Network for Sequential Recommendation

1 code implementation18 Apr 2023 Xinyu Du, Huanhuan Yuan, Pengpeng Zhao, Jianfeng Qu, Fuzhen Zhuang, Guanfeng Liu, Victor S. Sheng

However, many recent studies represent that current self-attention based models are low-pass filters and are inadequate to capture high-frequency information.

Contrastive Learning Sequential Recommendation

Privacy-Preserving Representation Learning for Text-Attributed Networks with Simplicial Complexes

no code implementations9 Feb 2023 Huixin Zhan, Victor S. Sheng

Finally, I will study a privacy-preserving deterministic differentially private alternating direction method of multiplier to learn secure representation outputs from SNNs that capture multi-scale relationships and facilitate the passage from local structure to global invariant features on text-attributed networks.

Graph Reconstruction Inference Attack +4

Measuring the Privacy Leakage via Graph Reconstruction Attacks on Simplicial Neural Networks (Student Abstract)

no code implementations8 Feb 2023 Huixin Zhan, Kun Zhang, Keyi Lu, Victor S. Sheng

In this paper, we measure the privacy leakage via studying whether graph representations can be inverted to recover the graph used to generate them via graph reconstruction attack (GRA).

Decoder Graph Attention +3

A Roadmap to Domain Knowledge Integration in Machine Learning

no code implementations12 Dec 2022 Himel Das Gupta, Victor S. Sheng

Many machine learning algorithms have been developed in recent years to enhance the performance of a model in different aspects of artificial intelligence.

Class-attention Video Transformer for Engagement Intensity Prediction

1 code implementation12 Aug 2022 Xusheng Ai, Victor S. Sheng, Chunhua Li, Zhiming Cui

In order to deal with variant-length long videos, prior works extract multi-modal features and fuse them to predict students' engagement intensity.

Knowledge Distillation via Weighted Ensemble of Teaching Assistants

no code implementations23 Jun 2022 Durga Prasad Ganta, Himel Das Gupta, Victor S. Sheng

In this research, we have shown that using multiple teaching assistant models, the student model (the smaller model) can be further improved.

Ensemble Learning Knowledge Distillation

Quaternion-Based Graph Convolution Network for Recommendation

no code implementations20 Nov 2021 Yaxing Fang, Pengpeng Zhao, Guanfeng Liu, Yanchi Liu, Victor S. Sheng, Lei Zhao, Xiaofang Zhou

Graph Convolution Network (GCN) has been widely applied in recommender systems for its representation learning capability on user and item embeddings.

Recommendation Systems Representation Learning

Edge-Enhanced Global Disentangled Graph Neural Network for Sequential Recommendation

no code implementations20 Nov 2021 Yunyi Li, Pengpeng Zhao, Guanfeng Liu, Yanchi Liu, Victor S. Sheng, Jiajie Xu, Xiaofang Zhou

In this paper, we propose an Edge-Enhanced Global Disentangled Graph Neural Network (EGD-GNN) model to capture the relation information between items for global item representation and local user intention learning.

Graph Neural Network Sequential Recommendation

Coarse to Fine: Multi-label Image Classification with Global/Local Attention

no code implementations26 Dec 2020 Fan Lyu, Fuyuan Hu, Victor S. Sheng, Zhengtian Wu, Qiming Fu, Baochuan Fu

Since multi-label image classification is very complicated, people seek to use the attention mechanism to guide the classification process.

General Classification Multi-Label Image Classification

Deep Cross Networks with Aesthetic Preference for Cross-domain Recommendation

no code implementations29 May 2019 Jian Liu, Pengpeng Zhao, Yanchi Liu, Victor S. Sheng, Fuzheng Zhuang, Jiajie Xu, Xiaofang Zhou, Hui Xiong

Then, we integrate the aesthetic features into a cross-domain network to transfer users' domain independent aesthetic preferences.

Transfer Learning

Where to Go Next: A Spatio-temporal LSTM model for Next POI Recommendation

no code implementations18 Jun 2018 Pengpeng Zhao, Haifeng Zhu, Yanchi Liu, Zhixu Li, Jiajie Xu, Victor S. Sheng

Furthermore, to reduce the number of parameters and improve efficiency, we further integrate coupled input and forget gates with our proposed model.

Sequential Recommendation

Cannot find the paper you are looking for? You can Submit a new open access paper.