Search Results for author: Shangsong Liang

Found 16 papers, 8 papers with code

Elevating Spectral GNNs through Enhanced Band-pass Filter Approximation

no code implementations15 Apr 2024 Guoming Li, Jian Yang, Shangsong Liang, Dongsheng Luo

Spectral Graph Neural Networks (GNNs) have attracted great attention due to their capacity to capture patterns in the frequency domains with essential graph filters.

Spectral GNN via Two-dimensional (2-D) Graph Convolution

no code implementations6 Apr 2024 Guoming Li, Jian Yang, Shangsong Liang, Dongsheng Luo

Spectral Graph Neural Networks (GNNs) have achieved tremendous success in graph learning.

Graph Learning

Contrastive Continual Learning with Importance Sampling and Prototype-Instance Relation Distillation

1 code implementation7 Mar 2024 Jiyong Li, Dilshod Azizov, Yang Li, Shangsong Liang

Recently, because of the high-quality representations of contrastive learning methods, rehearsal-based contrastive continual learning has been proposed to explore how to continually learn transferable representation embeddings to avoid the catastrophic forgetting issue in traditional continual settings.

Continual Learning Contrastive Learning +2

PASCL: Supervised Contrastive Learning with Perturbative Augmentation for Particle Decay Reconstruction

1 code implementation18 Feb 2024 Junjian Lu, Siwei Liu, Dmitrii Kobylianski, Etienne Dreyer, Eilam Gross, Shangsong Liang

In high-energy physics, particles produced in collision events decay in a format of a hierarchical tree structure, where only the final decay products can be observed using detectors.

Contrastive Learning

CLEX: Continuous Length Extrapolation for Large Language Models

1 code implementation25 Oct 2023 Guanzheng Chen, Xin Li, Zaiqiao Meng, Shangsong Liang, Lidong Bing

We generalise the PE scaling approaches to model the continuous dynamics by ordinary differential equations over the length scaling factor, thereby overcoming the constraints of current PE scaling methods designed for specific lengths.

4k Position

Multimodality Representation Learning: A Survey on Evolution, Pretraining and Its Applications

1 code implementation1 Feb 2023 Muhammad Arslan Manzoor, Sarah Albarri, Ziting Xian, Zaiqiao Meng, Preslav Nakov, Shangsong Liang

This survey presents the comprehensive literature on the evolution and enhancement of deep learning multimodal architectures to deal with textual, visual and audio features for diverse cross-modal and modern multimodal tasks.

Question Answering Representation Learning +3

Knowledge Graph Embedding: A Survey from the Perspective of Representation Spaces

no code implementations7 Nov 2022 Jiahang Cao, Jinyuan Fang, Zaiqiao Meng, Shangsong Liang

Particularly, we build a fine-grained classification to categorise the models based on three mathematical perspectives of the representation spaces: (1) Algebraic perspective, (2) Geometric perspective, and (3) Analytical perspective.

Knowledge Graph Embedding Knowledge Graphs +1

Revisiting Parameter-Efficient Tuning: Are We Really There Yet?

1 code implementation16 Feb 2022 Guanzheng Chen, Fangyu Liu, Zaiqiao Meng, Shangsong Liang

Parameter-Efficient Tuning (PETuning) methods have been deemed by many as the new paradigm for using pretrained language models (PLMs).

Structure-Aware Random Fourier Kernel for Graphs

no code implementations NeurIPS 2021 Jinyuan Fang, Qiang Zhang, Zaiqiao Meng, Shangsong Liang

Gaussian Processes (GPs) define distributions over functions and their generalization capabilities depend heavily on the choice of kernels.

Gaussian Processes Graph Learning +1

Variational Self-attention Model for Sentence Representation

no code implementations30 Dec 2018 Qiang Zhang, Shangsong Liang, Emine Yilmaz

This paper proposes a variational self-attention model (VSAM) that employs variational inference to derive self-attention.

Sentence Stance Detection +1

Neural Variational Hybrid Collaborative Filtering

no code implementations12 Oct 2018 Teng Xiao, Shangsong Liang, Hong Shen, Zaiqiao Meng

Specifically, we consider both the generative processes of users and items, and the prior of latent factors of users and items to be side informationspecific, which enables our model to alleviate matrix sparsity and learn better latent representations of users and items.

Collaborative Filtering Recommendation Systems

Explicit State Tracking with Semi-Supervision for Neural Dialogue Generation

2 code implementations31 Aug 2018 Xisen Jin, Wenqiang Lei, Zhaochun Ren, Hongshen Chen, Shangsong Liang, Yihong Zhao, Dawei Yin

However, the \emph{expensive nature of state labeling} and the \emph{weak interpretability} make the dialogue state tracking a challenging problem for both task-oriented and non-task-oriented dialogue generation: For generating responses in task-oriented dialogues, state tracking is usually learned from manually annotated corpora, where the human annotation is expensive for training; for generating responses in non-task-oriented dialogues, most of existing work neglects the explicit state tracking due to the unlimited number of dialogue states.

Dialogue Generation Dialogue State Tracking

Cannot find the paper you are looking for? You can Submit a new open access paper.