Search Results for author: Shiqi Shen

Found 13 papers, 8 papers with code

GNNs-to-MLPs by Teacher Injection and Dirichlet Energy Distillation

no code implementations15 Dec 2024 Ziang Zhou, Zhihao Ding, Jieming Shi, Qing Li, Shiqi Shen

Moreover, we observe that in a GNN layer, FT and GP operations often have opposing smoothing effects: GP is aggressive, while FT is conservative, in smoothing.

Node Classification

Super(ficial)-alignment: Strong Models May Deceive Weak Models in Weak-to-Strong Generalization

1 code implementation17 Jun 2024 Wenkai Yang, Shiqi Shen, Guangyao Shen, Wei Yao, Yong liu, Zhi Gong, Yankai Lin, Ji-Rong Wen

However, we are concerned that behind such a promising phenomenon, whether there exists an issue of weak-to-strong deception, where strong models deceive weak models by exhibiting well-aligned in areas known to weak models but producing misaligned behaviors in cases weak models do not know.

Unsupervised Graph Neural Architecture Search with Disentangled Self-supervision

no code implementations NeurIPS 2023 Zeyang Zhang, Xin Wang, Ziwei Zhang, Guangyao Shen, Shiqi Shen, Wenwu Zhu

To address the challenge, we propose a novel Disentangled Self-supervised Graph Neural Architecture Search (DSGAS) model, which is able to discover the optimal architectures capturing various latent graph factors in a self-supervised fashion based on unlabeled graph data.

Disentanglement Neural Architecture Search

SGOOD: Substructure-enhanced Graph-Level Out-of-Distribution Detection

1 code implementation16 Oct 2023 Zhihao Ding, Jieming Shi, Shiqi Shen, Xuequn Shang, Jiannong Cao, Zhipeng Wang, Zhi Gong

We find that substructure differences commonly exist between ID and OOD graphs, and design SGOOD with a series of techniques to encode task-agnostic substructures for effective OOD detection.

Out-of-Distribution Detection Representation Learning

Membership Inference Attacks and Generalization: A Causal Perspective

1 code implementation18 Sep 2022 Teodora Baluta, Shiqi Shen, S. Hitarth, Shruti Tople, Prateek Saxena

Our causal models also show a new connection between generalization and MI attacks via their shared causal factors.

THUMT: An Open Source Toolkit for Neural Machine Translation

6 code implementations20 Jun 2017 Jiacheng Zhang, Yanzhuo Ding, Shiqi Shen, Yong Cheng, Maosong Sun, Huanbo Luan, Yang Liu

This paper introduces THUMT, an open-source toolkit for neural machine translation (NMT) developed by the Natural Language Processing Group at Tsinghua University.

Decoder Machine Translation +2

Neural Headline Generation with Sentence-wise Optimization

no code implementations7 Apr 2016 Ayana, Shiqi Shen, Yu Zhao, Zhiyuan Liu, Maosong Sun

Recently, neural models have been proposed for headline generation by learning to map documents to headlines with recurrent neural networks.

Headline Generation Sentence

Cannot find the paper you are looking for? You can Submit a new open access paper.