Search Results for author: Xuying Meng

Found 13 papers, 2 papers with code

Not all Layers of LLMs are Necessary during Inference

no code implementations4 Mar 2024 Siqi Fan, Xin Jiang, Xiang Li, Xuying Meng, Peng Han, Shuo Shang, Aixin Sun, Yequan Wang, Zhongyuan Wang

To answer this question, we first indicate that Not all Layers are Necessary during Inference by statistically analyzing the activated layers across tasks.

In-Context Learning

Spectral-Based Graph Neural Networks for Complementary Item Recommendation

no code implementations4 Jan 2024 Haitong Luo, Xuying Meng, Suhang Wang, Hanyun Cao, Weiyao Zhang, Yequan Wang, Yujun Zhang

In this study, we present a novel approach called Spectral-based Complementary Graph Neural Networks (SComGNN) that utilizes the spectral properties of complementary item graphs.

Attribute Recommendation Systems

Self-supervised Multi-view Clustering in Computer Vision: A Survey

no code implementations18 Sep 2023 Jiatai Wang, Zhiwei Xu, Xuewen Yang, Hailong Li, Bo Li, Xuying Meng

However, as contrastive learning continues to evolve within the field of computer vision, self-supervised learning has also made substantial research progress and is progressively becoming dominant in MVC methods.

Clustering Contrastive Learning +3

FLM-101B: An Open LLM and How to Train It with $100K Budget

no code implementations7 Sep 2023 Xiang Li, Yiqun Yao, Xin Jiang, Xuezhi Fang, Xuying Meng, Siqi Fan, Peng Han, Jing Li, Li Du, Bowen Qin, Zheng Zhang, Aixin Sun, Yequan Wang

We demonstrate that a 101B-parameter LLM with 0. 31T tokens can be trained with a budget of 100K US dollars.

Memorization

FreeLM: Fine-Tuning-Free Language Model

no code implementations2 May 2023 Xiang Li, Xin Jiang, Xuying Meng, Aixin Sun, Yequan Wang

FreeLM outperforms large models e. g., GPT-3 and InstructGPT, on a range of language understanding tasks in experiments.

Language Modelling

NetGPT: Generative Pretrained Transformer for Network Traffic

no code implementations19 Apr 2023 Xuying Meng, Chungang Lin, Yequan Wang, Yujun Zhang

Pretrained models for network traffic can utilize large-scale raw data to learn the essential characteristics of network traffic, and generate distinguishable results for input traffic without considering specific downstream tasks.

Scheduling Traffic Classification

GCRE-GPT: A Generative Model for Comparative Relation Extraction

no code implementations15 Mar 2023 Yequan Wang, Hengran Zhang, Aixin Sun, Xuying Meng

Given comparative text, comparative relation extraction aims to extract two targets (\eg two cameras) in comparison and the aspect they are compared for (\eg image quality).

Relation Relation Extraction

PoKE: Prior Knowledge Enhanced Emotional Support Conversation with Latent Variable

no code implementations23 Oct 2022 Xiaohan Xu, Xuying Meng, Yequan Wang

Further experiments prove that abundant prior knowledge is conducive to high-quality emotional support, and a well-learned latent variable is critical to the diversity of generations.

Perplexity from PLM Is Unreliable for Evaluating Text Quality

no code implementations12 Oct 2022 Yequan Wang, Jiawen Deng, Aixin Sun, Xuying Meng

Recently, amounts of works utilize perplexity~(PPL) to evaluate the quality of the generated text.

Common Sense Reasoning

CofeNet: Context and Former-Label Enhanced Net for Complicated Quotation Extraction

1 code implementation COLING 2022 Yequan Wang, Xiang Li, Aixin Sun, Xuying Meng, Huaming Liao, Jiafeng Guo

CofeNet is able to extract complicated quotations with components of variable lengths and complicated structures.

Chat-Capsule: A Hierarchical Capsule for Dialog-level Emotion Analysis

no code implementations23 Mar 2022 Yequan Wang, Xuying Meng, Yiyi Liu, Aixin Sun, Yao Wang, Yinhe Zheng, Minlie Huang

These models hence are not optimized for dialog-level emotion detection, i. e. to predict the emotion category of a dialog as a whole.

Emotion Recognition

Peeking the Impact of Points of Interests on Didi

no code implementations6 Apr 2018 Yonghong Tian, Zeyu Li, Zhiwei Xu, Xuying Meng, Bing Zheng

Recently, the online car-hailing service, Didi, has emerged as a leader in the sharing economy.

Cannot find the paper you are looking for? You can Submit a new open access paper.