Search Results for author: Wenge Rong

Found 25 papers, 14 papers with code

Disentangling Preference Representation and Text Generation for Efficient Individual Preference Alignment

1 code implementation30 Dec 2024 Jianfei Zhang, Jun Bai, Bei Li, Yanmeng Wang, Rumei Li, Chenghua Lin, Wenge Rong

Aligning Large Language Models (LLMs) with general human preferences has been proved crucial in improving the interaction quality between LLMs and human.

Text Generation

HelloBench: Evaluating Long Text Generation Capabilities of Large Language Models

1 code implementation24 Sep 2024 Haoran Que, Feiyu Duan, Liqun He, Yutao Mou, Wangchunshu Zhou, Jiaheng Liu, Wenge Rong, Zekun Moore Wang, Jian Yang, Ge Zhang, Junran Peng, Zhaoxiang Zhang, Songyang Zhang, Kai Chen

Therefore, we introduce the Hierarchical Long Text Generation Benchmark (HelloBench), a comprehensive, in-the-wild, and open-ended benchmark to evaluate LLMs' performance in generating long text.

Long-Context Understanding Text Generation

Leveraging Estimated Transferability Over Human Intuition for Model Selection in Text Ranking

1 code implementation24 Sep 2024 Jun Bai, Zhuofan Chen, Zhenzi Li, Hanhua Hong, Jianfei Zhang, Chen Li, Chenghua Lin, Wenge Rong

As a promising alternative to human intuition and brute-force fine-tuning, Transferability Estimation (TE) has emerged as an effective approach to model selection.

Model Selection Sentence +1

PFME: A Modular Approach for Fine-grained Hallucination Detection and Editing of Large Language Models

no code implementations29 Jun 2024 Kunquan Deng, Zeyu Huang, Chen Li, Chenghua Lin, Min Gao, Wenge Rong

In editing tasks, PFME further enhances the FActScore of FActScore-Alpaca13B and FActScore-ChatGPT datasets, increasing by 16. 2pp and 4. 6pp, respectively.

Hallucination Sentence

Enhancing 3D Lane Detection and Topology Reasoning with 2D Lane Priors

1 code implementation5 Jun 2024 Han Li, Zehao Huang, Zitian Wang, Wenge Rong, Naiyan Wang, Si Liu

3D lane detection and topology reasoning are essential tasks in autonomous driving scenarios, requiring not only detecting the accurate 3D coordinates on lane lines, but also reasoning the relationship between lanes and traffic elements.

3D Lane Detection Autonomous Driving

Explainable Few-shot Knowledge Tracing

1 code implementation23 May 2024 Haoxuan Li, Jifan Yu, Yuanxin Ouyang, Zhuang Liu, Wenge Rong, Juanzi Li, Zhang Xiong

Knowledge tracing (KT), aiming to mine students' mastery of knowledge by their exercise records and predict their performance on future test questions, is a critical task in educational assessment.

Knowledge Tracing

Wasserstein Dependent Graph Attention Network for Collaborative Filtering with Uncertainty

no code implementations9 Apr 2024 Haoxuan Li, Yuanxin Ouyang, Zhuang Liu, Wenge Rong, Zhang Xiong

Collaborative filtering (CF) is an essential technique in recommender systems that provides personalized recommendations by only leveraging user-item interactions.

Collaborative Filtering Graph Attention +1

A Review of Data Mining in Personalized Education: Current Trends and Future Prospects

no code implementations27 Feb 2024 Zhang Xiong, Haoxuan Li, Zhuang Liu, Zhuofan Chen, Hao Zhou, Wenge Rong, Yuanxin Ouyang

Personalized education, tailored to individual student needs, leverages educational technology and artificial intelligence (AI) in the digital age to enhance learning effectiveness.

cognitive diagnosis Knowledge Tracing

Discovering Sounding Objects by Audio Queries for Audio Visual Segmentation

no code implementations18 Sep 2023 Shaofei Huang, Han Li, Yuqing Wang, Hongji Zhu, Jiao Dai, Jizhong Han, Wenge Rong, Si Liu

Explicit object-level semantic correspondence between audio and visual modalities is established by gathering object information from visual features with predefined audio queries.

Object Semantic correspondence

Evaluating Open-Domain Dialogues in Latent Space with Next Sentence Prediction and Mutual Information

1 code implementation26 May 2023 Kun Zhao, Bohao Yang, Chenghua Lin, Wenge Rong, Aline Villavicencio, Xiaohui Cui

The long-standing one-to-many issue of the open-domain dialogues poses significant challenges for automatic evaluation methods, i. e., there may be multiple suitable responses which differ in semantics for a given conversational context.

Semantic Similarity Semantic Textual Similarity +1

Transformer-Patcher: One Mistake worth One Neuron

1 code implementation24 Jan 2023 Zeyu Huang, Yikang Shen, Xiaofeng Zhang, Jie zhou, Wenge Rong, Zhang Xiong

Our method outperforms previous fine-tuning and HyperNetwork-based methods and achieves state-of-the-art performance for Sequential Model Editing (SME).

Model Editing

Improving Variational Autoencoders with Density Gap-based Regularization

1 code implementation1 Nov 2022 Jianfei Zhang, Jun Bai, Chenghua Lin, Yanmeng Wang, Wenge Rong

There are effective ways proposed to prevent posterior collapse in VAEs, but we observe that they in essence make trade-offs between posterior collapse and hole problem, i. e., mismatch between the aggregated posterior distribution and the prior distribution.

Language Modeling Language Modelling +1

Mixture of Attention Heads: Selecting Attention Heads Per Token

2 code implementations11 Oct 2022 Xiaofeng Zhang, Yikang Shen, Zeyu Huang, Jie zhou, Wenge Rong, Zhang Xiong

This paper proposes the Mixture of Attention Heads (MoA), a new architecture that combines multi-head attention with the MoE mechanism.

Computational Efficiency Language Modeling +3

Causal Intervention for Fairness in Multi-behavior Recommendation

no code implementations10 Sep 2022 Xi Wang, Wenjie Wang, Fuli Feng, Wenge Rong, Chuantao Yin, Zhang Xiong

Specifically, we find that: 1) item popularity is a confounder between the exposed items and users' post-click interactions, leading to the first unfairness; and 2) some hidden confounders (e. g., the reputation of item producers) affect both item popularity and quality, resulting in the second unfairness.

Fairness Recommendation Systems

Query-Response Interactions by Multi-tasks in Semantic Search for Chatbot Candidate Retrieval

no code implementations23 Aug 2022 Libin Shi, Kai Zhang, Wenge Rong

Semantic search for candidate retrieval is an important yet neglected problem in retrieval-based Chatbots, which aims to select a bunch of candidate responses efficiently from a large pool.

Chatbot Retrieval

Enhancing Dual-Encoders with Question and Answer Cross-Embeddings for Answer Retrieval

no code implementations Findings (EMNLP) 2021 Yanmeng Wang, Jun Bai, Ye Wang, Jianfei Zhang, Wenge Rong, Zongcheng Ji, Shaojun Wang, Jing Xiao

To keep independent encoding of questions and answers during inference stage, variational auto-encoder is further introduced to reconstruct answers (questions) from question (answer) embeddings as an auxiliary task to enhance QA interaction in representation learning in training stage.

Question Answering Representation Learning +2

Similarity Based Auxiliary Classifier for Named Entity Recognition

1 code implementation IJCNLP 2019 Shiyuan Xiao, Yuanxin Ouyang, Wenge Rong, Jianxin Yang, Zhang Xiong

The segmentation problem is one of the fundamental challenges associated with name entity recognition (NER) tasks that aim to reduce the boundary error when detecting a sequence of entity words.

named-entity-recognition Named Entity Recognition +3

Sequential Attention with Keyword Mask Model for Community-based Question Answering

1 code implementation NAACL 2019 Jianxin Yang, Wenge Rong, Libin Shi, Zhang Xiong

So the QA pairs capture features and information from both question text and answer text, interacting and improving vector representations iteratively through hops.

Answer Selection

LSDSCC: a Large Scale Domain-Specific Conversational Corpus for Response Generation with Diversity Oriented Evaluation Metrics

no code implementations NAACL 2018 Zhen Xu, Nan Jiang, Bingquan Liu, Wenge Rong, Bowen Wu, Baoxun Wang, Zhuoran Wang, Xiaolong Wang

The experimental results have shown that our proposed corpus can be taken as a new benchmark dataset for the NRG task, and the presented metrics are promising to guide the optimization of NRG models by quantifying the diversity of the generated responses reasonably.

Diversity Machine Translation +1

Word Embedding based Correlation Model for Question/Answer Matching

no code implementations15 Nov 2015 Yikang Shen, Wenge Rong, Nan Jiang, Baolin Peng, Jie Tang, Zhang Xiong

With the development of community based question answering (Q&A) services, a large scale of Q&A archives have been accumulated and are an important information and knowledge resource on the web.

Question Answering Translation

Cannot find the paper you are looking for? You can Submit a new open access paper.