Search Results for author: Kunpeng Liu

Found 37 papers, 9 papers with code

LEKA:LLM-Enhanced Knowledge Augmentation

no code implementations29 Jan 2025 Xinhao Zhang, Jinghan Zhang, Fengran Mo, Dongjie Wang, Yanjie Fu, Kunpeng Liu

Therefore, we design a knowledge augmentation method LEKA for knowledge transfer that actively searches for suitable knowledge sources that can enrich the target domain's knowledge.

Decision Making Transfer Learning

Iterative Feature Space Optimization through Incremental Adaptive Evaluation

no code implementations24 Jan 2025 Yanping Wu, Yanyong Huang, Zhengzhang Chen, Zijun Yao, Yanjie Fu, Kunpeng Liu, Xiao Luo, Dongjie Wang

We propose a weighted-sharing multi-head attention mechanism to encode key characteristics of the feature space into an embedding vector for evaluation.

Scoring with Large Language Models: A Study on Measuring Empathy of Responses in Dialogues

1 code implementation28 Dec 2024 Henry J. Xie, Jinghan Zhang, Xinhao Zhang, Kunpeng Liu

We develop a novel and comprehensive framework for investigating how effective LLMs are at measuring and scoring empathy of responses in dialogues, and what methods can be employed to deepen our understanding of LLM scoring.

feature selection

Enhancing Risk Assessment in Transformers with Loss-at-Risk Functions

no code implementations4 Nov 2024 Jinghan Zhang, Henry Xie, Xinhao Zhang, Kunpeng Liu

In the financial field, precise risk assessment tools are essential for decision-making.

Decision Making

Dynamic Weight Adjusting Deep Q-Networks for Real-Time Environmental Adaptation

no code implementations4 Nov 2024 Xinhao Zhang, Jinghan Zhang, Wujun Si, Kunpeng Liu

Deep Reinforcement Learning has shown excellent performance in generating efficient solutions for complex tasks.

Deep Reinforcement Learning

Thought Space Explorer: Navigating and Expanding Thought Space for Large Language Model Reasoning

no code implementations31 Oct 2024 Jinghan Zhang, Fengran Mo, Xiting Wang, Kunpeng Liu

Recent advances in large language models (LLMs) have demonstrated their potential in handling complex reasoning tasks, which are usually achieved by constructing a thought chain to guide the model to solve the problem with multi-step thinking.

Language Modeling Language Modelling +1

Enhanced Gene Selection in Single-Cell Genomics: Pre-Filtering Synergy and Reinforced Optimization

no code implementations11 Jun 2024 Weiliang Zhang, Zhen Meng, Dongjie Wang, Min Wu, Kunpeng Liu, Yuanchun Zhou, Meng Xiao

In this study, we introduce an iterative gene panel selection strategy that is applicable to clustering tasks in single-cell genomics.

Reinforcement Learning (RL)

Prototypical Reward Network for Data-Efficient RLHF

no code implementations6 Jun 2024 Jinghan Zhang, Xiting Wang, Yiqiao Jin, Changyu Chen, Xinhao Zhang, Kunpeng Liu

The reward model for Reinforcement Learning from Human Feedback (RLHF) has proven effective in fine-tuning Large Language Models (LLMs).

RATT: A Thought Structure for Coherent and Correct LLM Reasoning

1 code implementation4 Jun 2024 Jinghan Zhang, Xiting Wang, Weijieying Ren, Lu Jiang, Dongjie Wang, Kunpeng Liu

To address these limitations, we introduce the Retrieval Augmented Thought Tree (RATT), a novel thought structure that considers both overall logical soundness and factual correctness at each step of the thinking process.

Decision Making Fact Checking +2

Dynamic and Adaptive Feature Generation with LLM

no code implementations4 Jun 2024 Xinhao Zhang, Jinghan Zhang, Banafsheh Rekabdar, Yuanchun Zhou, Pengfei Wang, Kunpeng Liu

The representation of feature space is a crucial environment where data points get vectorized and embedded for upcoming modeling.

Automated Feature Engineering Feature Engineering

A Comprehensive Survey on Data Augmentation

no code implementations15 May 2024 Zaitian Wang, Pengfei Wang, Kunpeng Liu, Pengyang Wang, Yanjie Fu, Chang-Tien Lu, Charu C. Aggarwal, Jian Pei, Yuanchun Zhou

Existing literature surveys only focus on a certain type of specific modality data, and categorize these methods from modality-specific and operation-centric perspectives, which lacks a consistent summary of data augmentation methods across multiple modalities and limits the comprehension of how existing data samples serve the data augmentation process.

Data Augmentation Survey

TFWT: Tabular Feature Weighting with Transformer

no code implementations14 May 2024 Xinhao Zhang, Zaitian Wang, Lu Jiang, Wanfu Gao, Pengfei Wang, Kunpeng Liu

In this paper, we propose a novel feature weighting method to address the limitation of existing feature processing methods for tabular data.

Feature Interaction Aware Automated Data Representation Transformation

1 code implementation29 Sep 2023 Ehtesamul Azim, Dongjie Wang, Kunpeng Liu, Wei zhang, Yanjie Fu

Creating an effective representation space is crucial for mitigating the curse of dimensionality, enhancing model generalization, addressing data sparsity, and leveraging classical models more effectively.

Automated Feature Engineering Decision Making +4

Self-optimizing Feature Generation via Categorical Hashing Representation and Hierarchical Reinforcement Crossing

1 code implementation8 Sep 2023 Wangyang Ying, Dongjie Wang, Kunpeng Liu, Leilei Sun, Yanjie Fu

Feature generation aims to generate new and meaningful features to create a discriminative representation space. A generated feature is meaningful when the generated feature is from a feature pair with inherent feature interaction.

Descriptive

T-SaS: Toward Shift-aware Dynamic Adaptation for Streaming Data

no code implementations5 Sep 2023 Weijieying Ren, Tianxiang Zhao, Wei Qin, Kunpeng Liu

Discovering the shifted behaviors and the evolving patterns underlying the streaming data are important to understand the dynamic system.

Traceable Group-Wise Self-Optimizing Feature Transformation Learning: A Dual Optimization Perspective

1 code implementation29 Jun 2023 Meng Xiao, Dongjie Wang, Min Wu, Kunpeng Liu, Hui Xiong, Yuanchun Zhou, Yanjie Fu

Feature transformation aims to reconstruct an effective representation space by mathematically refining the existing features.

Feature Engineering Q-Learning

MEGA-DAgger: Imitation Learning with Multiple Imperfect Experts

1 code implementation1 Mar 2023 Xiatao Sun, Shuo Yang, Mingyan Zhou, Kunpeng Liu, Rahul Mangharam

In this paper, we propose MEGA-DAgger, a new DAgger variant that is suitable for interactive learning with multiple imperfect experts.

Autonomous Racing Imitation Learning

A Counterfactual Collaborative Session-based Recommender System

1 code implementation31 Jan 2023 Wenzhuo Song, Shoujin Wang, Yan Wang, Kunpeng Liu, Xueyan Liu, Minghao Yin

Next, COCO-SBRS adopts counterfactual inference to recommend items based on the outputs of the pre-trained recommendation model considering the causalities to alleviate the data sparsity problem.

counterfactual Counterfactual Inference +1

Traceable Automatic Feature Transformation via Cascading Actor-Critic Agents

1 code implementation27 Dec 2022 Meng Xiao, Dongjie Wang, Min Wu, Ziyue Qiao, Pengfei Wang, Kunpeng Liu, Yuanchun Zhou, Yanjie Fu

Feature transformation for AI is an essential task to boost the effectiveness and interpretability of machine learning (ML).

feature selection

Mitigating Popularity Bias in Recommendation with Unbalanced Interactions: A Gradient Perspective

no code implementations31 Oct 2022 Weijieying Ren, Lei Wang, Kunpeng Liu, Ruocheng Guo, Lim Ee Peng, Yanjie Fu

We present a gradient perspective to understand two negative impacts of popularity bias in recommendation model optimization: (i) the gradient direction of popular item embeddings is closer to that of positive interactions, and (ii) the magnitude of positive gradient for popular items are much greater than that of unpopular items.

Model Optimization Recommendation Systems

Automated Urban Planning aware Spatial Hierarchies and Human Instructions

no code implementations26 Sep 2022 Dongjie Wang, Kunpeng Liu, Yanyong Huang, Leilei Sun, Bowen Du, Yanjie Fu

While automated urban planners have been examined, they are constrained because of the following: 1) neglecting human requirements in urban planning; 2) omitting spatial hierarchies in urban planning, and 3) lacking numerous urban plan data samples.

Decoder

Self-Optimizing Feature Transformation

no code implementations16 Sep 2022 Meng Xiao, Dongjie Wang, Min Wu, Kunpeng Liu, Hui Xiong, Yuanchun Zhou, Yanjie Fu

Feature transformation aims to extract a good representation (feature) space by mathematically transforming existing features.

Feature Engineering Outlier Detection

Group-wise Reinforcement Feature Generation for Optimal and Explainable Representation Space Reconstruction

no code implementations28 May 2022 Dongjie Wang, Yanjie Fu, Kunpeng Liu, Xiaolin Li, Yan Solihin

We reformulate representation space reconstruction into an interactive process of nested feature generation and selection, where feature generation is to generate new meaningful and explicit features, and feature selection is to eliminate redundant features to control feature sizes.

Feature Engineering feature selection +1

Reinforced Imitative Graph Learning for Mobile User Profiling

no code implementations13 Mar 2022 Dongjie Wang, Pengyang Wang, Yanjie Fu, Kunpeng Liu, Hui Xiong, Charles E. Hughes

The profiling framework is formulated into a reinforcement learning task, where an agent is a next-visit planner, an action is a POI that a user will visit next, and the state of the environment is a fused representation of a user and spatial entities.

Graph Learning

Online POI Recommendation: Learning Dynamic Geo-Human Interactions in Streams

no code implementations19 Jan 2022 Dongjie Wang, Kunpeng Liu, Hui Xiong, Yanjie Fu

An event that a user visits a POI in stream updates the states of both users and geospatial contexts; the agent perceives the updated environment state to make online recommendations.

reinforcement-learning Reinforcement Learning +1

Deep Human-guided Conditional Variational Generative Modeling for Automated Urban Planning

no code implementations12 Oct 2021 Dongjie Wang, Kunpeng Liu, Pauline Johnson, Leilei Sun, Bowen Du, Yanjie Fu

Existing studies usually ignore the need of personalized human guidance in planning, and spatial hierarchical structure in planning generation.

Decoder Image Generation

Efficient Reinforced Feature Selection via Early Stopping Traverse Strategy

no code implementations29 Sep 2021 Kunpeng Liu, Pengfei Wang, Dongjie Wang, Wan Du, Dapeng Oliver Wu, Yanjie Fu

In this paper, we propose a single-agent Monte Carlo based reinforced feature selection (MCRFS) method, as well as two efficiency improvement strategies, i. e., early stopping (ES) strategy and reward-level interactive (RI) strategy.

feature selection

Automated Feature-Topic Pairing: Aligning Semantic and Embedding Spaces in Spatial Representation Learning

no code implementations22 Sep 2021 Dongjie Wang, Kunpeng Liu, David Mohaisen, Pengyang Wang, Chang-Tien Lu, Yanjie Fu

Texts of spatial entities, on the other hand, provide semantic understanding of latent feature labels, but is insensible to deep SRL models.

Representation Learning

Interactive Reinforcement Learning for Feature Selection with Decision Tree in the Loop

no code implementations2 Oct 2020 Wei Fan, Kunpeng Liu, Hao liu, Yong Ge, Hui Xiong, Yanjie Fu

In this journal version, we propose a novel interactive and closed-loop architecture to simultaneously model interactive reinforcement learning (IRL) and decision tree feedback (DTF).

Feature Importance feature selection +2

Simplifying Reinforced Feature Selection via Restructured Choice Strategy of Single Agent

no code implementations19 Sep 2020 Xiaosa Zhao, Kunpeng Liu, Wei Fan, Lu Jiang, Xiaowei Zhao, Minghao Yin, Yanjie Fu

To address the question, we develop a single-agent reinforced feature selection approach integrated with restructured choice strategy.

feature selection

Cannot find the paper you are looking for? You can Submit a new open access paper.