Search Results for author: Qingfu Zhang

Found 45 papers, 17 papers with code

Approximation of a Pareto Set Segment Using a Linear Model with Sharing Variables

no code implementations30 Mar 2024 Ping Guo, Qingfu Zhang, Xi Lin

In many real-world applications, the Pareto Set (PS) of a continuous multiobjective optimization problem can be a piecewise continuous manifold.

Multiobjective Optimization

Self-Improved Learning for Scalable Neural Combinatorial Optimization

no code implementations28 Mar 2024 Fu Luo, Xi Lin, Zhenkun Wang, Xialiang Tong, Mingxuan Yuan, Qingfu Zhang

The end-to-end neural combinatorial optimization (NCO) method shows promising performance in solving complex combinatorial optimization problems without the need for expert design.

Combinatorial Optimization

Exploring the Adversarial Frontier: Quantifying Robustness via Adversarial Hypervolume

no code implementations8 Mar 2024 Ping Guo, Cheng Gong, Xi Lin, Zhiyuan Yang, Qingfu Zhang

To address this gap, we propose a new metric termed adversarial hypervolume, assessing the robustness of deep learning models comprehensively over a range of perturbation intensities from a multi-objective optimization standpoint.

Adversarial Robustness Benchmarking

Smooth Tchebycheff Scalarization for Multi-Objective Optimization

no code implementations29 Feb 2024 Xi Lin, Xiaoyuan Zhang, Zhiyuan Yang, Fei Liu, Zhenkun Wang, Qingfu Zhang

Multi-objective optimization problems can be found in many real-world applications, where the objectives often conflict each other and cannot be optimized by a single solution.

valid

Multi-Task Learning for Routing Problem with Cross-Problem Zero-Shot Generalization

1 code implementation23 Feb 2024 Fei Liu, Xi Lin, Zhenkun Wang, Qingfu Zhang, Xialiang Tong, Mingxuan Yuan

The results show that the unified model demonstrates superior performance in the eleven VRPs, reducing the average gap to around 5% from over 20% in the existing approach and achieving a significant performance boost on benchmark datasets as well as a real-world logistics application.

Attribute Combinatorial Optimization +2

UMOEA/D: A Multiobjective Evolutionary Algorithm for Uniform Pareto Objectives based on Decomposition

no code implementations14 Feb 2024 Xiaoyuan Zhang, Xi Lin, Yichi Zhang, Yifan Chen, Qingfu Zhang

Multiobjective optimization (MOO) is prevalent in numerous applications, in which a Pareto front (PF) is constructed to display optima under various preferences.

Multiobjective Optimization

PMGDA: A Preference-based Multiple Gradient Descent Algorithm

no code implementations14 Feb 2024 Xiaoyuan Zhang, Xi Lin, Qingfu Zhang

It is desirable in many multi-objective machine learning applications, such as multi-task learning with conflicting objectives and multi-objective reinforcement learning, to find a Pareto solution that can match a given preference of a decision maker.

Multi-Objective Reinforcement Learning Multi-Task Learning +1

Panacea: Pareto Alignment via Preference Adaptation for LLMs

no code implementations3 Feb 2024 Yifan Zhong, Chengdong Ma, Xiaoyuan Zhang, Ziran Yang, Qingfu Zhang, Siyuan Qi, Yaodong Yang

Our work marks a step forward in effectively and efficiently aligning models to diverse and intricate human preferences in a controllable and Pareto-optimal manner.

Language Modelling Large Language Model

L-AutoDA: Leveraging Large Language Models for Automated Decision-based Adversarial Attacks

1 code implementation27 Jan 2024 Ping Guo, Fei Liu, Xi Lin, Qingchuan Zhao, Qingfu Zhang

In the rapidly evolving field of machine learning, adversarial attacks present a significant challenge to model robustness and security.

Adversarial Attack Computational Efficiency +2

PuriDefense: Randomized Local Implicit Adversarial Purification for Defending Black-box Query-based Attacks

no code implementations19 Jan 2024 Ping Guo, Zhiyuan Yang, Xi Lin, Qingchuan Zhao, Qingfu Zhang

Black-box query-based attacks constitute significant threats to Machine Learning as a Service (MLaaS) systems since they can generate adversarial examples without accessing the target model's architecture and parameters.

Algorithm Evolution Using Large Language Model

2 code implementations26 Nov 2023 Fei Liu, Xialiang Tong, Mingxuan Yuan, Qingfu Zhang

In this paper, we propose a novel approach called Algorithm Evolution using Large Language Model (AEL).

Language Modelling Large Language Model

Evolutionary Pareto Set Learning with Structure Constraints

no code implementations31 Oct 2023 Xi Lin, Xiaoyuan Zhang, Zhiyuan Yang, Qingfu Zhang

In our approach, the Pareto optimality can be traded off with a preferred structure among the whole solution set, which could be crucial for many real-world problems.

Multiobjective Optimization

Large Language Model for Multi-objective Evolutionary Optimization

1 code implementation19 Oct 2023 Fei Liu, Xi Lin, Zhenkun Wang, Shunyu Yao, Xialiang Tong, Mingxuan Yuan, Qingfu Zhang

It is also promising to see the operator only learned from a few instances can have robust generalization performance on unseen problems with quite different patterns and settings.

Evolutionary Algorithms Language Modelling +3

Neural Combinatorial Optimization with Heavy Decoder: Toward Large Scale Generalization

1 code implementation NeurIPS 2023 Fu Luo, Xi Lin, Fei Liu, Qingfu Zhang, Zhenkun Wang

Neural combinatorial optimization (NCO) is a promising learning-based approach for solving challenging combinatorial optimization problems without specialized algorithm design by experts.

Combinatorial Optimization

Continuation Path Learning for Homotopy Optimization

1 code implementation24 Jul 2023 Xi Lin, Zhiyuan Yang, Xiaoyuan Zhang, Qingfu Zhang

Homotopy optimization is a traditional method to deal with a complicated optimization problem by solving a sequence of easy-to-hard surrogate subproblems.

Decision Making

Heuristics for Vehicle Routing Problem: A Survey and Recent Advances

no code implementations1 Mar 2023 Fei Liu, Chengyu Lu, Lin Gui, Qingfu Zhang, Xialiang Tong, Mingxuan Yuan

Vehicle routing is a well-known optimization research topic with significant practical importance.

Pareto Set Learning for Expensive Multi-Objective Optimization

1 code implementation16 Oct 2022 Xi Lin, Zhiyuan Yang, Xiaoyuan Zhang, Qingfu Zhang

This work represents the first attempt to model the Pareto set for expensive multi-objective optimization.

Bayesian Optimization Decision Making

Pareto Set Learning for Neural Multi-objective Combinatorial Optimization

1 code implementation29 Mar 2022 Xi Lin, Zhiyuan Yang, Qingfu Zhang

In this work, we generalize the idea of neural combinatorial optimization, and develop a learning-based approach to approximate the whole Pareto set for a given MOCO problem without further search procedure.

Combinatorial Optimization Traveling Salesman Problem

Template NeRF: Towards Modeling Dense Shape Correspondences from Category-Specific Object Images

no code implementations8 Nov 2021 Jianfei Guo, Zhiyuan Yang, Xi Lin, Qingfu Zhang

By representing object instances within the same category as shape and appearance variation of a shared NeRF template, our proposed method can achieve dense shape correspondences reasoning on images for a wide range of object classes.

3D-Aware Image Synthesis Keypoint Detection

Preference Conditioned Neural Multi-objective Combinatorial Optimization

no code implementations ICLR 2022 Xi Lin, Zhiyuan Yang, Qingfu Zhang

In this work, we generalize the idea of neural combinatorial optimization, and develop a learning-based approach to approximate the whole Pareto set for a given MOCO problem without further search procedure.

Combinatorial Optimization Traveling Salesman Problem

Semantic-embedded Unsupervised Spectral Reconstruction from Single RGB Images in the Wild

1 code implementation ICCV 2021 Zhiyu Zhu, Hui Liu, Junhui Hou, Huanqiang Zeng, Qingfu Zhang

Specifically, on the basis of the intrinsic imaging degradation model of RGB images from HS images, we progressively spread the differences between input RGB images and re-projected RGB images from recovered HS images via effective unsupervised camera spectral response function estimation.

Image Reconstruction Spectral Reconstruction +1

Deep Amended Gradient Descent for Efficient Spectral Reconstruction from Single RGB Images

1 code implementation12 Aug 2021 Zhiyu Zhu, Hui Liu, Junhui Hou, Sen Jia, Qingfu Zhang

Then, we design a lightweight neural network with a multi-stage architecture to mimic the formed amended gradient descent process, in which efficient convolution and novel spectral zero-mean normalization are proposed to effectively extract spatial-spectral features for regressing an initialization, a basic gradient, and an incremental gradient.

Spectral Reconstruction

Crowd Counting via Perspective-Guided Fractional-Dilation Convolution

1 code implementation8 Jul 2021 Zhaoyi Yan, Ruimao Zhang, Hongzhi Zhang, Qingfu Zhang, WangMeng Zuo

One of the main issues in this task is how to handle the dramatic scale variations of pedestrians caused by the perspective effect.

Crowd Counting

Self-supervised Symmetric Nonnegative Matrix Factorization

1 code implementation2 Mar 2021 Yuheng Jia, Hui Liu, Junhui Hou, Sam Kwong, Qingfu Zhang

Inspired by ensemble clustering that aims to seek a better clustering result from a set of clustering results, we propose self-supervised SNMF (S$^3$NMF), which is capable of boosting clustering performance progressively by taking advantage of the sensitivity to initialization characteristic of SNMF, without relying on any additional information.

Clustering

Clustering Ensemble Meets Low-rank Tensor Approximation

1 code implementation16 Dec 2020 Yuheng Jia, Hui Liu, Junhui Hou, Qingfu Zhang

The existing clustering ensemble methods generally construct a co-association matrix, which indicates the pairwise similarity between samples, as the weighted linear combination of the connective matrices from different base clusterings, and the resulting co-association matrix is then adopted as the input of an off-the-shelf clustering algorithm, e. g., spectral clustering.

Clustering Clustering Ensemble

Maximum Entropy Subspace Clustering Network

2 code implementations6 Dec 2020 Zhihao Peng, Yuheng Jia, Hui Liu, Junhui Hou, Qingfu Zhang

Furthermore, we design a novel framework to explicitly decouple the auto-encoder module and the self-expressiveness module.

Clustering

Controllable Pareto Multi-Task Learning

no code implementations13 Oct 2020 Xi Lin, Zhiyuan Yang, Qingfu Zhang, Sam Kwong

With a fixed model capacity, the tasks would be conflicted with each other, and the system usually has to make a trade-off among learning all of them together.

Multiobjective Optimization Multi-Task Learning

Graph Neural Network Encoding for Community Detection in Attribute Networks

1 code implementation6 Jun 2020 Jianyong Sun, Wei Zheng, Qingfu Zhang, Zongben Xu

Based on the new encoding method and the two objectives, a multiobjective evolutionary algorithm (MOEA) based upon NSGA-II, termed as continuous encoding MOEA, is developed for the transformed community detection problem with continuous decision variables.

Attribute Community Detection

Multi-View Spectral Clustering Tailored Tensor Low-Rank Representation

no code implementations30 Apr 2020 Yuheng Jia, Hui Liu, Junhui Hou, Sam Kwong, Qingfu Zhang

On the basis of the novel tensor low-rank norm, we formulate MVSC as a convex low-rank tensor recovery problem, which is then efficiently solved with an augmented Lagrange multiplier based method iteratively.

Clustering

On the Combined Impact of Population Size and Sub-problem Selection in MOEA/D

no code implementations15 Apr 2020 Geoffrey Pruvost, Bilel Derbel, Arnaud Liefooghe, Ke Li, Qingfu Zhang

This paper intends to understand and to improve the working principle of decomposition-based multi-objective evolutionary algorithms.

Evolutionary Algorithms

Pareto Multi-Task Learning

1 code implementation NeurIPS 2019 Xi Lin, Hui-Ling Zhen, Zhenhua Li, Qingfu Zhang, Sam Kwong

Recently, a novel method is proposed to find one single Pareto optimal solution with good trade-off among different tasks by casting multi-task learning as multiobjective optimization.

Multiobjective Optimization Multi-Task Learning

Multi-objectivization Inspired Metaheuristics for the Sum-of-the-Parts Combinatorial Optimization Problems

no code implementations12 Nov 2019 Jialong Shi, Jianyong Sun, Qingfu Zhang

For a sum-of-the-parts combinatorial optimization problem, we propose to decompose its original objective into two sub-objectives with controllable correlation.

Combinatorial Optimization Traveling Salesman Problem

Homotopic Convex Transformation: A New Landscape Smoothing Method for the Traveling Salesman Problem

no code implementations14 May 2019 Jialong Shi, Jianyong Sun, Qingfu Zhang, Kai Ye

We first define the Homotopic Convex (HC) transformation of a TSP as a convex combination of a well-constructed simple TSP and the original TSP.

Traveling Salesman Problem

Nonlinear Collaborative Scheme for Deep Neural Networks

no code implementations4 Nov 2018 Hui-Ling Zhen, Xi Lin, Alan Z. Tang, Zhenhua Li, Qingfu Zhang, Sam Kwong

Different from them, in this paper, we aim to link the generalization ability of a deep network to optimizing a new objective function.

Locating the boundaries of Pareto fronts: A Many-Objective Evolutionary Algorithm Based on Corner Solution Search

no code implementations8 Jun 2018 Xinye Cai, Haoran Sun, Chunyang Zhu, Zhenyu Li, Qingfu Zhang

In this paper, an evolutionary many-objective optimization algorithm based on corner solution search (MaOEA-CS) was proposed.

A Simple Yet Efficient Rank One Update for Covariance Matrix Adaptation

no code implementations11 Oct 2017 Zhenhua Li, Qingfu Zhang

In this paper, we propose an efficient approximated rank one update for covariance matrix adaptation evolution strategy (CMA-ES).

EB-GLS: An Improved Guided Local Search Based on the Big Valley Structure

no code implementations22 Sep 2017 Jialong Shi, Qingfu Zhang, Edward Tsang

EB-GLS records and maintains an elite solution as an estimate of the globally optimal solutions, and reduces the chance of penalizing the features in this solution.

Combinatorial Optimization Traveling Salesman Problem

Push and Pull Search for Solving Constrained Multi-objective Optimization Problems

no code implementations15 Sep 2017 Zhun Fan, Wenji Li, Xinye Cai, Hui Li, Caimin Wei, Qingfu Zhang, Kalyanmoy Deb, Erik D. Goodman

Compared with other CMOEAs, the proposed PPS method can more efficiently get across infeasible regions and converge to the feasible and non-dominated regions by applying push and pull search strategies at different stages.

Evolutionary Multitasking for Multiobjective Continuous Optimization: Benchmark Problems, Performance Metrics and Baseline Results

no code implementations8 Jun 2017 Yuan Yuan, Yew-Soon Ong, Liang Feng, A. K. Qin, Abhishek Gupta, Bingshui Da, Qingfu Zhang, Kay Chen Tan, Yaochu Jin, Hisao Ishibuchi

In this report, we suggest nine test problems for multi-task multi-objective optimization (MTMOO), each of which consists of two multiobjective optimization tasks that need to be solved simultaneously.

Multiobjective Optimization

Evolutionary Many-Objective Optimization Based on Adversarial Decomposition

no code implementations7 Apr 2017 Mengyuan Wu, Ke Li, Sam Kwong, Qingfu Zhang

It decomposes a multi-objective optimization problem into several single-objective optimization subproblems, each of which is usually defined as a scalarizing function using a weight vector.

Difficulty Adjustable and Scalable Constrained Multi-objective Test Problem Toolkit

no code implementations21 Dec 2016 Zhun Fan, Wenji Li, Xinye Cai, Hui Li, Caimin Wei, Qingfu Zhang, Kalyanmoy Deb, Erik D. Goodman

Multi-objective evolutionary algorithms (MOEAs) have progressed significantly in recent decades, but most of them are designed to solve unconstrained multi-objective optimization problems.

Evolutionary Algorithms

Matching-Based Selection with Incomplete Lists for Decomposition Multi-Objective Optimization

no code implementations30 Aug 2016 Mengyuan Wu, Ke Li, Sam Kwong, Yu Zhou, Qingfu Zhang

In particular, the stable matching between subproblems and solutions, which achieves an equilibrium between their mutual preferences, implicitly strikes a balance between the convergence and diversity.

Learning from Non-Stationary Stream Data in Multiobjective Evolutionary Algorithm

no code implementations16 Jun 2016 Jianyong Sun, Hu Zhang, Aimin Zhou, Qingfu Zhang

Evolutionary algorithms (EAs) have been well acknowledged as a promising paradigm for solving optimisation problems with multiple conflicting objectives in the sense that they are able to locate a set of diverse approximations of Pareto optimal solutions in a single run.

Clustering Evolutionary Algorithms

Cannot find the paper you are looking for? You can Submit a new open access paper.