Search Results for author: Yueming Lyu

Found 31 papers, 7 papers with code

Anti-Aesthetics: Protecting Facial Privacy against Customized Text-to-Image Synthesis

no code implementations16 Apr 2025 Songping Wang, Yueming Lyu, Shiqi Liu, Ning li, Tong Tong, Hao Sun, Caifeng Shan

The rise of customized diffusion models has spurred a boom in personalized visual content creation, but also poses risks of malicious misuse, severely threatening personal privacy and copyright protection.

Image Generation

Exploring Adversarial Transferability between Kolmogorov-arnold Networks

no code implementations8 Mar 2025 Songping Wang, Xinquan Yue, Yueming Lyu, Caifeng Shan

To explore this critical safety issue, we conduct an analysis and find that due to overfitting to the specific basis functions of KANs, they possess poor adversarial transferability among different KANs.

Adversarial Robustness Kolmogorov-Arnold Networks

Concept Corrector: Erase concepts on the fly for text-to-image diffusion models

no code implementations22 Feb 2025 Zheling Meng, Bo Peng, Xiaochuan Jin, Yueming Lyu, Wei Wang, Jing Dong

In this paper, motivated by the notion that concept erasure on the output side, i. e. generated images, may be more direct and effective, we propose to check concepts based on intermediate-generated images and correct them in the remainder of the generation process.

Fast Direct: Query-Efficient Online Black-box Guidance for Diffusion-model Target Generation

1 code implementation2 Feb 2025 Kim Yong Tan, Yueming Lyu, Ivor Tsang, Yew-Soon Ong

In this work, we propose a novel and simple algorithm, $\textbf{Fast Direct}$, for query-efficient online black-box target generation.

Drug Discovery Image Generation

Sharpness-Aware Black-Box Optimization

no code implementations16 Oct 2024 Feiyang Ye, Yueming Lyu, Xuehao Wang, Masashi Sugiyama, Yu Zhang, Ivor Tsang

To address those problems in black-box optimization, we propose a novel Sharpness-Aware Black-box Optimization (SABO) algorithm, which applies a sharpness-aware minimization strategy to improve the model generalization.

Diversified Batch Selection for Training Acceleration

1 code implementation7 Jun 2024 Feng Hong, Yueming Lyu, Jiangchao Yao, Ya zhang, Ivor W. Tsang, Yanfeng Wang

The remarkable success of modern machine learning models on large datasets often demands extensive training time and resource consumption.

Diversity

Covariance-Adaptive Sequential Black-box Optimization for Diffusion Targeted Generation

no code implementations2 Jun 2024 Yueming Lyu, Kim Yong Tan, Yew Soon Ong, Ivor W. Tsang

Diffusion models have demonstrated great potential in generating high-quality content for images, natural language, protein domains, etc.

3D Molecule Generation

RS-Corrector: Correcting the Racial Stereotypes in Latent Diffusion Models

no code implementations8 Dec 2023 Yue Jiang, Yueming Lyu, Tianxiang Ma, Bo Peng, Jing Dong

Extensive empirical evaluations demonstrate that the introduced \themodel effectively corrects the racial stereotypes of the well-trained Stable Diffusion model while leaving the original model unchanged.

Image Generation

DeltaSpace: A Semantic-aligned Feature Space for Flexible Text-guided Image Editing

1 code implementation12 Oct 2023 Yueming Lyu, Kang Zhao, Bo Peng, Yue Jiang, Yingya Zhang, Jing Dong

Based on DeltaSpace, we propose a novel framework called DeltaEdit, which maps the CLIP visual feature differences to the latent space directions of a generative model during the training phase, and predicts the latent space directions from the CLIP textual feature differences during the inference phase.

text-guided-image-editing

InfoStyler: Disentanglement Information Bottleneck for Artistic Style Transfer

no code implementations30 Jul 2023 Yueming Lyu, Yue Jiang, Bo Peng, Jing Dong

InfoStyler formulates the disentanglement representation learning as an information compression problem by eliminating style statistics from the content image and removing the content structure from the style image.

Disentanglement Style Transfer

3D-Aware Adversarial Makeup Generation for Facial Privacy Protection

no code implementations26 Jun 2023 Yueming Lyu, Yue Jiang, Ziwen He, Bo Peng, Yunfan Liu, Jing Dong

The privacy and security of face data on social media are facing unprecedented challenges as it is vulnerable to unauthorized access and identification.

Face Recognition Face Verification

Earning Extra Performance from Restrictive Feedbacks

1 code implementation28 Apr 2023 Jing Li, Yuangang Pan, Yueming Lyu, Yinghua Yao, Yulei Sui, Ivor W. Tsang

Unlike existing model tuning methods where the target data is always ready for calculating model gradients, the model providers in EXPECTED only see some feedbacks which could be as simple as scalars, such as inference accuracy or usage rate.

Adversary-Aware Partial label learning with Label distillation

no code implementations2 Apr 2023 Cheng Chen, Yueming Lyu, Ivor W. Tsang

However, conventional partial-label learning (PLL) methods are still vulnerable to the high ratio of noisy partial labels, especially in a large labelling space.

Partial Label Learning

DeltaEdit: Exploring Text-free Training for Text-Driven Image Manipulation

1 code implementation CVPR 2023 Yueming Lyu, Tianwei Lin, Fu Li, Dongliang He, Jing Dong, Tieniu Tan

Our key idea is to investigate and identify a space, namely delta image and text space that has well-aligned distribution between CLIP visual feature differences of two images and CLIP textual embedding differences of source and target texts.

Image Manipulation

DRAN: Detailed Region-Adaptive Normalization for Conditional Image Synthesis

1 code implementation29 Sep 2021 Yueming Lyu, Peibin Chen, Jingna Sun, Bo Peng, Xu Wang, Jing Dong

To evaluate the effectiveness and show the general use of our method, we conduct a set of experiments on makeup transfer and semantic image synthesis.

Facial Makeup Transfer Image Generation +2

Fine-Tuning from Limited Feedbacks

no code implementations29 Sep 2021 Jing Li, Yuangang Pan, Yueming Lyu, Yinghua Yao, Ivor Tsang

Instead of learning from scratch, fine-tuning a pre-trained model to fit a related target dataset of interest or downstream tasks has been a handy trick to achieve the desired performance.

Fairness

Neural Optimization Kernel: Towards Robust Deep Learning

no code implementations11 Jun 2021 Yueming Lyu, Ivor Tsang

We further establish a new generalization bound of our deep structured approximated NOK architecture.

Deep Learning Generalization Bounds

SOGAN: 3D-Aware Shadow and Occlusion Robust GAN for Makeup Transfer

no code implementations21 Apr 2021 Yueming Lyu, Jing Dong, Bo Peng, Wei Wang, Tieniu Tan

Since human faces are symmetrical in the UV space, we can conveniently remove the undesired shadow and occlusion from the reference image by carefully designing a Flip Attention Module (FAM).

Face Model Facial Makeup Transfer

A Simple Sparse Denoising Layer for Robust Deep Learning

no code implementations1 Jan 2021 Yueming Lyu, Xingrui Yu, Ivor Tsang

In this work, we take an initial step to designing a simple robust layer as a lightweight plug-in for vanilla deep models.

Deep Learning Denoising +2

Learning Efficient Planning-based Rewards for Imitation Learning

no code implementations1 Jan 2021 Xingrui Yu, Yueming Lyu, Ivor Tsang

Our method learns useful planning computations with a meaningful reward function that focuses on the resulting region of an agent executing an action.

Atari Games continuous-control +3

Subgroup-based Rank-1 Lattice Quasi-Monte Carlo

no code implementations NeurIPS 2020 Yueming Lyu, Yuan Yuan, Ivor W. Tsang

We theoretically prove a lower and an upper bound of the minimum pairwise distance of any non-degenerate rank-1 lattice.

Bayesian Inference

Intrinsic Reward Driven Imitation Learning via Generative Model

1 code implementation ICML 2020 Xingrui Yu, Yueming Lyu, Ivor W. Tsang

Thus, our module provides the imitation agent both the intrinsic intention of the demonstrator and a better exploration ability, which is critical for the agent to outperform the demonstrator.

Atari Games Imitation Learning +2

Black-box Optimizer with Implicit Natural Gradient

no code implementations9 Oct 2019 Yueming Lyu, Ivor W. Tsang

Empirically, our method with full matrix update achieves competitive performance compared with one of the state-of-the-art method CMA-ES on benchmark test problems.

Reinforcement Learning Reinforcement Learning (RL)

Efficient Batch Black-box Optimization with Deterministic Regret Bounds

no code implementations24 May 2019 Yueming Lyu, Yuan Yuan, Ivor W. Tsang

In this work, we investigate black-box optimization from the perspective of frequentist kernel methods.

Bayesian Optimization

Spherical Structured Feature Maps for Kernel Approximation

no code implementations ICML 2017 Yueming Lyu

According to (Brauchart \& Grabner, 2015), optimizing the discrete Riesz s-energy can generate asymptotically uniformly distributed point set on $\mathbb{S}^{d-1}$.

ARC

Cannot find the paper you are looking for? You can Submit a new open access paper.