Search Results for author: Mengnan Zhao

Found 10 papers, 4 papers with code

Catastrophic Overfitting: A Potential Blessing in Disguise

no code implementations28 Feb 2024 Mengnan Zhao, Lihe Zhang, Yuqiu Kong, BaoCai Yin

To tackle this issue, we initially employ the feature activation differences between clean and adversarial examples to analyze the underlying causes of CO. Intriguingly, our findings reveal that CO can be attributed to the feature coverage induced by a few specific pathways.

Adversarial Robustness

Separable Multi-Concept Erasure from Diffusion Models

1 code implementation3 Feb 2024 Mengnan Zhao, Lihe Zhang, Tianhang Zheng, Yuqiu Kong, BaoCai Yin

Large-scale diffusion models, known for their impressive image generation capabilities, have raised concerns among researchers regarding social impacts, such as the imitation of copyrighted artistic styles.

Image Generation Machine Unlearning

EipFormer: Emphasizing Instance Positions in 3D Instance Segmentation

no code implementations9 Dec 2023 Mengnan Zhao, Lihe Zhang, Yuqiu Kong, BaoCai Yin

It enhances the initial instance positions through weighted farthest point sampling and further refines the instance positions and proposals using aggregation averaging and center matching.

3D Instance Segmentation Position +1

Fast Adversarial Training with Smooth Convergence

1 code implementation ICCV 2023 Mengnan Zhao, Lihe Zhang, Yuqiu Kong, BaoCai Yin

To address this, we analyze the training process of prior FAT work and observe that catastrophic overfitting is accompanied by the appearance of loss convergence outliers.

Adversarial Robustness

Temporal Knowledge Graph Reasoning Triggered by Memories

1 code implementation17 Oct 2021 Mengnan Zhao, Lihe Zhang, Yuqiu Kong, BaoCai Yin

Specifically, the transient learning network considers transient memories as a static knowledge graph, and the time-aware recurrent evolution network learns representations through a sequence of recurrent evolution units from long-short-term memories.

Attribute Decision Making +2

Accelerating SLIDE Deep Learning on Modern CPUs: Vectorization, Quantizations, Memory Optimizations, and More

2 code implementations6 Mar 2021 Shabnam Daghaghi, Nicholas Meisburger, Mengnan Zhao, Yong Wu, Sameh Gobriel, Charlie Tai, Anshumali Shrivastava

Our work highlights several novel perspectives and opportunities for implementing randomized algorithms for deep learning on modern CPUs.

A Truly Constant-time Distribution-aware Negative Sampling

no code implementations1 Jan 2021 Shabnam Daghaghi, Tharun Medini, Beidi Chen, Mengnan Zhao, Anshumali Shrivastava

Softmax classifiers with a very large number of classes naturally occur in many applications such as natural language processing and information retrieval.

Information Retrieval Retrieval

A Tale of Two Efficient and Informative Negative Sampling Distributions

no code implementations31 Dec 2020 Shabnam Daghaghi, Tharun Medini, Nicholas Meisburger, Beidi Chen, Mengnan Zhao, Anshumali Shrivastava

Unfortunately, due to the dynamically updated parameters and data samples, there is no sampling scheme that is provably adaptive and samples the negative classes efficiently.

Information Retrieval Retrieval +1

What is the Largest Sparsity Pattern that Can Be Recovered by 1-Norm Minimization?

no code implementations12 Oct 2019 Mustafa D. Kaba, Mengnan Zhao, Rene Vidal, Daniel P. Robinson, Enrique Mallada

In the case of the partial discrete Fourier transform, our characterization of the largest sparsity pattern that can be recovered requires the unknown signal to be real and its dimension to be a prime number.

Cannot find the paper you are looking for? You can Submit a new open access paper.