Search Results for author: Xiuyu Sun

Found 27 papers, 20 papers with code

Neural Architecture Design for GPU-Efficient Networks

2 code implementations24 Jun 2020 Ming Lin, Hesen Chen, Xiuyu Sun, Qi Qian, Hao Li, Rong Jin

To address this issue, we propose a general principle for designing GPU-efficient networks based on extensive empirical studies.

Neural Architecture Search

Beyond Appearance: a Semantic Controllable Self-Supervised Learning Framework for Human-Centric Visual Tasks

4 code implementations CVPR 2023 Weihua Chen, Xianzhe Xu, Jian Jia, Hao Luo, Yaohua Wang, Fan Wang, Rong Jin, Xiuyu Sun

Unlike the existing self-supervised learning methods, prior knowledge from human images is utilized in SOLIDER to build pseudo semantic labels and import more semantic information into the learned representation.

Human Parsing Pedestrian Attribute Recognition +6

Zen-NAS: A Zero-Shot NAS for High-Performance Deep Image Recognition

2 code implementations1 Feb 2021 Ming Lin, Pichao Wang, Zhenhong Sun, Hesen Chen, Xiuyu Sun, Qi Qian, Hao Li, Rong Jin

Comparing with previous NAS methods, the proposed Zen-NAS is magnitude times faster on multiple server-side and mobile-side GPU platforms with state-of-the-art accuracy on ImageNet.

Image Classification Neural Architecture Search

Zen-NAS: A Zero-Shot NAS for High-Performance Image Recognition

2 code implementations ICCV 2021 Ming Lin, Pichao Wang, Zhenhong Sun, Hesen Chen, Xiuyu Sun, Qi Qian, Hao Li, Rong Jin

To address this issue, instead of using an accuracy predictor, we propose a novel zero-shot index dubbed Zen-Score to rank the architectures.

Neural Architecture Search Vocal Bursts Intensity Prediction

MAE-DET: Revisiting Maximum Entropy Principle in Zero-Shot NAS for Efficient Object Detection

1 code implementation26 Nov 2021 Zhenhong Sun, Ming Lin, Xiuyu Sun, Zhiyu Tan, Hao Li, Rong Jin

Recent researches attempt to reduce this cost by optimizing the backbone architecture with the help of Neural Architecture Search (NAS).

Neural Architecture Search Object +2

Entropy-Driven Mixed-Precision Quantization for Deep Network Design

1 code implementation Conference on Neural Information Processing Systems 2022 Zhenhong Sun, Ce Ge, Junyan Wang, Ming Lin, Hesen Chen, Hao Li, Xiuyu Sun

Deploying deep convolutional neural networks on Internet-of-Things (IoT) devices is challenging due to the limited computational resources, such as limited SRAM memory and Flash storage.

Face Detection Hardware Aware Neural Architecture Search +3

DeepMAD: Mathematical Architecture Design for Deep Convolutional Neural Network

1 code implementation CVPR 2023 Xuan Shen, Yaohua Wang, Ming Lin, Yilun Huang, Hao Tang, Xiuyu Sun, Yanzhi Wang

To this end, a novel framework termed Mathematical Architecture Design for Deep CNN (DeepMAD) is proposed to design high-performance CNN models in a principled way.

Image Classification Neural Architecture Search

Maximizing Spatio-Temporal Entropy of Deep 3D CNNs for Efficient Video Recognition

1 code implementation5 Mar 2023 Junyan Wang, Zhenhong Sun, Yichen Qian, Dong Gong, Xiuyu Sun, Ming Lin, Maurice Pagnucco, Yang song

In this work, we propose to automatically design efficient 3D CNN architectures via a novel training-free neural architecture search approach tailored for 3D CNNs considering the model complexity.

Action Recognition Computational Efficiency +2

Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluation

1 code implementation29 Aug 2023 Dawei Gao, Haibin Wang, Yaliang Li, Xiuyu Sun, Yichen Qian, Bolin Ding, Jingren Zhou

Our explorations highlight open-source LLMs' potential in Text-to-SQL, as well as the advantages and disadvantages of the supervised fine-tuning.

Prompt Engineering Text-To-SQL

Entroformer: A Transformer-based Entropy Model for Learned Image Compression

2 code implementations ICLR 2022 Yichen Qian, Ming Lin, Xiuyu Sun, Zhiyu Tan, Rong Jin

One critical component in lossy deep image compression is the entropy model, which predicts the probability distribution of the quantized latent representation in the encoding and decoding modules.

Image Classification Image Compression +1

GiraffeDet: A Heavy-Neck Paradigm for Object Detection

2 code implementations ICLR 2022 Yiqi Jiang, Zhiyu Tan, Junyan Wang, Xiuyu Sun, Ming Lin, Hao Li

This heavy-backbone design paradigm is mostly due to the historical legacy when transferring image recognition models to object detection rather than an end-to-end optimized design for object detection.

Object object-detection +1

Ada-NETS: Face Clustering via Adaptive Neighbour Discovery in the Structure Space

2 code implementations ICLR 2022 Yaohua Wang, Yaobin Zhang, Fangyi Zhang, Ming Lin, Yuqi Zhang, Senzhang Wang, Xiuyu Sun

In Ada-NETS, each face is transformed to a new structure space, obtaining robust features by considering face features of the neighbour images.

Clustering Face Clustering

Learning Accurate Entropy Model with Global Reference for Image Compression

2 code implementations ICLR 2021 Yichen Qian, Zhiyu Tan, Xiuyu Sun, Ming Lin, Dongyang Li, Zhenhong Sun, Hao Li, Rong Jin

In this work, we propose a novel Global Reference Model for image compression to effectively leverage both the local and the global context information, leading to an enhanced compression rate.

Image Compression

Spatiotemporal Entropy Model is All You Need for Learned Video Compression

1 code implementation13 Apr 2021 Zhenhong Sun, Zhiyu Tan, Xiuyu Sun, Fangyi Zhang, Dongyang Li, Yichen Qian, Hao Li

The framework of dominant learned video compression methods is usually composed of motion prediction modules as well as motion vector and residual image compression modules, suffering from its complex structure and error propagation problem.

Image Compression motion prediction +3

Interpolation variable rate image compression

1 code implementation20 Sep 2021 Zhenhong Sun, Zhiyu Tan, Xiuyu Sun, Fangyi Zhang, Yichen Qian, Dongyang Li, Hao Li

Compression standards have been used to reduce the cost of image storage and transmission for decades.

Image Compression MS-SSIM +1

TAGPerson: A Target-Aware Generation Pipeline for Person Re-identification

1 code implementation28 Dec 2021 Kai Chen, Weihua Chen, Tao He, Rong Du, Fan Wang, Xiuyu Sun, Yuchen Guo, Guiguang Ding

In TAGPerson, we extract information from target scenes and use them to control our parameterized rendering process to generate target-aware synthetic images, which would hold a smaller gap to the real images in the target domain.

Person Re-Identification

Avatar Knowledge Distillation: Self-ensemble Teacher Paradigm with Uncertainty

1 code implementation4 May 2023 Yuan Zhang, Weihua Chen, Yichen Lu, Tao Huang, Xiuyu Sun, Jian Cao

Knowledge distillation is an effective paradigm for boosting the performance of pocket-size model, especially when multiple teacher models are available, the student would break the upper limit again.

Knowledge Distillation object-detection +3

Robust Graph Structure Learning via Multiple Statistical Tests

1 code implementation8 Oct 2022 Yaohua Wang, Fangyi Zhang, Ming Lin, Senzhang Wang, Xiuyu Sun, Rong Jin

A natural way to construct a graph among images is to treat each image as a node and assign pairwise image similarities as weights to corresponding edges.

Face Clustering Graph structure learning

Learning to Cluster Faces via Transformer

no code implementations23 Apr 2021 Jinxing Ye, Xioajiang Peng, Baigui Sun, Kai Wang, Xiuyu Sun, Hao Li, Hanqing Wu

In this paper, we repurpose the well-known Transformer and introduce a Face Transformer for supervised face clustering.

Clustering Face Clustering +2

Importance Weighted Adversarial Discriminative Transfer for Anomaly Detection

1 code implementation14 May 2021 Cangning Fan, Fangyi Zhang, Peng Liu, Xiuyu Sun, Hao Li, Ting Xiao, Wei Zhao, Xianglong Tang

In this way, an obvious gap can be produced between the distributions of normal and abnormal data in the target domain, therefore enabling the anomaly detection in the domain.

Anomaly Detection valid

Fine-Grained AutoAugmentation for Multi-Label Classification

no code implementations12 Jul 2021 Ya Wang, Hesen Chen, Fangyi Zhang, Yaohua Wang, Xiuyu Sun, Ming Lin, Hao Li

Data augmentation is a commonly used approach to improving the generalization of deep learning models.

Classification Data Augmentation +3

Exploring the Quality of GAN Generated Images for Person Re-Identification

no code implementations23 Aug 2021 Yiqi Jiang, Weihua Chen, Xiuyu Sun, Xiaoyu Shi, Fan Wang, Hao Li

Recently, GAN based method has demonstrated strong effectiveness in generating augmentation data for person re-identification (ReID), on account of its ability to bridge the gap between domains and enrich the data variety in feature space.

Person Re-Identification Unsupervised Domain Adaptation

ZenDet: Revisiting Efficient Object Detection Backbones from Zero-Shot Neural Architecture Search

no code implementations29 Sep 2021 Zhenhong Sun, Ming Lin, Zhiyu Tan, Xiuyu Sun, Rong Jin

Recent researches attempt to reduce this cost by optimizing the backbone architecture with the help of Neural Architecture Search (NAS).

Neural Architecture Search Object +2

NAS-Bench-Zero: A Large Scale Dataset for Understanding Zero-Shot Neural Architecture Search

no code implementations29 Sep 2021 Hanlin Chen, Ming Lin, Xiuyu Sun, Hao Li

Based on these new discoveries, we propose i) a novel hybrid zero-shot proxy which outperforms existing ones by a large margin and is transferable among popular search spaces; ii) a new index for better measuring the true performance of ZS-NAS proxies in constrained NAS.

Benchmarking Neural Architecture Search

Hierarchical Cross Contrastive Learning of Visual Representations

no code implementations29 Sep 2021 Hesen Chen, Ming Lin, Xiuyu Sun, Rong Jin

In this work, we propose a novel approach termed Hierarchical Cross Contrastive Learning(HCCL) to further distill the information mismatched by the conventional contrastive loss.

Contrastive Learning Few-Shot Learning +1

Fuxi-DA: A Generalized Deep Learning Data Assimilation Framework for Assimilating Satellite Observations

no code implementations12 Apr 2024 Xiaoze Xu, Xiuyu Sun, Wei Han, Xiaohui Zhong, Lei Chen, Hao Li

Data assimilation (DA), as an indispensable component within contemporary Numerical Weather Prediction (NWP) systems, plays a crucial role in generating the analysis that significantly impacts forecast performance.

Weather Forecasting

Cannot find the paper you are looking for? You can Submit a new open access paper.