no code implementations • 17 Sep 2024 • Xinyue Fang, Zhen Huang, Zhiliang Tian, Minghui Fang, Ziyi Pan, Quntian Fang, Zhihua Wen, Hengyue Pan, Dongsheng Li
Recent studies on detecting hallucinations in long text without external resources conduct consistency comparison among multiple sampled outputs.
1 code implementation • 29 Jan 2024 • Hengyue Pan, Yixin Chen, Zhiliang Tian, Peng Qiao, Linbo Qiao, Dongsheng Li
To get the balance between the computation complexity and memory usage, we propose a new network structure, namely Time-Frequency Domain Mixture Network (TFDMNet), which combines the advantages of both convolution layers and EMLs.
1 code implementation • 14 Dec 2023 • Zimian Wei, Lujun Li, Peijie Dong, Zheng Hui, Anggeng Li, Menglong Lu, Hengyue Pan, Zhiliang Tian, Dongsheng Li
Based on the discovered zero-cost proxy, we conduct a ViT architecture search in a training-free manner.
no code implementations • 24 Nov 2023 • Zimian Wei, Hengyue Pan, Lujun Li, Peijie Dong, Zhiliang Tian, Xin Niu, Dongsheng Li
In this paper, for the first time, we investigate how to search in a training-free manner with the help of teacher models and devise an effective Training-free ViT (TVT) search framework.
1 code implementation • ICCV 2023 • Peijie Dong, Lujun Li, Zimian Wei, Xin Niu, Zhiliang Tian, Hengyue Pan
In particular, we devise an elaborate search space involving the existing proxies and perform an evolution search to discover the best correlated MQ proxy.
no code implementations • 24 Jan 2023 • Peijie Dong, Xin Niu, Zhiliang Tian, Lujun Li, Xiaodong Wang, Zimian Wei, Hengyue Pan, Dongsheng Li
Practical networks for edge devices adopt shallow depth and small convolutional kernels to save memory and computational cost, which leads to a restricted receptive field.
1 code implementation • 24 Jan 2023 • Peijie Dong, Xin Niu, Lujun Li, Zhiliang Tian, Xiaodong Wang, Zimian Wei, Hengyue Pan, Dongsheng Li
In this paper, we propose Ranking Distillation one-shot NAS (RD-NAS) to enhance ranking consistency, which utilizes zero-cost proxies as the cheap teacher and adopts the margin ranking loss to distill the ranking knowledge.
no code implementations • 28 Dec 2022 • Zimian Wei, Hengyue Pan, Xin Niu, Dongsheng Li
OVO samples sub-nets for both teacher and student networks for better distillation results.
no code implementations • 16 Sep 2022 • Zimian Wei, Hengyue Pan, Lujun Li, Menglong Lu, Xin Niu, Peijie Dong, Dongsheng Li
Vision transformers have shown excellent performance in computer vision tasks.
1 code implementation • 27 Jun 2022 • Peijie Dong, Xin Niu, Lujun Li, Linzhen Xie, Wenbin Zou, Tian Ye, Zimian Wei, Hengyue Pan
In this paper, we present Prior-Guided One-shot NAS (PGONAS) to strengthen the ranking correlation of supernets.
2 code implementations • 14 Apr 2022 • Hengyue Pan, Yixin Chen, Xin Niu, Wenbo Zhou, Dongsheng Li
The most important motivation of this research is that we can use the straightforward element-wise multiplication operation to replace the image convolution in the frequency domain based on the Cross-Correlation Theorem, which obviously reduces the computation complexity.
no code implementations • 8 Mar 2022 • Zimian Wei, Hengyue Pan, Lujun Li, Menglong Lu, Xin Niu, Peijie Dong, Dongsheng Li
Neural architecture search (NAS) has brought significant progress in recent image recognition tasks.
no code implementations • 30 Jan 2021 • Linbo Qiao, Tao Sun, Hengyue Pan, Dongsheng Li
In recent years, the Deep Learning Alternating Minimization (DLAM), which is actually the alternating minimization applied to the penalty form of the deep neutral networks training, has been developed as an alternative algorithm to overcome several drawbacks of Stochastic Gradient Descent (SGD) algorithms.
no code implementations • 29 May 2020 • Hengyue Pan, Xin Niu, Rongchun Li, Siqi Shen, Yong Dou
Instead, we propose a novel method to encode all background objects in each image by using one fixed-size vector (i. e., FBE vector).
no code implementations • 16 Nov 2018 • Hengyue Pan, Hui Jiang, Xin Niu, Yong Dou
Most of previous methods mainly consider to drop features from input data and hidden layers, such as Dropout, Cutout and DropBlocks.
no code implementations • 24 Apr 2017 • Hengyue Pan, Hui Jiang
In the past few years, Generative Adversarial Network (GAN) became a prevalent research topic.
1 code implementation • 20 Jun 2016 • Hengyue Pan, Hui Jiang
Convolutional neural networks (CNNs) have yielded the excellent performance in a variety of computer vision tasks, where CNNs typically adopt a similar structure consisting of convolution layers, pooling layers and fully connected layers.
no code implementations • 1 Feb 2016 • Hengyue Pan, Hui Jiang
In this paper, we propose a fast deep learning method for object saliency detection using convolutional neural networks.
no code implementations • 5 May 2015 • Hengyue Pan, Bo wang, Hui Jiang
In this work, we use the computed saliency maps for image segmentation.