Search Results for author:
Found 6 papers, 3 papers with code
CORSD: Class-Oriented Relational Self Distillation
Knowledge distillation conducts an effective model compression method while holding some limitations:(1) the feature based distillation methods only focus on distilling the feature map but are lack of transferring the relation of data examples; (2) the relational distillation methods are either limited to the handcrafted functions for relation extraction, such as L2 norm, or weak in inter- and intra- class relation modeling.
Multi-Glimpse Network: A Robust and Efficient Classification Architecture based on Recurrent Downsampled Attention
Inspired by this observation, we propose an end-to-end trainable Multi-Glimpse Network (MGNet) which aims to tackle the challenges of high computation and the lack of robustness based on recurrent downsampled attention mechanism.
An Unsupervised Deep Learning Approach for Real-World Image Denoising
In the real-world case, the noise distribution is so complex that the simplified additive white Gaussian (AWGN) assumption rarely holds, which significantly deteriorates the Gaussian denoisers' performance.
Light-weight Calibrator: a Separable Component for Unsupervised Domain Adaptation
Existing domain adaptation methods aim at learning features that can be generalized among domains.
Ranked #3 on
Domain Adaptation
on USPS-to-MNIST
Non-Structured DNN Weight Pruning -- Is It Beneficial in Any Platform?
Based on the proposed comparison framework, with the same accuracy and quantization, the results show that non-structrued pruning is not competitive in terms of both storage and computation efficiency.
Brain-inspired reverse adversarial examples
On contrast, current state-of-the-art deep learning approaches heavily depend on the variety of training samples and the capacity of the network.
