Search Results for author:
Found 12 papers, 8 papers with code
Novelty Detection via Contrastive Learning with Negative Data Augmentation
Moreover, our model is more stable for training in a non-adversarial manner, compared to other adversarial based novelty detection methods.
Towards Compact Single Image Super-Resolution via Contrastive Self-distillation
Convolutional neural networks (CNNs) are highly successful for super-resolution (SR) but often require sophisticated architectures with heavy memory cost and computational overhead, significantly restricts their practical deployments on resource-limited devices.
Towards Compact CNNs via Collaborative Compression
Channel pruning and tensor decomposition have received extensive attention in convolutional neural network compression.
Contrastive Learning for Compact Single Image Dehazing
In this paper, we propose a novel contrastive regularization (CR) built upon contrastive learning to exploit both the information of hazy images and clear images as negative and positive samples, respectively.
Farewell to Mutual Information: Variational Distillation for Cross-Modal Person Re-Identification
The Information Bottleneck (IB) provides an information theoretic principle for representation learning, by retaining all information relevant for predicting label while minimizing the redundancy.
Cross-Modality Person Re-identification
Cross-Modal Person Re-Identification
+3
PAMS: Quantized Super-Resolution via Parameterized Max Scale
Specifically, most state-of-the-art SR models without batch normalization have a large dynamic quantization range, which also serves as another cause of performance drop.
Neural network compression via learnable wavelet transforms
Linear layers still occupy a significant portion of the parameters in recurrent neural networks (RNNs).
Training convolutional neural networks with cheap convolutions and online distillation
The large memory and computation consumption in convolutional neural networks (CNNs) has been one of the main barriers for deploying them on resource-limited systems.
Interpretable Neural Network Decoupling
More specifically, we introduce a novel architecture controlling module in each layer to encode the network architecture by a vector.
Towards Optimal Structured CNN Pruning via Generative Adversarial Learning
In this paper, we propose an effective structured pruning approach that jointly prunes filters as well as other structures in an end-to-end manner.
Towards Compact ConvNets via Structure-Sparsity Regularized Filter Pruning
In this paper, we propose a novel filter pruning scheme, termed structured sparsity regularization (SSR), to simultaneously speedup the computation and reduce the memory overhead of CNNs, which can be well supported by various off-the-shelf deep learning libraries.
Exploiting Kernel Sparsity and Entropy for Interpretable CNN Compression
The relationship between the input feature maps and 2D kernels is revealed in a theoretical framework, based on which a kernel sparsity and entropy (KSE) indicator is proposed to quantitate the feature map importance in a feature-agnostic manner to guide model compression.