Search Results for author:
Found 190 papers, 86 papers with code
Mitigating Data Poisoning in Text Classification with Differential Privacy
NLP models are vulnerable to data poisoning attacks.
Neural Architecture Search in a Proxy Validation Loss Landscape
This paper searches for the optimal neural architecture by minimizing a proxy of validation loss.
On Dropping Clusters to Regularize Graph Convolutional Neural Networks
Dropout has been widely adopted to regularize graph convolutional networks (GCNs) by randomly zeroing entries of the node feature vectors and obtains promising performance on various tasks.
Detecting Every Object from Events
Object detection is critical in autonomous driving, and it is more practical yet challenging to localize objects of unknown categories: an endeavour known as Class-Agnostic Object Detection (CAOD).
NeRF2Points: Large-Scale Point Cloud Generation From Street Views' Radiance Field Optimization
Neural Radiance Fields (NeRF) have emerged as a paradigm-shifting methodology for the photorealistic rendering of objects and environments, enabling the synthesis of novel viewpoints with remarkable fidelity.
Towards Memorization-Free Diffusion Models
Pretrained diffusion models and their outputs are widely accessible due to their exceptional capacity for synthesizing high-quality images and their open-source nature.
ConGeo: Robust Cross-view Geo-localization across Ground View Variations
Cross-view geo-localization aims at localizing a ground-level query image by matching it to its corresponding geo-referenced aerial view.
Learning Cross-view Visual Geo-localization without Ground Truth
We observe that training on unlabeled cross-view images presents significant challenges, including the need to establish relationships within unlabeled data and reconcile view discrepancies between uncertain queries and references.
Collage Prompting: Budget-Friendly Visual Recognition with GPT-4V
Based on the observation that the accuracy of GPT-4V's image recognition varies significantly with the order of images within the collage prompt, our method further learns to optimize the arrangement of images for maximum recognition accuracy.
Understanding Robustness of Visual State Space Models for Image Classification
VMamba exhibits exceptional generalizability with out-of-distribution data but shows scalability weaknesses against natural adversarial examples and common corruptions.
EfficientVMamba: Atrous Selective Scan for Light Weight Visual Mamba
Inspired by this, this work proposes to explore the potential of visual state space models in light-weight model design and introduce a novel efficient model variant dubbed EfficientVMamba.
LocalMamba: Visual State Space Model with Windowed Selective Scan
This paper posits that the key to enhancing Vision Mamba (ViM) lies in optimizing scan directions for sequence modeling.
Active Generation for Image Classification
Recently, the growing capabilities of deep generative models have underscored their potential in enhancing image classification accuracy.
MG-TSD: Multi-Granularity Time Series Diffusion Models with Guided Learning Process
However, the effective utilization of their strong modeling ability in the probabilistic time series forecasting task remains an open question, partially due to the challenge of instability arising from their stochastic nature.
Data-efficient Large Vision Models through Sequential Autoregression
Training general-purpose vision models on purely sequential visual data, eschewing linguistic inputs, has heralded a new frontier in visual understanding.
Vision Superalignment: Weak-to-Strong Generalization for Vision Foundation Models
Recent advancements in large language models have sparked interest in their extraordinary and near-superhuman capabilities, leading researchers to explore methods for evaluating and optimizing these abilities, which is called superalignment.
Accelerated Cloud for Artificial Intelligence (ACAI)
Training an effective Machine learning (ML) model is an iterative process that requires effort in multiple dimensions.
Visual Imitation Learning with Calibrated Contrastive Representation
Adversarial Imitation Learning (AIL) allows the agent to reproduce expert behavior with low-dimensional states and actions.
Not All Steps are Equal: Efficient Generation with Progressive Diffusion Models
In the initial stage, a base denoising model is trained to encompass all timesteps.
Detecting Any Human-Object Interaction Relationship: Universal HOI Detector with Spatial Prompt Learning on Foundation Models
We conduct a deep analysis of the three hierarchical features inherent in visual HOI detectors and propose a method for high-level relation extraction aimed at VL foundation models, which we call HO prompt-based learning.
One-for-All: Bridge the Gap Between Heterogeneous Architectures in Knowledge Distillation
To tackle the challenge in distilling heterogeneous models, we propose a simple yet effective one-for-all KD framework called OFA-KD, which significantly improves the distillation performance between heterogeneous architectures.
Rethinking Scale Imbalance in Semi-supervised Object Detection for Aerial Images
This paper focuses on the scale imbalance problem of semi-supervised object detection(SSOD) in aerial images.
Imitation Learning from Purified Demonstration
To tackle these problems, we propose to purify the potential perturbations in imperfect demonstrations and subsequently conduct imitation learning from purified demonstrations.
DiffNAS: Bootstrapping Diffusion Models by Prompting for Better Architectures
Diffusion models have recently exhibited remarkable performance on synthetic data.
Parameter-Saving Adversarial Training: Reinforcing Multi-Perturbation Robustness via Hypernetworks
Adversarial training serves as one of the most popular and effective methods to defend against adversarial perturbations.
MM-NeRF: Multimodal-Guided 3D Multi-Style Transfer of Neural Radiance Field
3D style transfer aims to generate stylized views of 3D scenes with specified styles, which requires high-quality generating and keeping multi-view consistency.
Stealthy Physical Masked Face Recognition Attack via Adversarial Style Optimization
Moreover, to ameliorate the phenomenon of sub-optimization with one fixed style, we propose to discover the optimal style given a target through style optimization in a continuous relaxation manner.
A Benchmark Study on Calibration
As far as we are aware, our research represents the first large-scale investigation into calibration properties and the premier study of calibration issues within NAS.
Boosting Diffusion Models with an Adaptive Momentum Sampler
Our proposed sampler can be readily applied to a pre-trained diffusion model, utilizing momentum mechanisms and adaptive updating to smooth the reverse sampling process and ensure stable generation, resulting in outputs of enhanced quality.
Efficient Transfer Learning in Diffusion Models via Adversarial Noise
Diffusion Probabilistic Models (DPMs) have demonstrated substantial promise in image generation tasks but heavily rely on the availability of large amounts of training data.
CoNe: Contrast Your Neighbours for Supervised Image Classification
Moreover, to further boost the performance, we propose ``distributional consistency" as a more informative regularization to enable similar instances to have a similar probability distribution.
Microstructure-Empowered Stock Factor Extraction and Utilization
To address these challenges, we propose a novel framework that aims to effectively extract essential factors from order flow data for diverse downstream tasks across different granularities and scenarios.
SimMatchV2: Semi-Supervised Learning with Graph Consistency
Semi-Supervised image classification is one of the most fundamental problem in computer vision, which significantly reduces the need for human labor.
Fingerprints of Generative Models in the Frequency Domain
It is verified in existing works that CNN-based generative models leave unique fingerprints on generated images.
Re-mine, Learn and Reason: Exploring the Cross-modal Semantic Correlations for Language-guided HOI detection
Human-Object Interaction (HOI) detection is a challenging computer vision task that requires visual models to address the complex interactive relationship between humans and objects and predict HOI triplets.
What Can Simple Arithmetic Operations Do for Temporal Modeling?
We conduct comprehensive ablation studies on the instantiation of ATMs and demonstrate that this module provides powerful temporal modeling capability at a low computational cost.
Ranked #4 on
Action Recognition
on Something-Something V1
Neural Architecture Retrieval
With the increasing number of new neural architecture designs and substantial existing neural architectures, it becomes difficult for the researchers to situate their contributions compared with existing neural architectures or establish the connections between their designs and other relevant ones.
Learning Structure-Guided Diffusion Model for 2D Human Pose Estimation
One of the mainstream schemes for 2D human pose estimation (HPE) is learning keypoints heatmaps by a neural network.
GPT Self-Supervision for a Better Data Annotator
In the one-shot tuning phase, we sample a data from the support set as part of the prompt for GPT to generate a textual summary, which is then used to recover the original data.
Knowledge Diffusion for Distillation
To address this, we propose to denoise student features using a diffusion model trained by teacher features.
VanillaKD: Revisit the Power of Vanilla Knowledge Distillation from Small Scale to Large Scale
The tremendous success of large models trained on extensive datasets demonstrates that scale is a key ingredient in achieving superior results.
Dual Focal Loss for Calibration
While different variants of focal loss have been explored, it is difficult to find a balance between over-confidence and under-confidence.
Can GPT-4 Perform Neural Architecture Search?
We investigate the potential of GPT-4~\cite{gpt4} to perform Neural Architecture Search (NAS) -- the task of designing effective neural architectures.
Dynamic Coarse-to-Fine Learning for Oriented Tiny Object Detection
Despite the exploration of adaptive label assignment in recent oriented object detectors, the extreme geometry shape and limited feature of oriented tiny objects still induce severe mismatch and imbalance issues.
Ranked #2 on
Oriented Object Detction
on DOTA 2.0
Diffusion Action Segmentation
Temporal action segmentation is crucial for understanding long-form videos.
Ranked #2 on
Action Segmentation
on GTEA
PSVT: End-to-End Multi-person 3D Pose and Shape Estimation with Progressive Video Transformers
To handle the variances of objects as time proceeds, a novel scheme of progressive decoding is used to update pose and shape queries at each frame.
Ranked #24 on
3D Human Pose Estimation
on 3DPW
Thin Films on the Skin, but not Frictional Agents, Attenuate the Percept of Pleasantness to Brushed Stimuli
Brushed stimuli are perceived as pleasant when stroked lightly on the skin surface of a touch receiver at certain velocities.
Two-in-one Knowledge Distillation for Efficient Facial Forgery Detection
More specifically, knowledge distillation on both the spatial and frequency branches has degraded performance than distillation only on the spatial branch.
Unlabeled Imperfect Demonstrations in Adversarial Imitation Learning
The trajectories of an initial agent policy could be closer to those non-optimal expert demonstrations, but within the framework of adversarial imitation learning, agent policy will be optimized to cheat the discriminator and produce trajectories that are similar to those optimal expert demonstrations.
Calibrating a Deep Neural Network with Its Predecessors
However, early stopping, as a well-known technique to mitigate overfitting, fails to calibrate networks.
Anti-Compression Contrastive Facial Forgery Detection
To enhance the performance for such models, we consider the weak compressed and strong compressed data as two views of the original data and they should have similar representation and relationships with other samples.
Personalized Image Generation for Color Vision Deficiency Population
Approximately, 350 million people, a proportion of 8%, suffer from color vision deficiency (CVD).
Trade-Off Between Robustness and Accuracy of Vision Transformers
Although deep neural networks (DNNs) have shown great successes in computer vision tasks, they are vulnerable to perturbations on inputs, and there exists a trade-off between the natural accuracy and robustness to such perturbations, which is mainly caused by the existence of robust non-predictive features and non-robust predictive features.
Private Image Generation With Dual-Purpose Auxiliary Classifier
However, apart from this standard utility, we identify the "reversed utility" as another crucial aspect, which computes the accuracy on generated data of a classifier trained using real data, dubbed as real2gen accuracy (r2g%).
Adversarial Robustness via Random Projection Filters
Deep Neural Networks show superior performance in various tasks but are vulnerable to adversarial attacks.
Speech4Mesh: Speech-Assisted Monocular 3D Facial Reconstruction for Speech-Driven 3D Facial Animation
Besides, we also verify that the proposed framework is able to explicitly control the emotion of the animated talking face.
Learning Spatiotemporal Frequency-Transformer for Low-Quality Video Super-Resolution
Video Super-Resolution (VSR) aims to restore high-resolution (HR) videos from low-resolution (LR) videos.
Ranked #2 on
Video Super-Resolution
on REDS4- 4x upscaling
ContraFeat: Contrasting Deep Features for Semantic Discovery
In this paper, we propose a model that automates this process and achieves state-of-the-art semantic discovery performance.
FastMIM: Expediting Masked Image Modeling Pre-training for Vision
This paper presents FastMIM, a simple and generic framework for expediting masked image modeling with the following two steps: (i) pre-training vision backbones with low-resolution input images; and (ii) reconstructing Histograms of Oriented Gradients (HOG) feature instead of original RGB values of the input images.
GhostNetV2: Enhance Cheap Operation with Long-Range Attention
The convolutional operation can only capture local information in a window region, which prevents performance from being further improved.
Boosting Semi-Supervised Semantic Segmentation with Probabilistic Representations
In prevalent pixel-wise contrastive learning solutions, the model maps pixels to deterministic representations and regularizes them in the latent space.
Learning Differential Operators for Interpretable Time Series Modeling
In this work, we propose an learning framework that can automatically obtain interpretable PDE models from sequential data.
Motion Robust High-Speed Light-Weighted Object Detection With Event Camera
In this work, we propose a motion robust and high-speed detection pipeline which better leverages the event data.
RFLA: Gaussian Receptive Field based Label Assignment for Tiny Object Detection
Then, instead of assigning samples with IoU or center sampling strategy, a new Receptive Field Distance (RFD) is proposed to directly measure the similarity between the Gaussian receptive field and ground truth.
Spatial-Channel Token Distillation for Vision MLPs
Recently, neural architectures with all Multi-layer Perceptrons (MLPs) have attracted great research interest from the computer vision community.
Ranked #488 on
Image Classification
on ImageNet
LightViT: Towards Light-Weight Convolution-Free Vision Transformers
Vision transformers (ViTs) are usually considered to be less light-weight than convolutional neural networks (CNNs) due to the lack of inductive bias.
Detecting tiny objects in aerial images: A normalized Wasserstein distance and a new benchmark
Tiny object detection (TOD) in aerial images is challenging since a tiny object only contains a few pixels.
Masked Distillation with Receptive Tokens
To obtain a group of masks, the receptive tokens are learned via the regular task loss but with teacher fixed, and we also leverage a Dice loss to enrich the diversity of learned masks.
Knowledge Distillation from A Stronger Teacher
In this paper, we show that simply preserving the relations between the predictions of teacher and student would suffice, and propose a correlation-based loss to capture the intrinsic inter-class relations from the teacher explicitly.
Ranked #2 on
Knowledge Distillation
on ImageNet
(using extra training data)
Searching for Network Width with Bilaterally Coupled Network
In BCNet, each channel is fairly trained and responsible for the same amount of network widths, thus each network width can be evaluated more accurately.
DyRep: Bootstrapping Training with Dynamic Re-parameterization
Structural re-parameterization (Rep) methods achieve noticeable improvements on simple VGG-style networks.
Relational Self-Supervised Learning
Self-supervised Learning (SSL) including the mainstream contrastive learning has achieved great success in learning visual representations without data annotations.
Ranked #60 on
Self-Supervised Image Classification
on ImageNet
SimMatch: Semi-supervised Learning with Similarity Matching
Learning with few labeled data has been a longstanding problem in the computer vision and machine learning research community.
Multi-Tailed Vision Transformer for Efficient Inference
To satisfy the sequential input of Transformer, the tail of ViT first splits each image into a sequence of visual tokens with a fixed length.
Relational Surrogate Loss Learning
Evaluation metrics in machine learning are often hardly taken as loss functions, as they could be non-differentiable and non-decomposable, e. g., average precision and F1 score.
GhostNets on Heterogeneous Devices via Cheap Operations
The proposed C-Ghost module can be taken as a plug-and-play component to upgrade existing convolutional neural networks.
DeepFake Disrupter: The Detector of DeepFake Is My Friend
We argue that the detectors do not share a similar perspective as human eyes, which might still be spoofed by the disrupted data.
An Empirical Study of Adder Neural Networks for Object Detection
Adder neural networks (AdderNets) have shown impressive performance on image classification with only addition operations, which are more energy efficient than traditional convolutional neural networks built with multiplications.
Handling Long-tailed Feature Distribution in AdderNets
Adder neural networks (ANNs) are designed for low energy cost which replace expensive multiplications in convolutional neural networks (CNNs) with cheaper additions to yield energy-efficient neural networks and hardware accelerations.
Towards Stable and Robust AdderNets
Adder neural network (AdderNet) replaces the original convolutions with massive multiplications by cheap additions while achieving comparable performance thus yields a series of energy-efficient neural networks.
GreedyNASv2: Greedier Search with a Greedy Path Filter
In this paper, we leverage an explicit path filter to capture the characteristics of paths and directly filter those weak ones, so that the search can be thus implemented on the shrunk space more greedily and efficiently.
An Image Patch is a Wave: Phase-Aware Vision MLP
To dynamically aggregate tokens, we propose to represent each token as a wave function with two parts, amplitude and phase.
PP-PicoDet: A Better Real-Time Object Detector on Mobile Devices
We investigate the applicability of the anchor-free strategy on lightweight object detection models.
Ranked #1 on
Object Detection
on MSCOCO
A Normalized Gaussian Wasserstein Distance for Tiny Object Detection
Our key observation is that Intersection over Union (IoU) based metrics such as IoU itself and its extensions are very sensitive to the location deviation of the tiny objects, and drastically deteriorate the detection performance when used in anchor-based detectors.
Ranked #1 on
Object Detection
on AI-TOD
Weakly Supervised Contrastive Learning
Specifically, our proposed framework is based on two projection heads, one of which will perform the regular instance discrimination task.
Learning Versatile Convolution Filters for Efficient Visual Recognition
A series of secondary filters can be derived from a primary filter with the help of binary masks.
Hire-MLP: Vision MLP via Hierarchical Rearrangement
Previous vision MLPs such as MLP-Mixer and ResMLP accept linearly flattened image patches as input, making them inflexible for different input sizes and hard to capture spatial information.
DeepFake MNIST+: A DeepFake Facial Animation Dataset
It includes 10, 000 facial animation videos in ten different actions, which can spoof the recent liveness detectors.
Neural Architecture Dilation for Adversarial Robustness
With the tremendous advances in the architecture and scale of convolutional neural networks (CNNs) over the past few decades, they can easily reach or even exceed the performance of humans in certain tasks.
ReSSL: Relational Self-Supervised Learning with Weak Augmentation
Self-supervised Learning (SSL) including the mainstream contrastive learning has achieved great success in learning visual representations without data annotations.
Ranked #78 on
Self-Supervised Image Classification
on ImageNet
As Easy as 1, 2, 3: Behavioural Testing of NMT Systems for Numerical Translation
Mistranslated numbers have the potential to cause serious effects, such as financial loss or medical misinformation.
CMT: Convolutional Neural Networks Meet Vision Transformers
Vision transformers have been successfully applied to image recognition tasks due to their ability to capture long-range dependencies within an image.
Putting words into the system's mouth: A targeted attack on neural machine translation using monolingual data poisoning
Neural machine translation systems are known to be vulnerable to adversarial test inputs, however, as we show in this paper, these systems are also vulnerable to training attacks.
Augmented Shortcuts for Vision Transformers
Transformer models have achieved great progress on computer vision tasks recently.
ViTAS: Vision Transformer Architecture Search
Vision transformers (ViTs) inherited the success of NLP but their structures have not been sufficiently investigated and optimized for visual tasks.
ReNAS: Relativistic Evaluation of Neural Architecture Search
An effective and efficient architecture performance evaluation scheme is essential for the success of Neural Architecture Search (NAS).
Learning Student Networks in the Wild
Experiments on various datasets demonstrate that the student networks learned by the proposed method can achieve comparable performance with those using the original dataset.
Positive-Unlabeled Data Purification in the Wild for Object Detection
In this paper, we present a positive-unlabeled learning based scheme to expand training data by purifying valuable images from massive unlabeled ones, where the original training data are viewed as positive data and the unlabeled images in the wild are unlabeled data.
K-shot NAS: Learnable Weight-Sharing for NAS with K-shot Supernets
The operation weight for each path is represented as a convex combination of items in a dictionary with a simplex code.
Commutative Lie Group VAE for Disentanglement Learning
Instead, we propose to encode the data variations with groups, a structure not only can equivariantly represent variations, but can also be adaptively optimized to preserve the properties of data variations.
Patch Slimming for Efficient Vision Transformers
We first identify the effective patches in the last layer and then use them to guide the patch selection process of previous layers.
Ranked #8 on
Efficient ViTs
on ImageNet-1K (with DeiT-T)
Universal Adder Neural Networks
The widely-used convolutions in deep neural networks are exactly cross-correlation to measure the similarity between input feature and convolution filters, which involves massive multiplications between float values.
BCNet: Searching for Network Width with Bilaterally Coupled Network
In BCNet, each channel is fairly trained and responsible for the same amount of network widths, thus each network width can be evaluated more accurately.
Where and What? Examining Interpretable Disentangled Representations
We thus impose a perturbation on a certain dimension of the latent code, and expect to identify the perturbation along this dimension from the generated images so that the encoding of simple variations can be enforced.
Distilling Object Detectors via Decoupled Features
To this end, we present a novel distillation algorithm via decoupled features (DeFeat) for learning a better student detector.
Joint Distribution across Representation Space for Out-of-Distribution Detection
Specifically, We construct a generative model, called Latent Sequential Gaussian Mixture (LSGM), to depict how the in-distribution latent features are generated in terms of the trace of DNN inference across representation spaces.
Out-of-Distribution Detection
Out of Distribution (OOD) Detection
Prioritized Architecture Sampling with Monto-Carlo Tree Search
One-shot neural architecture search (NAS) methods significantly reduce the search cost by considering the whole search space as one network, which only needs to be trained once.
Learning Frequency-aware Dynamic Network for Efficient Super-Resolution
Extensive experiments conducted on benchmark SISR models and datasets show that the frequency-aware dynamic network can be employed for various SISR neural architectures to obtain the better tradeoff between visual quality and computational complexity.
Manifold Regularized Dynamic Network Pruning
Then, the manifold relationship between instances and the pruned sub-networks will be aligned in the training procedure.
LocalDrop: A Hybrid Regularization for Deep Neural Networks
In neural networks, developing regularization algorithms to settle overfitting is one of the major study areas.
Learning Frequency Domain Approximation for Binary Neural Networks
Binary neural networks (BNNs) represent original full-precision weights and activations into 1-bit with sign function.
Hero: On the Chaos When PATH Meets Modules
The results showed that \textsc{Hero} achieved a high detection rate of 98. 5\% on a DM issue benchmark and found 2, 422 new DM issues in 2, 356 popular Golang projects.
Software Engineering
REST: Relational Event-driven Stock Trend Forecasting
To remedy the first shortcoming, we propose to model the stock context and learn the effect of event information on the stocks under different contexts.
Locally Free Weight Sharing for Network Width Search
In this paper, to better evaluate each width, we propose a locally free weight sharing strategy (CafeNet) accordingly.
PTN: A Poisson Transfer Network for Semi-supervised Few-shot Learning
Second, the extra unlabeled samples are employed to transfer the knowledge from base classes to novel classes through contrastive learning.
Finite particle number description of neutron matter using the unitary correlation operator and high-momentum pair methods
The central short-range correlation coming from the short-range repulsion in the NN interaction is treated by the unitary correlation operator method (UCOM) and the tensor correlation and spin-orbit effects are described by the two-particle two-hole (2p2h) excitations of nucleon pairs, in which the two nucleons with a large relative momentum are regarded as a high-momentum pair (HM).
Nuclear Theory
Assessing Social License to Operate from the Public Discourse on Social Media
Our experimental results show that SIRTA is highly effective in distilling stances from social posts for SLO level assessment, and that the continuous monitoring of SLO levels afforded by SIRTA enables the early detection of critical SLO changes.
Pre-Trained Image Processing Transformer
To maximally excavate the capability of transformer, we present to utilize the well-known ImageNet benchmark for generating a large amount of corrupted image pairs.
Ranked #1 on
Single Image Deraining
on Rain100L
(using extra training data)
UnModNet: Learning to Unwrap a Modulo Image for High Dynamic Range Imaging
A conventional camera often suffers from over- or under-exposure when recording a real-world scene with a very high dynamic range (HDR).
Adapting Neural Architectures Between Domains
The power of deep neural networks is to be unleashed for analyzing a large volume of data (e. g. ImageNet), but the architecture search is often executed on another smaller dataset (e. g. CIFAR-10) to finish it in a feasible time.
A Targeted Attack on Black-Box Neural Machine Translation with Parallel Data Poisoning
In this paper, we show that targeted attacks on black-box NMT systems are feasible, based on poisoning a small fraction of their parallel training data.
Data Agnostic Filter Gating for Efficient Deep Networks
To deploy a well-trained CNN model on low-end computation edge devices, it is usually supposed to compress or prune the model under certain computation budget (e. g., FLOPs).
SCOP: Scientific Control for Reliable Neural Network Pruning
To increase the reliability of the results, we prefer to have a more rigorous research design by including a scientific control group as an essential part to minimize the effect of all factors except the association between the filter and expected network output.
Training Binary Neural Networks through Learning with Noisy Supervision
This paper formalizes the binarization operations over neural networks from a learning perspective.
Open-Set Hypothesis Transfer with Semantic Consistency
Unsupervised open-set domain adaptation (UODA) is a realistic problem where unlabeled target data contain unknown classes.
Kernel Based Progressive Distillation for Adder Neural Networks
A convolutional neural network (CNN) with the same architecture is simultaneously initialized and trained as a teacher network, features and weights of ANN and CNN will be transformed to a new space to eliminate the accuracy drop.
Searching for Low-Bit Weights in Quantized Neural Networks
Quantized neural networks with low-bit weights and activations are attractive for developing AI accelerators.
AdderSR: Towards Energy Efficient Image Super-Resolution
To this end, we thoroughly analyze the relationship between an adder operation and the identity mapping and insert shortcuts to enhance the performance of SR models using adder networks.
Adversarially Robust Neural Architectures
We explore the relationship among adversarial robustness, Lipschitz constant, and architecture parameters and show that an appropriate constraint on architecture parameters could reduce the Lipschitz constant to further improve the robustness.
Approximated Bilinear Modules for Temporal Modeling
Specifically, we show how two-layer subnets in CNNs can be converted to temporal bilinear modules by adding an auxiliary-branch.
Learning Disentangled Representations with Latent Variation Predictability
Given image pairs generated by latent codes varying in a single dimension, this varied dimension could be closely correlated with these image pairs if the representation is well disentangled.
Optical Flow Distillation: Towards Efficient and Stable Video Style Transfer
This paper proposes to learn a lightweight video style transfer network via knowledge distillation paradigm.
DeepMnemonic: Password Mnemonic Generation via Deep Attentive Encoder-Decoder Model
Moreover, the user study further validates that the generated mnemonic sentences by DeepMnemonic are useful in helping users memorize strong passwords.
HourNAS: Extremely Fast Neural Architecture Search Through an Hourglass Lens
To achieve an extremely fast NAS while preserving the high accuracy, we propose to identify the vital blocks and make them the priority in the architecture search.
TOAN: Target-Oriented Alignment Network for Fine-Grained Image Categorization with Few Labeled Samples
The challenges of high intra-class variance yet low inter-class fluctuations in fine-grained visual categorization are more severe with few labeled samples, \textit{i. e.,} Fine-Grained categorization problems under the Few-Shot setting (FGFS).
A Semi-Supervised Assessor of Neural Architectures
A graph convolutional neural network is introduced to predict the performance of architectures based on the learned representations and their relation modeled by the graph.
Automatic low-bit hybrid quantization of neural networks through meta learning
With the best searched quantization policy, we subsequently retrain or finetune to further improve the performance of the quantized target network.
Hit-Detector: Hierarchical Trinity Architecture Search for Object Detection
To this end, we propose a hierarchical trinity search framework to simultaneously discover efficient architectures for all components (i. e. backbone, neck, and head) of object detector in an end-to-end manner.
K-Core based Temporal Graph Convolutional Network for Dynamic Graphs
Graph representation learning is a fundamental task in various applications that strives to learn low-dimensional embeddings for nodes that can preserve graph topology information.
DAN: Dual-View Representation Learning for Adapting Stance Classifiers to New Domains
We address the issue of having a limited number of annotations for stance classification in a new domain, by adapting out-of-domain classifiers with domain adaptation.
Distilling portable Generative Adversarial Networks for Image Translation
To promote the capability of student generator, we include a student discriminator to measure the distances between real images, and images generated by student and teacher generators.
Beyond Dropout: Feature Map Distortion to Regularize Deep Neural Networks
On one hand, massive trainable parameters significantly enhance the performance of these deep networks.
Discernible Image Compression
Experiments on benchmarks demonstrate that images compressed by using the proposed method can also be well recognized by subsequent visual recognition and detection models.
On Positive-Unlabeled Classification in GAN
In contrast, it is more reasonable to treat the generated data as unlabeled, which could be positive or negative according to their quality.
AdderNet: Do We Really Need Multiplications in Deep Learning?
The widely-used convolutions in deep neural networks are exactly cross-correlation to measure the similarity between input feature and convolution filters, which involves massive multiplications between float values.
Learning from Bad Data via Generation
A worst-case formulation can be developed over this distribution set, and then be interpreted as a generation task in an adversarial manner.
GhostNet: More Features from Cheap Operations
Deploying convolutional neural networks (CNNs) on embedded devices is difficult due to the limited memory and computation resources.
Ranked #864 on
Image Classification
on ImageNet
Operational Calibration: Debugging Confidence Errors for DNNs in the Field
Trained DNN models are increasingly adopted as integral parts of software systems, but they often perform deficiently in the field.
ReNAS:Relativistic Evaluation of Neural Architecture Search
An effective and efficient architecture performance evaluation scheme is essential for the success of Neural Architecture Search (NAS).
Efficient Residual Dense Block Search for Image Super-Resolution
Focusing on this issue, we propose an efficient residual dense block search algorithm with multiple objectives to hunt for fast, lightweight and accurate networks for image super-resolution.
Positive-Unlabeled Compression on the Cloud
In practice, only a small portion of the original training set is required as positive examples and more useful training examples can be obtained from the massive unlabeled data on the cloud through a PU classifier with an attention based multi-scale feature extractor.
CARS: Continuous Evolution for Efficient Neural Architecture Search
Architectures in the population that share parameters within one SuperNet in the latest generation will be tuned over the training dataset with a few epochs.
Full-Stack Filters to Build Minimum Viable CNNs
Existing works used to decrease the number or size of requested convolution filters for a minimum viable CNN on edge devices.
Learning Instance-wise Sparsity for Accelerating Deep Models
Exploring deep convolutional neural networks of high efficiency and low memory usage is very essential for a wide variety of machine learning tasks.
Attribute Aware Pooling for Pedestrian Attribute Recognition
This paper expands the strength of deep convolutional neural networks (CNNs) to the pedestrian attribute recognition problem by devising a novel attribute aware pooling algorithm.
Co-Evolutionary Compression for Unpaired Image Translation
Generative adversarial networks (GANs) have been successfully used for considerable computer vision tasks, especially the image-to-image translation.
Bilinear Graph Networks for Visual Question Answering
The question-graph exchanges information between these output nodes from image-graph to amplify the implicit yet important relationship between objects.
Ranked #16 on
Visual Question Answering (VQA)
on VQA v2 test-std
Bringing Giant Neural Networks Down to Earth with Unlabeled Data
Specifically, we exploit the unlabeled data to mimic the classification characteristics of giant networks, so that the original capacity can be preserved nicely.
Boosting Operational DNN Testing Efficiency through Conditioning
With the increasing adoption of Deep Neural Network (DNN) models as integral parts of software systems, efficient operational testing of DNNs is much in demand to ensure these models' actual performance in field conditions.
Recognising Agreement and Disagreement between Stances with Reason Comparing Networks
We identify agreement and disagreement between utterances that express stances towards a topic of discussion.
Multi-view Vector-valued Manifold Regularization for Multi-label Image Classification
In computer vision, image datasets used for classification are naturally associated with multiple labels and comprised of multiple views, because each image may contain several objects (e. g. pedestrian, bicycle and tree) and is properly characterized by multiple visual features (e. g. color, texture and shape).
Multi-View Intact Space Learning
In this paper, we propose the Multi-view Intact Space Learning (MISL) algorithm, which integrates the encoded complementary information in multiple views to discover a latent intact representation of the data.
Cost-Sensitive Feature Selection by Optimizing F-Measures
Feature selection is beneficial for improving the performance of general machine learning tasks by extracting an informative subset from the high-dimensional features.
Gated-GAN: Adversarial Gated Networks for Multi-Collection Style Transfer
We propose adversarial gated networks (Gated GAN) to transfer multiple styles in a single model.
Data-Free Learning of Student Networks
Learning portable neural networks is very essential for computer vision for the purpose that pre-trained heavy deep models can be well applied on edge devices such as mobile phones and micro sensors.
Image-Question-Answer Synergistic Network for Visual Dialog
Afterward, in the second stage, answers with high probability of being correct are re-ranked by synergizing with image and question.
Ranked #57 on
Visual Dialog
on Visual Dialog v1.0 test-std
STRIP: A Defence Against Trojan Attacks on Deep Neural Networks
Since the trojan trigger is a secret guarded and exploited by the attacker, detecting such trojan inputs is a challenge, especially at run-time when models are in active operation.
Cryptography and Security
Learning Student Networks via Feature Embedding
Experiments on benchmark datasets and well-trained networks suggest that the proposed algorithm is superior to state-of-the-art teacher-student learning methods in terms of computational and storage complexity.
Learning Versatile Filters for Efficient Convolutional Neural Networks
A series of secondary filters can be derived from a primary filter.
Modeling Local Dependence in Natural Language with Multi-channel Recurrent Neural Networks
In this paper, we propose an improved variant of RNN, Multi-Channel RNN (MC-RNN), to dynamically capture and leverage local semantic structure information.
Robust Student Network Learning
In this way, a portable student network with significantly fewer parameters can achieve a considerable accuracy which is comparable to that of teacher network.
Cross-Target Stance Classification with Self-Attention Networks
In stance classification, the target on which the stance is made defines the boundary of the task, and a classifier is usually trained for prediction on the same target.
Graph Edge Convolutional Neural Networks for Skeleton Based Action Recognition
Considering the complementarity between graph node convolution and graph edge convolution, we additionally construct two hybrid neural networks to combine graph node convolutional neural network and graph edge convolutional neural network using shared intermediate layers.
Attention-GAN for Object Transfiguration in Wild Images
This paper studies the object transfiguration problem in wild images.
Evolutionary Generative Adversarial Networks
In this paper, we propose a novel GAN framework called evolutionary generative adversarial networks (E-GAN) for stable GAN training and improved generative performance.
Beyond Filters: Compact Feature Map for Portable Deep Model
The filter is then re-configured to establish the mapping from original input to the new compact feature map, and the resulting network can preserve intrinsic information of the original network with significantly fewer parameters, which not only decreases the online memory for launching CNN but also accelerates the computation speed.
Towards Evolutional Compression
In contrast to directly recognizing subtle weights or filters as redundant in a given CNN, this paper presents an evolutionary method to automatically eliminate redundant convolution filters.
Perceptual Adversarial Networks for Image-to-Image Transformation
The proposed PAN consists of two feed-forward convolutional neural networks (CNNs), the image transformation network T and the discriminative network D. Through combining the generative adversarial loss and the proposed perceptual adversarial loss, these two networks can be trained alternately to solve image-to-image transformation tasks.
Reinforcement Learning for Learning Rate Control
Stochastic gradient descent (SGD), which updates the model parameters by adding a local gradient times a learning rate at each step, is widely used in model training of machine learning algorithms such as neural networks.
Tag Disentangled Generative Adversarial Networks for Object ImageRe-rendering
The whole framework consists of a disentangling network, a generative network, a tag mapping net, and a discriminative network, which are trained jointly based on a given set of images that are complete/partially tagged(i. e., supervised/semi-supervised setting).
Privileged Multi-label Learning
This paper presents privileged multi-label learning (PrML) to explore and exploit the relationship between labels in multi-label learning problems.
CNNpack: Packing Convolutional Neural Networks in the Frequency Domain
Deep convolutional neural networks (CNNs) are successfully used in a number of applications.
Streaming View Learning
An underlying assumption in conventional multi-view learning algorithms is that all views can be simultaneously accessed.
Streaming Label Learning for Modeling Labels on the Fly
The core of SLL is to explore and exploit the relationships between new labels and past labels and then inherit the relationship into hypotheses of labels to boost the performance of new classifiers.
Parts for the Whole: The DCT Norm for Extreme Visual Recovery
Here we study the extreme visual recovery problem, in which over 90\% of pixel values in a given image are missing.
Local Rademacher Complexity for Multi-label Learning
We analyze the local Rademacher complexity of empirical risk minimization (ERM)-based multi-label learning algorithms, and in doing so propose a new algorithm for multi-label learning.
Sequential Click Prediction for Sponsored Search with Recurrent Neural Networks
Click prediction is one of the fundamental problems in sponsored search.
A Survey on Multi-view Learning
Notably, co-training style algorithms train alternately to maximize the mutual agreement on two distinct views of the data; multiple kernel learning algorithms exploit kernels that naturally correspond to different views and combine kernels either linearly or non-linearly to improve learning performance; and subspace learning algorithms aim to obtain a latent subspace shared by multiple views by assuming that the input views are generated from this latent subspace.
