Search Results for author:
Found 110 papers, 59 papers with code
Hallucinating Visual Instances in Total Absentia
This seemingly minor difference in fact makes the HVITA a much challenging task, as the restoration algorithm would have to not only infer the category of the object in total absentia, but also hallucinate an object of which the appearance is consistent with the background.
Collaboration by Competition: Self-coordinated Knowledge Amalgamation for Multi-talent Student Learning
To this end, we propose a self-coordinate knowledge amalgamation network (SOKA-Net) for learning the multi-talent student model.
EqMotion: Equivariant Multi-agent Motion Prediction with Invariant Interaction Reasoning
In motion prediction tasks, maintaining motion equivariance under Euclidean geometric transformations and invariance of agent interaction is a critical and fundamental principle.
Ranked #1 on
Human Pose Forecasting
on Human3.6M
Partial Network Cloning
Unlike prior methods that update all or at least part of the parameters in the target network throughout the knowledge transfer process, PNC conducts partial parametric "cloning" from a source network and then injects the cloned module to the target, without modifying its parameters.
DepGraph: Towards Any Structural Pruning
Structural pruning enables model acceleration by removing structurally-grouped parameters from neural networks.
Dataset Distillation: A Comprehensive Review
Recent success of deep learning is largely attributed to the sheer amount of data used for training deep neural networks. Despite the unprecedented success, the massive data, unfortunately, significantly increases the burden on storage and transmission and further gives rise to a cumbersome model training process.
Diffusion Probabilistic Model Made Slim
Despite the recent visually-pleasing results achieved, the massive computational cost has been a long-standing flaw for diffusion probabilistic models (DPMs), which, in turn, greatly limits their applications on resource-limited platforms.
AvatarGen: A 3D Generative Model for Animatable Human Avatars
Specifically, we decompose the generative 3D human synthesis into pose-guided mapping and canonical representation with predefined human pose and shape, such that the canonical representation can be explicitly driven to different poses and shapes with the guidance of a 3D parametric human model SMPL.
Task Residual for Tuning Vision-Language Models
Large-scale vision-language models (VLMs) pre-trained on billion-level data have learned general visual representations and broad visual concepts.
Dataset Factorization for Condensation
In this paper, we study dataset distillation (DD), from a novel perspective and introduce a \emph{dataset factorization} approach, termed \emph{HaBa}, which is a plug-and-play strategy portable to any existing DD baseline.
Dataset Distillation via Factorization
In this paper, we study \xw{dataset distillation (DD)}, from a novel perspective and introduce a \emph{dataset factorization} approach, termed \emph{HaBa}, which is a plug-and-play strategy portable to any existing DD baseline.
MetaFormer Baselines for Vision
By simply applying depthwise separable convolutions as token mixer in the bottom stages and vanilla self-attention in the top stages, the resulting model CAFormer sets a new record on ImageNet-1K: it achieves an accuracy of 85. 5% at 224x224 resolution, under normal supervised training without external data or distillation.
Ranked #57 on
Image Classification
on ImageNet
(using extra training data)
Deep Model Reassembly
Given a collection of heterogeneous models pre-trained from distinct sources and with diverse architectures, the goal of DeRy, as its name implies, is to first dissect each model into distinctive building blocks, and then selectively reassemble the derived blocks to produce customized networks under both the hardware resource and performance constraints.
Reachability-Aware Laplacian Representation in Reinforcement Learning
In Reinforcement Learning (RL), Laplacian Representation (LapRep) is a task-agnostic state representation that encodes the geometry of the environment.
Scaling & Shifting Your Features: A New Baseline for Efficient Model Tuning
With the proposed SSF, our model obtains 2. 46% (90. 72% vs. 88. 54%) and 11. 48% (73. 10% vs. 65. 57%) performance improvement on FGVC and VTAB-1k in terms of Top-1 accuracy compared to the full fine-tuning but only fine-tuning about 0. 3M parameters.
Training Spiking Neural Networks with Local Tandem Learning
The LTL rule follows the teacher-student learning approach by mimicking the intermediate feature representations of a pre-trained ANN.
Attention Diversification for Domain Generalization
Under this guidance, a novel Attention Diversification framework is proposed, in which Intra-Model and Inter-Model Attention Diversification Regularization are collaborated to reassign appropriate attention to diverse task-related features.
Bottom-Up 2D Pose Estimation via Dual Anatomical Centers for Small-Scale Persons
In multi-person 2D pose estimation, the bottom-up methods simultaneously predict poses for all persons, and unlike the top-down methods, do not rely on human detection.
AvatarGen: a 3D Generative Model for Animatable Human Avatars
Unsupervised generation of clothed virtual humans with various appearance and animatable poses is important for creating 3D human avatars and other AR/VR applications.
Federated Selective Aggregation for Knowledge Amalgamation
The goal of FedSA is to train a student model for a new task with the help of several decentralized teachers, whose pre-training tasks and data are different and agnostic.
Hierarchical Semi-Supervised Contrastive Learning for Contamination-Resistant Anomaly Detection
Anomaly detection aims at identifying deviant samples from the normal data distribution.
Learning Graph Neural Networks for Image Style Transfer
To this end, we develop an elaborated GNN model with content and style local patches as the graph vertices.
Learning with Recoverable Forgetting
Life-long learning aims at learning a sequence of tasks without forgetting the previously acquired knowledge.
DynaST: Dynamic Sparse Transformer for Exemplar-Guided Image Generation
Prior approaches, despite the promising results, have relied on either estimating dense attention to compute per-point matching, which is limited to only coarse scales due to the quadratic memory cost, or fixing the number of correspondences to achieve linear complexity, which lacks flexibility.
Factorizing Knowledge in Neural Networks
The core idea of KF lies in the modularization and assemblability of knowledge: given a pretrained network model as input, KF aims to decompose it into several factor networks, each of which handles only a dedicated task and maintains task-specific knowledge factorized from the source network.
Slimmable Domain Adaptation
In this paper, we introduce a simple framework, Slimmable Domain Adaptation, to improve cross-domain generalization with a weight-sharing model bank, from which models of different capacities can be sampled to accommodate different accuracy-efficiency trade-offs.
Learning Domain Adaptive Object Detection with Probabilistic Teacher
In addition, we conduct anchor adaptation in parallel with localization adaptation, since anchor can be regarded as a learnable parameter.
Inception Transformer
Recent studies show that Transformer has strong capability of building long-range dependencies, yet is incompetent in capturing high frequencies that predominantly convey local information.
FaceMAE: Privacy-Preserving Face Recognition via Masked Autoencoders
Firstly, randomly masked face images are used to train the reconstruction module in FaceMAE.
Tyger: Task-Type-Generic Active Learning for Molecular Property Prediction
However, existing best deep AL methods are mostly developed for a single type of learning task (e. g., single-label classification), and hence may not perform well in molecular property prediction that involves various task types.
Prompting to Distill: Boosting Data-Free Knowledge Distillation via Reinforced Prompt
Data-free knowledge distillation (DFKD) conducts knowledge distillation via eliminating the dependence of original training data, and has recently achieved impressive results in accelerating pre-trained language models.
M3ED: Multi-modal Multi-scene Multi-label Emotional Dialogue Database
In this work, we propose a Multi-modal Multi-scene Multi-label Emotional Dialogue dataset, M3ED, which contains 990 dyadic emotional dialogues from 56 different TV series, a total of 9, 082 turns and 24, 449 utterances.
Reliable Label Correction is a Good Booster When Learning with Extremely Noisy Labels
This paradigm, however, is prone to significant degeneration under heavy label noise, as the number of clean samples is too small for conventional methods to behave well.
Modeling Motion with Multi-Modal Features for Text-Based Video Segmentation
Text-based video segmentation aims to segment the target object in a video based on a describing sentence.
Ranked #7 on
Referring Expression Segmentation
on A2D Sentences
Optical Flow Estimation
Referring Expression Segmentation
+2
PoseTriplet: Co-evolving 3D Human Pose Estimation, Imitation, and Hallucination under Self-supervision
Existing self-supervised 3D human pose estimation schemes have largely relied on weak supervisions like consistency loss to guide the learning, which, inevitably, leads to inferior results in real-world scenarios with unseen poses.
Ranked #15 on
3D Human Pose Estimation
on MPI-INF-3DHP
Point2Seq: Detecting 3D Objects as Sequences
We further propose a lightweight scene-to-sequence decoder that can auto-regressively generate words conditioned on features from a 3D scene as well as cues from the preceding words.
CAFE: Learning to Condense Dataset by Aligning Features
Dataset condensation aims at reducing the network training effort through condensing a cumbersome training set into a compact synthetic one.
Geometric Structure Preserving Warp for Natural Image Stitching
Further, an optimized GES energy term is presented to reasonably determine the weights of the sampling points on the geometric structure, and the term is added into the Global Similarity Prior (GSP) stitching model called GES-GSP to achieve a smooth transition between local alignment and geometric structure preservation.
PONet: Robust 3D Human Pose Estimation via Learning Orientations Only
Conventional 3D human pose estimation relies on first detecting 2D body keypoints and then solving the 2D to 3D correspondence problem. Despite the promising results, this learning paradigm is highly dependent on the quality of the 2D keypoint detector, which is inevitably fragile to occlusions and out-of-image absences. In this paper, we propose a novel Pose Orientation Net (PONet) that is able to robustly estimate 3D pose by learning orientations only, hence bypassing the error-prone keypoint detector in the absence of image evidence.
Ranked #54 on
3D Human Pose Estimation
on MPI-INF-3DHP
Up to 100$\times$ Faster Data-free Knowledge Distillation
At the heart of our approach is a novel strategy to reuse the shared common features in training data so as to synthesize different data instances.
Safe Distillation Box
In other words, all users may employ a model in SDB for inference, but only authorized users get access to KD from the model.
Shunted Self-Attention via Multi-Scale Token Aggregation
This novel merging scheme enables the self-attention to learn relationships between objects with different sizes and simultaneously reduces the token numbers and the computational cost.
MetaFormer Is Actually What You Need for Vision
Based on this observation, we hypothesize that the general architecture of the Transformers, instead of the specific token mixer module, is more essential to the model's performance.
Ranked #9 on
Semantic Segmentation
on DensePASS
Meta Clustering Learning for Large-scale Unsupervised Person Re-identification
Unsupervised Person Re-identification (U-ReID) with pseudo labeling recently reaches a competitive performance compared to fully-supervised ReID methods based on modern clustering algorithms.
Mosaicking to Distill: Knowledge Distillation from Out-of-Domain Data
Knowledge distillation~(KD) aims to craft a compact student model that imitates the behavior of a pre-trained teacher in a target domain.
MEmoBERT: Pre-training Model with Prompt-based Learning for Multimodal Emotion Recognition
Multimodal emotion recognition study is hindered by the lack of labelled corpora in terms of scale and diversity, due to the high annotation cost and label ambiguity.
Unleash the Potential of Adaptation Models via Dynamic Domain Labels
In this paper, we propose an embarrassing simple yet highly effective adversarial domain adaptation (ADA) method for effectively training models for alignment.
How Well Does Self-Supervised Pre-Training Perform with Streaming ImageNet?
Prior works on self-supervised pre-training focus on the joint training scenario, where massive unlabeled data are assumed to be given as input all at once, and only then is a learner trained.
Meta-Aggregator: Learning to Aggregate for 1-bit Graph Neural Networks
In this paper, we study a novel meta aggregation scheme towards binarizing graph neural networks (GNNs).
Structure-Aware Feature Generation for Zero-Shot Learning
In this paper, we introduce a novel structure-aware feature generation scheme, termed as SA-GAN, to explicitly account for the topological structure in learning both the latent space and the generative networks.
Boundary Knowledge Translation based Reference Semantic Segmentation
In this paper, we introduce a novel Reference semantic segmentation Network (Ref-Net) to conduct visual boundary knowledge translation.
Visual Boundary Knowledge Translation for Foreground Segmentation
To this end, we propose a Translation Segmentation Network (Trans-Net), which comprises a segmentation network and two boundary discriminators.
Edge-competing Pathological Liver Vessel Segmentation with Limited Labels
The diagnosis of MVI needs discovering the vessels that contain hepatocellular carcinoma cells and counting their number in each vessel, which depends heavily on experiences of the doctor, is largely subjective and time-consuming.
Amalgamating Knowledge From Heterogeneous Graph Neural Networks
In this paper, we study a novel knowledge transfer task in the domain of graph neural networks (GNNs).
Tree-Like Decision Distillation
Knowledge distillation pursues a diminutive yet well-behaved student network by harnessing the knowledge learned by a cumbersome teacher model.
Turning Frequency to Resolution: Video Super-Resolution via Event Cameras
To this end, we propose an Event-based VSR framework (E-VSR), of which the key component is an asynchronous interpolation (EAI) module that reconstructs a high-frequency (HF) video stream with uniform and tiny pixel displacements between neighboring frames from an event stream.
Learning Dynamics via Graph Neural Networks for Human Pose Estimation and Tracking
In this paper, we propose a novel online approach to learning the pose dynamics, which are independent of pose detections in current fame, and hence may serve as a robust estimation even in challenging scenarios including occlusion.
Contrastive Model Inversion for Data-Free Knowledge Distillation
In this paper, we propose Contrastive Model Inversion~(CMI), where the data diversity is explicitly modeled as an optimizable objective, to alleviate the mode collapse issue.
KDExplainer: A Task-oriented Attention Model for Explaining Knowledge Distillation
Knowledge distillation (KD) has recently emerged as an efficacious scheme for learning compact deep neural networks (DNNs).
How Well Does Self-Supervised Pre-Training Perform with Streaming Data?
Prior works on self-supervised pre-training focus on the joint training scenario, where massive unlabeled data are assumed to be given as input all at once, and only then is a learner trained.
Online Multiple Object Tracking with Cross-Task Synergy
On the other hand, such reliable embeddings can boost identity-awareness through memory aggregation, hence strengthen attention modules and suppress drifts.
Training Generative Adversarial Networks in One Stage
Based on the adversarial losses of the generator and discriminator, we categorize GANs into two classes, Symmetric GANs and Asymmetric GANs, and introduce a novel gradient decomposition method to unify the two, allowing us to train both classes in one stage and hence alleviate the training effort.
SPAGAN: Shortest Path Graph Attention Network
SPAGAN therefore allows for a more informative and intact exploration of the graph structure and further {a} more effective aggregation of information from distant neighbors into the center node, as compared to node-based GCN methods.
Self-Born Wiring for Neural Trees
Neural trees aim at integrating deep neural networks and decision trees so as to bring the best of the two worlds, including representation learning from the former and faster inference from the latter.
Mutual-Complementing Framework for Nuclei Detection and Segmentation in Pathology Image
The existing two unsupervised methods are prone to failure on degenerated samples.
Stochastic Partial Swap: Enhanced Model Generalization and Interpretability for Fine-Grained Recognition
Learning mid-level representation for fine-grained recognition is easily dominated by a limited number of highly discriminative patterns, degrading its robustness and generalization capability.
Overcoming Catastrophic Forgetting in Graph Neural Networks
Catastrophic forgetting refers to the tendency that a neural network "forgets" the previous learned knowledge upon learning new tasks.
SnapMix: Semantically Proportional Mixing for Augmenting Fine-grained Data
As the main discriminative information of a fine-grained image usually resides in subtle regions, methods along this line are prone to heavy label noise in fine-grained recognition.
Ranked #30 on
Fine-Grained Image Classification
on CUB-200-2011
Progressive Network Grafting for Few-Shot Knowledge Distillation
In this paper, we investigate the practical few-shot knowledge distillation scenario, where we assume only a few samples without human annotations are available for each category.
One-sample Guided Object Representation Disassembling
In this paper, we introduce the One-sample Guided Object Representation Disassembling (One-GORD) method, which only requires one annotated sample for each object category to learn disassembled object representation from unannotated images.
Learning Propagation Rules for Attribution Map Generation
Prior gradient-based attribution-map methods rely on handcrafted propagation rules for the non-linear/activation layers during the backward pass, so as to produce gradients of the input and then the attribution map.
Factorizable Graph Convolutional Networks
In this paper, we introduce a novel graph convolutional network (GCN), termed as factorizable graph convolutional network(FactorGCN), that explicitly disentangles such intertwined relations encoded in a graph.
Ranked #3 on
Node Classification
on PATTERN 100k
Tracking-by-Counting: Using Network Flows on Crowd Density Maps for Tracking Multiple Targets
State-of-the-art multi-object tracking~(MOT) methods follow the tracking-by-detection paradigm, where object trajectories are obtained by associating per-frame outputs of object detectors.
Impression Space from Deep Template Network
This network is referred to as the {\emph{Template Network}} because its filters will be used as templates to reconstruct images from the impression.
Disassembling Object Representations without Labels
In this paper, we study a new representation-learning task, which we termed as disassembling object representations.
Learning Oracle Attention for High-fidelity Face Completion
While recent works adopted the attention mechanism to learn the contextual relations among elements of the face, they have largely overlooked the disastrous impacts of inaccurate attention scores; in addition, they fail to pay sufficient attention to key facial components, the completion results of which largely determine the authenticity of a face image.
Distilling Knowledge from Graph Convolutional Networks
To enable the knowledge transfer from the teacher GCN to the student, we propose a local structure preserving module that explicitly accounts for the topological semantics of the teacher.
Data-Free Knowledge Amalgamation via Group-Stack Dual-GAN
Then a dual generator is trained by taking the output from the former generator as input.
DEPARA: Deep Attribution Graph for Deep Knowledge Transferability
In this paper, we propose the DEeP Attribution gRAph (DEPARA) to investigate the transferability of knowledge learned from PR-DNNs.
Data-Free Adversarial Distillation
Knowledge Distillation (KD) has made remarkable progress in the last few years and become a popular paradigm for model compression and knowledge transfer.
Hearing Lips: Improving Lip Reading by Distilling Speech Recognizers
In this paper, we propose a new method, termed as Lip by Speech (LIBS), of which the goal is to strengthen lip reading by learning from speech recognizers.
Ranked #2 on
Lipreading
on CMLR
Dynamic Instance Normalization for Arbitrary Style Transfer
Prior normalization methods rely on affine transformations to produce arbitrary image style transfers, of which the parameters are computed in a pre-defined way.
Deep Model Transferability from Attribution Maps
Exploring the transferability between heterogeneous tasks sheds light on their intrinsic interconnections, and consequently enables knowledge transfer from one task to another so as to reduce the training effort of the latter.
Customizing Student Networks From Heterogeneous Teachers via Adaptive Knowledge Amalgamation
To this end, we introduce a dual-step strategy that first extracts the task-specific knowledge from the heterogeneous teachers sharing the same sub-task, and then amalgamates the extracted knowledge to build the student network.
Knowledge Amalgamation from Heterogeneous Networks by Common Feature Learning
An increasing number of well-trained deep networks have been released online by researchers and developers, enabling the community to reuse them in a plug-and-play way without accessing the training annotations.
One-pass Multi-task Networks with Cross-task Guided Attention for Brain Tumor Segmentation
The model cascade (MC) strategy significantly alleviates the class imbalance issue via running a set of individual deep models for coarse-to-fine segmentation.
Ranked #1 on
Brain Tumor Segmentation
on BRATS-2015
Amalgamating Filtered Knowledge: Learning Task-customized Student from Multi-task Teachers
Many well-trained Convolutional Neural Network(CNN) models have now been released online by developers for the sake of effortless reproducing.
Not All Parts Are Created Equal: 3D Pose Estimation by Modelling Bi-directional Dependencies of Body Parts
We model parts with higher DOFs like the elbows, as dependent components of the corresponding parts with lower DOFs like the torso, of which the 3D locations can be more reliably estimated.
Student Becoming the Master: Knowledge Amalgamation for Joint Scene Parsing, Depth Estimation, and More
In this paper, we investigate a novel deep-model reusing task.
A Light Dual-Task Neural Network for Haze Removal
In LDTNet, the haze-free image and the transmission map are produced simultaneously.
Amalgamating Knowledge towards Comprehensive Classification
We propose in this paper to study a new model-reusing task, which we term as \emph{knowledge amalgamation}.
Wide Activation for Efficient and Accurate Image Super-Resolution
Keras-based implementation of WDSR, EDSR and SRGAN for single image super-resolution
Ranked #4 on
Multi-Frame Super-Resolution
on PROBA-V
Geometry-Aware Scene Text Detection With Instance Transformation Network
Localizing text in the wild is challenging in the situations of complicated geometric layout of the targets like random orientation and large aspect ratio.
Dual Swap Disentangling
To achieve disentangling using the labeled pairs, we follow a "encoding-swap-decoding" process, where we first swap the parts of their encodings corresponding to the shared attribute and then decode the obtained hybrid codes to reconstruct the original input pairs.
Anchor-based Nearest Class Mean Loss for Convolutional Neural Networks
Discriminative features are obtained by constraining the deep CNNs to map training samples to the corresponding anchors as close as possible.
Horizontal Pyramid Matching for Person Re-identification
Despite the remarkable recent progress, person re-identification (Re-ID) approaches are still suffering from the failure cases where the discriminative body parts are missing.
Ranked #53 on
Person Re-Identification
on DukeMTMC-reID
Deep Motion Boundary Detection
In this paper, we propose the first dedicated end-to-end deep learning approach for motion boundary detection, which we term as MoBoNet.
FishEyeRecNet: A Multi-Context Collaborative Deep Network for Fisheye Image Rectification
Images captured by fisheye lenses violate the pinhole camera assumption and suffer from distortions.
A Performance Evaluation of Local Features for Image Based 3D Reconstruction
To obtain a comprehensive evaluation, we choose to include both float type features and binary ones.
Improving Object Detection from Scratch via Gated Feature Reuse
In this paper, we present a simple and parameter-efficient drop-in module for one-stage object detectors like SSD when learning from scratch (i. e., without pre-trained models).
Non-Markovian Globally Consistent Multi-Object Tracking
Many state-of-the-art approaches to multi-object tracking rely on detecting them in each frame independently, grouping detections into short but reliable trajectory segments, and then further grouping them into full trajectories.
On Compressing Deep Models by Low Rank and Sparse Decomposition
Deep compression refers to removing the redundancy of parameters and feature maps for deep learning models.
Globally Consistent Multi-People Tracking using Motion Patterns
Many state-of-the-art approaches to people tracking rely on detecting them in each frame independently, grouping detections into short but reliable trajectory segments, and then further grouping them into full trajectories.
Do We Need Binary Features for 3D Reconstruction?
Binary features have been incrementally popular in the past few years due to their low memory footprints and the efficient computation of Hamming distance between binary descriptors.
What Players do with the Ball: A Physically Constrained Interaction Modeling
Tracking the ball is critical for video-based analysis of team sports.
Predicting People's 3D Poses from Short Sequences
We propose an efficient approach to exploiting motion information from consecutive frames of a video sequence to recover the 3D pose of people.
Predicting people’s 3D poses from short sequences
We propose an efficient approach to exploiting motion information from consecutive frames of a video sequence to recover the 3D pose of people.
Ranked #268 on
3D Human Pose Estimation
on Human3.6M
Globally Optimal Cell Tracking using Integer Programming
We propose a novel approach to automatically tracking cell populations in time-lapse images.
Multiple human pose estimation with temporally consistent 3d pictorial structures
To address these challenges, we propose a temporally consistent 3D Pictorial Structures model (3DPS) for multiple human pose estimation from multiple camera views.
Ranked #16 on
3D Multi-Person Pose Estimation
on Campus
