Search Results for author:
Found 215 papers, 96 papers with code
Improving Multiple Sclerosis Lesion Segmentation Across Clinical Sites: A Federated Learning Approach with Noise-Resilient Training
Our approach enables collaboration among multiple clinical sites without compromising data privacy under a federated learning paradigm that incorporates a noise-robust training strategy based on label correction.
DiffBIR: Towards Blind Image Restoration with Generative Diffusion Prior
We present DiffBIR, which leverages pretrained text-to-image diffusion models for blind image restoration problem.
Ranked #1 on
Blind Face Restoration
on LFW
Boosting Residual Networks with Group Knowledge
Specifically, we implicitly divide all subnets into hierarchical groups by subnet-in-subnet sampling, aggregate the knowledge of different subnets in each group during training, and exploit upper-level group knowledge to supervise lower-level subnet groups.
STEERER: Resolving Scale Variations for Counting and Localization via Selective Inheritance Learning
Scale variation is a deep-rooted problem in object counting, which has not been effectively addressed by existing scale-aware algorithms.
Masked Motion Predictors are Strong 3D Action Representation Learners
To be specific, the proposed MAMP takes as input the masked spatio-temporal skeleton sequence and predicts the corresponding temporal motion of the masked human joints.
Experts Weights Averaging: A New General Training Scheme for Vision Transformers
As Vision Transformers (ViTs) are gradually surpassing CNNs in various visual tasks, one may question: if a training scheme specifically for ViTs exists that can also achieve performance improvement without increasing inference cost?
MCTformer+: Multi-Class Token Transformer for Weakly Supervised Semantic Segmentation
Building upon the observation that the attended regions of the one-class token in the standard vision transformer can contribute to a class-agnostic localization map, we explore the potential of the transformer model to capture class-specific attention for class-discriminative object localization by learning multiple class tokens.
Object Localization
Weakly supervised Semantic Segmentation
+1
A general Temperature-Guided Language model to engineer enhanced Stability and Activity in Proteins
Designing protein mutants with high stability and activity is a critical yet challenging task in protein engineering.
Theoretically Guaranteed Policy Improvement Distilled from Model-Based Planning
Model-based reinforcement learning (RL) has demonstrated remarkable successes on a range of continuous control tasks due to its high sample efficiency.
Meta-Transformer: A Unified Framework for Multimodal Learning
Multimodal learning aims to build models that can process and relate information from multiple modalities.
What Can Simple Arithmetic Operations Do for Temporal Modeling?
We conduct comprehensive ablation studies on the instantiation of ATMs and demonstrate that this module provides powerful temporal modeling capability at a low computational cost.
Ranked #3 on
Action Recognition
on Something-Something V1
MotionGPT: Finetuned LLMs are General-Purpose Motion Generators
Generating realistic human motion from given action descriptions has experienced significant advancements because of the emerging requirement of digital humans.
UniG3D: A Unified 3D Object Generation Dataset
However, the quality and diversity of existing 3D object generation methods are constrained by the inadequacies of existing 3D object datasets, including issues related to text quality, the incompleteness of multi-modal data representation encompassing 2D rendered images and 3D assets, as well as the size of the dataset.
Adaptive Hierarchical SpatioTemporal Network for Traffic Forecasting
In this work, we propose an Adaptive Hierarchical SpatioTemporal Network (AHSTN) to promote traffic forecasting by exploiting the spatial hierarchy and modeling multi-scale spatial correlations.
Retrieve Anyone: A General-purpose Person Re-identification Task with Instructions
This paper strives to resolve this problem by proposing a new instruct-ReID task that requires the model to retrieve images according to the given image or language instructions. Our instruct-ReID is a more general ReID setting, where existing ReID tasks can be viewed as special cases by designing different instructions.
LAMM: Language-Assisted Multi-Modal Instruction-Tuning Dataset, Framework, and Benchmark
2) We demonstrate the detailed methods of constructing instruction-tuning datasets and benchmarks for MLLMs, which will enable future research on MLLMs to scale up and extend to other domains, tasks, and modalities faster.
Bi-LRFusion: Bi-Directional LiDAR-Radar Fusion for 3D Dynamic Object Detection
LiDAR and Radar are two complementary sensing approaches in that LiDAR specializes in capturing an object's 3D shape while Radar provides longer detection ranges as well as velocity hints.
PVT-SSD: Single-Stage 3D Object Detector with Point-Voxel Transformer
The key to associating the two different representations is our introduced input-dependent Query Initialization module, which could efficiently generate reference points and content queries.
Clothes-Invariant Feature Learning by Causal Intervention for Clothes-Changing Person Re-identification
Clothes-invariant feature extraction is critical to the clothes-changing person re-identification (CC-ReID).
Clothes Changing Person Re-Identification
Person Re-Identification
Stimulative Training++: Go Beyond The Performance Limits of Residual Networks
In this work, we aim to re-investigate the training process of residual networks from a novel social psychology perspective of loafing, and further propose a new training scheme as well as three improved strategies for boosting residual networks beyond their performance limits.
Seeing is not always believing: Benchmarking Human and Model Perception of AI-Generated Images
Along with this, we conduct the model capability of AI-Generated images detection evaluation MPBench and the top-performing model from MPBench achieves a 13% failure rate under the same setting used in the human evaluation.
FengWu: Pushing the Skillful Global Medium-range Weather Forecast beyond 10 Days Lead
We present FengWu, an advanced data-driven global medium-range weather forecast system based on Artificial Intelligence (AI).
Automatically Predict Material Properties with Microscopic Image Example Polymer Compatibility
Computer image recognition with machine learning method can make up the defects of artificial judging, giving accurate and quantitative judgement.
HumanBench: Towards General Human-centric Perception with Projector Assisted Pretraining
Specifically, we propose a \textbf{HumanBench} based on existing datasets to comprehensively evaluate on the common ground the generalization abilities of different pretraining methods on 19 datasets from 6 diverse downstream tasks, including person ReID, pose estimation, human parsing, pedestrian attribute recognition, pedestrian detection, and crowd counting.
Ranked #1 on
Pedestrian Attribute Recognition
on PA-100K
UniHCP: A Unified Model for Human-Centric Perceptions
When adapted to a specific task, UniHCP achieves new SOTAs on a wide range of human-centric tasks, e. g., 69. 8 mIoU on CIHP for human parsing, 86. 18 mA on PA-100K for attribute prediction, 90. 3 mAP on Market1501 for ReID, and 85. 8 JI on CrowdHuman for pedestrian detection, performing better than specialized models tailored for each task.
Ranked #1 on
Pedestrian Attribute Recognition
on PETA
Multi-Scale Control Signal-Aware Transformer for Motion Synthesis without Phase
As past poses often contain useful auxiliary hints, in this paper, we propose a task-agnostic deep learning method, namely Multi-scale Control Signal-aware Transformer (MCS-T), with an attention based encoder-decoder architecture to discover the auxiliary information implicitly for synthesizing controllable motion without explicitly requiring auxiliary information such as phase.
Saliency Guided Contrastive Learning on Scene Images
Despite being feasible, recent works largely overlooked discovering the most discriminative regions for contrastive learning to object representations in scene images.
Learning from pseudo-labels: deep networks improve consistency in longitudinal brain volume estimation
An accurate and robust quantitative measurement of brain volume change is paramount for translational research and clinical applications.
Fast-BEV: A Fast and Strong Bird's-Eye View Perception Baseline
Our Fast-BEV consists of five parts, We novelly propose (1) a lightweight deployment-friendly view transformation which fast transfers 2D image feature to 3D voxel space, (2) an multi-scale image encoder which leverages multi-scale information for better performance, (3) an efficient BEV encoder which is particularly designed to speed up on-vehicle inference.
$β$-DARTS++: Bi-level Regularization for Proxy-robust Differentiable Architecture Search
To address the robustness problem, we first benchmark different NAS methods under a wide range of proxy data, proxy channels, proxy layers and proxy epochs, since the robustness of NAS under different kinds of proxies has not been explored before.
Crossing the Gap: Domain Generalization for Image Captioning
In this paper, we introduce a new setting called Domain Generalization for Image Captioning (DGIC), where the data from the target domain is unseen in the learning process.
Learning Multi-Modal Class-Specific Tokens for Weakly Supervised Dense Object Localization
Weakly supervised dense object localization (WSDOL) relies generally on Class Activation Mapping (CAM), which exploits the correlation between the class weights of the image classifier and the pixel-level features.
Open-Set Fine-Grained Retrieval via Prompting Vision-Language Evaluator
PLEor could leverage pre-trained CLIP model to infer the discrepancies encompassing both pre-defined and unknown subcategories, called category-specific discrepancies, and transfer them to the backbone network trained in the close-set scenarios.
Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?
Most existing text-video retrieval methods focus on cross-modal matching between the visual content of videos and textual query sentences.
Ranked #4 on
Video Retrieval
on VATEX
Ponder: Point Cloud Pre-training via Neural Rendering
We propose a novel approach to self-supervised learning of point cloud representations by differentiable neural rendering.
Bidirectional Cross-Modal Knowledge Exploration for Video Recognition with Pre-trained Vision-Language Models
In this paper, we propose a novel framework called BIKE, which utilizes the cross-modal bridge to explore bidirectional knowledge: i) We introduce the Video Attribute Association mechanism, which leverages the Video-to-Text knowledge to generate textual auxiliary attributes for complementing video recognition.
Ranked #1 on
Zero-Shot Action Recognition
on ActivityNet
MM-3DScene: 3D Scene Understanding by Customizing Masked Modeling with Informative-Preserved Reconstruction and Self-Distilled Consistency
Besides, such scenes with progressive masking ratios can also serve to self-distill their intrinsic spatial consistency, requiring to learn the consistent representations from unmasked areas.
3D Point Cloud Pre-training with Knowledge Distillation from 2D Images
The recent success of pre-trained 2D vision models is mostly attributable to learning from large-scale datasets.
Frozen CLIP Model is An Efficient Point Cloud Backbone
This paper introduces Efficient Point Cloud Learning (EPCL), an effective and efficient point cloud learner for directly training high-quality point cloud models with a frozen CLIP model.
GD-MAE: Generative Decoder for MAE Pre-training on LiDAR Point Clouds
In contrast to previous 3D MAE frameworks, which either design a complex decoder to infer masked information from maintained regions or adopt sophisticated masking strategies, we instead propose a much simpler paradigm.
Reconstructing Hand-Held Objects from Monocular Video
The key idea is that the hand motion naturally provides multiple views of the object and the motion can be reliably estimated by a hand pose tracker.
ACE: Cooperative Multi-agent Q-learning with Bidirectional Action-Dependency
In the learning phase, each agent minimizes the TD error that is dependent on how the subsequent agents have reacted to their chosen action.
Ranked #1 on
SMAC
on SMAC 3s5z_vs_3s6z
3D-QueryIS: A Query-based Framework for 3D Instance Segmentation
Previous top-performing methods for 3D instance segmentation often maintain inter-task dependencies and the tendency towards a lack of robustness.
Boosting Semi-Supervised 3D Object Detection with Semi-Sampling
When training a teacher-student semi-supervised framework, we randomly select gt samples and pseudo samples to both labeled frames and unlabeled frames, making a strong data augmentation for them.
The Equalization Losses: Gradient-Driven Training for Long-tailed Object Recognition
Long-tail distribution is widely spread in real-world applications.
Stimulative Training of Residual Networks: A Social Psychology Perspective of Loafing
In this work, we aim to re-investigate the training process of residual networks from a novel social psychology perspective of loafing, and further propose a new training strategy to strengthen the performance of residual networks.
CLIP2Point: Transfer CLIP to Point Cloud Classification with Image-Depth Pre-training
To address this issue, we propose CLIP2Point, an image-depth pre-training method by contrastive learning to transfer CLIP to the 3D domain, and adapt it to point cloud classification.
Ranked #3 on
Training-free 3D Point Cloud Classification
on ScanObjectNN
(using extra training data)
Towards Frame Rate Agnostic Multi-Object Tracking
In this paper, we propose a Frame Rate Agnostic MOT framework with a Periodic training Scheme (FAPS) to tackle the FraMOT problem for the first time.
ZoomNAS: Searching for Whole-body Human Pose Estimation in the Wild
We propose a single-network approach, termed ZoomNet, to take into account the hierarchical structure of the full human body and solve the scale variation of different body parts.
Ranked #2 on
2D Human Pose Estimation
on COCO-WholeBody
An Empirical Study of Pseudo-Labeling for Image-based 3D Object Detection
We hope this work can provide insights for the image-based 3D detection community under a semi-supervised setting.
Fine-grained Retrieval Prompt Tuning
In this paper, we develop Fine-grained Retrieval Prompt Tuning (FRPT), which steers a frozen pre-trained model to perform the fine-grained retrieval task from the perspectives of sample prompting and feature adaptation.
3D Interacting Hand Pose Estimation by Hand De-occlusion and Removal
Unlike most previous works that directly predict the 3D poses of two interacting hands simultaneously, we propose to decompose the challenging interacting hand pose estimation task and estimate the pose of each hand separately.
Pose for Everything: Towards Category-Agnostic Pose Estimation
In this paper, we introduce the task of Category-Agnostic Pose Estimation (CAPE), which aims to create a pose estimation model capable of detecting the pose of any class of object given only a few samples with keypoint definition.
NSNet: Non-saliency Suppression Sampler for Efficient Video Recognition
On the video level, a temporal attention module is learned under dual video-level supervisions on both the salient and the non-salient representations.
Ranked #3 on
Action Recognition
on ActivityNet
Fast-MoCo: Boost Momentum-based Contrastive Learning with Combinatorial Patches
Contrastive-based self-supervised learning methods achieved great success in recent years.
Action Recognition With Motion Diversification and Dynamic Selection
To address this issue, we introduce a Motion Diversification and Selection (MoDS) module to generate diversified spatio-temporal motion features and then select the suitable motion representation dynamically for categorizing the input video.
Ranked #16 on
Action Recognition
on Something-Something V1
Revisiting Classifier: Transferring Vision-Language Models for Video Recognition
In this study, we focus on transferring knowledge for video classification tasks.
Ranked #1 on
Action Recognition
on ActivityNet
TransVG++: End-to-End Visual Grounding with Language Conditioned Vision Transformer
For another, we devise Language Conditioned Vision Transformer that removes external fusion modules and reuses the uni-modal ViT for vision-language fusion at the intermediate layers.
Better Teacher Better Student: Dynamic Prior Knowledge for Knowledge Distillation
Besides, our DPK makes the performance of the student model positively correlated with that of the teacher model, which means that we can further boost the accuracy of students by applying larger teachers.
Domain Invariant Masked Autoencoders for Self-supervised Learning from Multi-domains
While recent self-supervised learning methods have achieved good performances with evaluation set on the same domain as the training set, they will have an undesirable performance decrease when tested on a different domain.
MS Lesion Segmentation: Revisiting Weighting Mechanisms for Federated Learning
In addition, the segmentation loss function in each client is also re-weighted according to the lesion volume for the data during training.
Not All Tokens Are Equal: Human-centric Visual Analysis via Token Clustering Transformer
Vision transformers have achieved great successes in many computer vision tasks.
Ranked #4 on
2D Human Pose Estimation
on COCO-WholeBody
Unsupervised Learning of Accurate Siamese Tracking
As unlimited self-supervision signals can be obtained by tracking a video along a cycle in time, we investigate evolving a Siamese tracker by tracking videos forward-backward.
SeCo: Separating Unknown Musical Visual Sounds with Consistency Guidance
Recent years have witnessed the success of deep learning on the visual sound separation task.
DR.VIC: Decomposition and Reasoning for Video Individual Counting
Instead of relying on the Multiple Object Tracking (MOT) techniques, we propose to solve the problem by decomposing all pedestrians into the initial pedestrians who existed in the first frame and the new pedestrians with separate identities in each following frame.
Backbone is All Your Need: A Simplified Architecture for Visual Object Tracking
Exploiting a general-purpose neural architecture to replace hand-wired designs or inductive biases has recently drawn extensive interest.
Multi-class Token Transformer for Weakly Supervised Semantic Segmentation
To this end, we propose a Multi-class Token Transformer, termed as MCTformer, which uses multiple class tokens to learn interactions between the class tokens and the patch tokens.
Object Localization
Weakly supervised Semantic Segmentation
+1
$β$-DARTS: Beta-Decay Regularization for Differentiable Architecture Search
Neural Architecture Search~(NAS) has attracted increasingly more attention in recent years because of its capability to design deep neural networks automatically.
3D Object Detection from Images for Autonomous Driving: A Survey
3D object detection from images, one of the fundamental and challenging problems in autonomous driving, has received increasing attention from both industry and academia in recent years.
Trajectory Forecasting from Detection with Uncertainty-Aware Motion Encoding
Trajectories obtained from object detection and tracking are inevitably noisy, which could cause serious forecasting errors to predictors built on ground truth trajectories.
MonoDistill: Learning Spatial Features for Monocular 3D Object Detection
Finally, this LiDAR Net can serve as the teacher to transfer the learned knowledge to the baseline model.
Pseudo-Labeled Auto-Curriculum Learning for Semi-Supervised Keypoint Localization
PL approaches apply pseudo-labels to unlabeled data, and then train the model with a combination of the labeled and pseudo-labeled data iteratively.
RePre: Improving Self-Supervised Vision Transformer with Reconstructive Pre-training
Recently, self-supervised vision transformers have attracted unprecedented attention for their impressive representation learning ability.
Accelerating Neural Network Optimization Through an Automated Control Theory Lens
We conduct experiments both from a control theory lens through a phase locus verification and from a network training lens on several models, including CNNs, Transformers, MLPs, and on benchmark datasets.
b-DARTS: Beta-Decay Regularization for Differentiable Architecture Search
Neural Architecture Search (NAS) has attracted increasingly more attention in recent years because of its capability to design deep neural network automatically.
A Continuous Mapping For Augmentation Design
Automated data augmentation (ADA) techniques have played an important role in boosting the performance of deep models.
Revisiting the Transferability of Supervised Pretraining: an MLP Perspective
The pretrain-finetune paradigm is a classical pipeline in visual learning.
Unsupervised Contrastive Learning with Simple Transformation for 3D Point Cloud Data
Though a number of point cloud learning methods have been proposed to handle unordered points, most of them are supervised and require labels for training.
Supervision Exists Everywhere: A Data Efficient Contrastive Language-Image Pre-training Paradigm
Recently, large-scale Contrastive Language-Image Pre-training (CLIP) has attracted unprecedented attention for its impressive zero-shot recognition ability and excellent transferability to downstream tasks.
Deep Instance Segmentation with Automotive Radar Detection Points
Automotive radar provides reliable environmental perception in all-weather conditions with affordable cost, but it hardly supplies semantic and geometry information due to the sparsity of radar detection points.
Improving the Transferability of Supervised Pretraining with an MLP Projector
The pretrain-finetune paradigm is a classical pipeline in visual learning.
Graph-Based 3D Multi-Person Pose Estimation Using Multi-View Images
Following the top-down paradigm, we decompose the task into two stages, i. e. person localization and pose estimation.
Ranked #2 on
3D Multi-Person Pose Estimation
on Panoptic
(using extra training data)
Towards Balanced Learning for Instance Recognition
In this work, we carefully revisit the standard training practice of detectors, and find that the detection performance is often limited by the imbalance during the training process, which generally consists in three levels - sample level, feature level, and objective level.
BN-NAS: Neural Architecture Search with Batch Normalization
We present BN-NAS, neural architecture search with Batch Normalization (BN-NAS), to accelerate neural architecture search (NAS).
PSViT: Better Vision Transformer via Token Pooling and Attention Sharing
Then, a compact set of the possible combinations for different token pooling and attention sharing mechanisms are constructed.
Learning Geometry-Guided Depth via Projective Modeling for Monocular 3D Object Detection
In this paper, we propose to learn geometry-guided depth estimation with projective modeling to advance monocular 3D object detection.
Ranked #7 on
Monocular 3D Object Detection
on KITTI Cars Moderate
Geometry Uncertainty Projection Network for Monocular 3D Object Detection
In this paper, we propose a Geometry Uncertainty Projection Network (GUP Net) to tackle the error amplification problem at both inference and training stages.
3D Object Detection From Monocular Images
Depth Estimation
+2
Leveraging Auxiliary Tasks with Affinity Learning for Weakly Supervised Semantic Segmentation
Motivated by the significant inter-task correlation, we propose a novel weakly supervised multi-task framework termed as AuxSegNet, to leverage saliency detection and multi-label image classification as auxiliary tasks to improve the primary task of semantic segmentation using only image-level ground-truth labels.
GLiT: Neural Architecture Search for Global and Local Image Transformer
We introduce the first Neural Architecture Search (NAS) method to find a better transformer architecture for image recognition.
Ranked #459 on
Image Classification
on ImageNet
Mutual CRF-GNN for Few-Shot Learning
In this MCGN, the labels and features of support data are used by the CRF for inferring GNN affinities in a principled and probabilistic way.
AutoSampling: Search for Effective Data Sampling Schedules
Data sampling acts as a pivotal role in training deep learning models.
ViPNAS: Efficient Video Pose Estimation via Neural Architecture Search
Human pose estimation has achieved significant progress in recent years.
Ranked #26 on
Pose Estimation
on COCO test-dev
(using extra training data)
Layerwise Optimization by Gradient Decomposition for Continual Learning
The gradient for update should be close to the gradient of the new task, consistent with the gradients shared by all old tasks, and orthogonal to the space spanned by the gradients specific to the old tasks.
PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loop
Regression-based methods have recently shown promising results in reconstructing human meshes from monocular images.
Ranked #53 on
3D Human Pose Estimation
on 3DPW
(using extra training data)
3D human pose and shape estimation
3D Human Reconstruction
+2
Delving into Localization Errors for Monocular 3D Object Detection
Estimating 3D bounding boxes from monocular images is an essential component in autonomous driving, while accurate 3D object detection from this kind of data is very challenging.
Ranked #15 on
Monocular 3D Object Detection
on KITTI Cars Moderate
Gradient Regularized Contrastive Learning for Continual Domain Adaptation
To better understand this issue, we study the problem of continual domain adaptation, where the model is presented with a labelled source domain and a sequence of unlabelled target domains.
Higher Performance Visual Tracking with Dual-Modal Localization
Visual Object Tracking (VOT) has synchronous needs for both robustness and accuracy.
Real-Time Visual Object Tracking via Few-Shot Learning
Visual Object Tracking (VOT) can be seen as an extended task of Few-Shot Learning (FSL).
Probabilistic Graph Attention Network with Conditional Kernels for Pixel-Wise Prediction
In contrast to previous works directly considering multi-scale feature maps obtained from the inner layers of a primary CNN architecture, and simply fusing the features with weighted averaging or concatenation, we propose a probabilistic graph attention network structure based on a novel Attention-Gated Conditional Random Fields (AG-CRFs) model for learning and fusing multi-scale representations in a principled manner.
Aggregation With Feature Detection
Aggregating features from different depths of a network is widely adopted to improve the network capability.
Inception Convolution with Efficient Dilation Search
To develop a practical method for learning complex inception convolution based on the data, a simple but effective search algorithm, referred to as efficient dilation optimization (EDO), is developed.
DETR for Crowd Pedestrian Detection
Furthermore, the bipartite match of ED harms the training efficiency due to the large ground truth number in crowd scenes.
Full Matching on Low Resolution for Disparity Estimation
To this end, we first propose to decompose the full matching task into multiple stages of the cost aggregation module.
Direct Depth Learning Network for Stereo Matching
To make the Adaptive-Grained Depth Refinement stage robust to the coarse depth and adaptive to the depth range of the points, the Granularity Uncertainty is introduced to Adaptive-Grained Depth Refinement stage.
Temporal-Channel Transformer for 3D Lidar-Based Video Object Detection in Autonomous Driving
As a special design of this transformer, the information encoded in the encoder is different from that in the decoder, i. e. the encoder encodes temporal-channel information of multiple frames while the decoder decodes the spatial-channel information for the current frame in a voxel-wise manner.
Evolving Search Space for Neural Architecture Search
The automation of neural architecture design has been a coveted alternative to human experts.
Adaptive Gradient Method with Resilience and Momentum
Several variants of stochastic gradient descent (SGD) have been proposed to improve the learning effectiveness and efficiency when training deep neural networks, among which some recent influential attempts would like to adaptively control the parameter-wise learning rate (e. g., Adam and RMSProp).
Category-specific Semantic Coherency Learning for Fine-grained Image Recognition
Existing deep learning based weakly supervised fine-grained image recognition (WFGIR) methods usually pick out the discriminative regions from the high-level feature (HLF) maps directly.
Once Quantization-Aware Training: High Performance Extremely Low-bit Architecture Search
Therefore, we propose to combine Network Architecture Search methods with quantization to enjoy the merits of the two sides.
Improving Auto-Augment via Augmentation-Wise Weight Sharing
On CIFAR-10, we achieve a top-1 error rate of 1. 24%, which is currently the best performing single model without extra training data.
Once Quantized for All: Progressively Searching for Quantized Compact Models
Automatic search of Quantized Neural Networks (QNN) has attracted a lot of attention.
SAMOT: Switcher-Aware Multi-Object Tracking and Still Another MOT Measure
Besides, we propose a new MOT evaluation measure, Still Another IDF score (SAIDF), aiming to focus more on identity issues. This new measure may overcome some problems of the previous measures and provide a better insight for identity issues in MOT.
Improving Deep Video Compression by Resolution-adaptive Flow Coding
In this work, we propose a new framework called Resolution-adaptive Flow Coding (RaFC) to effectively compress the flow maps globally and locally, in which we use multi-resolution representations instead of single-resolution representations for both the input flow maps and the output motion features of the MV encoder.
Exploring the Hierarchy in Relation Labels for Scene Graph Generation
By assigning each relationship a single label, current approaches formulate the relationship detection as a classification problem.
BriNet: Towards Bridging the Intra-class and Inter-class Gaps in One-Shot Segmentation
(2) The object categories at the training and inference stages have no overlap, leaving the inter-class gap.
Rethinking Pseudo-LiDAR Representation
Based on this observation, we design an image based CNN detector named Patch-Net, which is more generalized and can be instantiated as pseudo-LiDAR based 3D detectors.
Whole-Body Human Pose Estimation in the Wild
This paper investigates the task of 2D human whole-body pose estimation, which aims to localize dense landmarks on the entire human body including face, hands, body, and feet.
Ranked #8 on
2D Human Pose Estimation
on COCO-WholeBody
Differentiable Hierarchical Graph Grouping for Multi-Person Pose Estimation
The modules of HGG can be trained end-to-end with the keypoint detection network and is able to supervise the grouping process in a hierarchical manner.
Ranked #3 on
Keypoint Detection
on OCHuman
3D Human Mesh Regression with Dense Correspondence
This paper proposes a model-free 3D human mesh estimation framework, named DecoMR, which explicitly establishes the dense correspondence between the mesh and the local image features in the UV space (i. e. a 2D space used for texture mapping of 3D mesh).
Ranked #1 on
3D Human Reconstruction
on Surreal
Scope Head for Accurate Localization in Object Detection
Existing anchor-based and anchor-free object detectors in multi-stage or one-stage pipelines have achieved very promising detection performance.
Cheaper Pre-training Lunch: An Efficient Paradigm for Object Detection
In this paper, we propose a general and efficient pre-training paradigm, Montage pre-training, for object detection.
Location-Aware Feature Selection Text Detection Network
However, they are behind in accuracy comparing with recent segmentation-based text detectors.
Disentangling and Unifying Graph Convolutions for Skeleton-Based Action Recognition
Spatial-temporal graphs have been widely used by skeleton-based action recognition algorithms to model human action dynamics.
Ranked #1 on
3D Action Recognition
on Assembly101
Content Adaptive and Error Propagation Aware Deep Video Compression
Therefore, the encoder is adaptive to different video contents and achieves better compression performance by reducing the domain gap between the training and testing datasets.
Channel Pruning Guided by Classification Loss and Feature Importance
To this end, we propose a new strategy to suppress the influence of unimportant features (i. e., the features will be removed at the next pruning stage).
Equalization Loss for Long-Tailed Object Recognition
Based on it, we propose a simple but effective loss, named equalization loss, to tackle the problem of long-tailed rare categories by simply ignoring those gradients for rare categories.
Ranked #15 on
Long-tail Learning
on CIFAR-10-LT (ρ=10)
EcoNAS: Finding Proxies for Economical Neural Architecture Search
While many methods have been proposed to improve the efficiency of NAS, the search progress is still laborious because training and evaluating plausible architectures over large search space is time-consuming.
Learning 3D Human Shape and Pose from Dense Body Parts
Reconstructing 3D human shape and pose from monocular images is challenging despite the promising results achieved by the most recent learning-based methods.
Ranked #57 on
3D Human Pose Estimation
on 3DPW
(MPJPE metric)
3D human pose and shape estimation
3D Human Reconstruction
+2
Computation Reallocation for Object Detection
However, classification allocation pattern is usually adopted directly to object detector, which is proved to be sub-optimal.
A Shape Transformation-based Dataset Augmentation Framework for Pedestrian Detection
Alternatively, to access much more natural-looking pedestrians, we propose to augment pedestrian detection datasets by transforming real pedestrians from the same dataset into different shapes.
TRB: A Novel Triplet Representation for Understanding 2D Human Body
In this paper, we propose the Triplet Representation for Body (TRB) -- a compact 2D human body representation, with skeleton keypoints capturing human pose information and contour keypoints containing human shape information.
Improving One-shot NAS by Suppressing the Posterior Fading
In this paper, we analyse existing weight sharing one-shot NAS approaches from a Bayesian point of view and identify the posterior fading problem, which compromises the effectiveness of shared weights.
IntersectGAN: Learning Domain Intersection for Generating Images with Multiple Attributes
For example, given two image domains $X_1$ and $X_2$ with certain attributes, the intersection $X_1 \cap X_2$ denotes a new domain where images possess the attributes from both $X_1$ and $X_2$ domains.
GradNet: Gradient-Guided Network for Visual Object Tracking
In this work, we propose a novel gradient-guided network to exploit the discriminative information in gradients and update the template in the siamese network through feed-forward and backward operations.
Ranked #3 on
Visual Object Tracking
on OTB-2015
(Precision metric)
Structured Modeling of Joint Deep Feature and Prediction Refinement for Salient Object Detection
We formulate the CRF graphical model that involves message-passing of feature-feature, feature-prediction, and prediction-prediction, from the coarse scale to the finer scale, to update the features and the corresponding predictions.
Crowd Counting with Deep Structured Scale Integration Network
Automatic estimation of the number of people in unconstrained crowded scenes is a challenging task and one major difficulty stems from the huge scale variation of people.
Improving Description-based Person Re-identification by Multi-granularity Image-text Alignments
Firstly, the global-global alignment in the Global Contrast (GC) module is for matching the global contexts of images and descriptions.
Ranked #16 on
Text based Person Retrieval
on CUHK-PEDES
MMDetection: Open MMLab Detection Toolbox and Benchmark
In this paper, we introduce the various features of this toolbox.
Improving Action Localization by Progressive Cross-stream Cooperation
Specifically, we first generate a larger set of region proposals by combining the latest region proposals from both streams, from which we can readily obtain a larger set of labelled training samples to help learn better action detection models.
Online Hyper-parameter Learning for Auto-Augmentation Strategy
Data augmentation is critical to the success of modern deep learning techniques.
AM-LFS: AutoML for Loss Function Search
The key contribution of this work is the design of search space which can guarantee the generalization and transferability on different vision tasks by including a bunch of existing prevailing loss functions in a unified formulation.
Contextualized Spatial-Temporal Network for Taxi Origin-Destination Demand Prediction
Finally, a GCC module is applied to model the correlation between all regions by computing a global correlation feature as a weighted sum of all regional features, with the weights being calculated as the similarity between the corresponding region pairs.
PRUNING WITH HINTS: AN EFFICIENT FRAMEWORK FOR MODEL ACCELERATION
Hints can improve the performance of student model by transferring knowledge from teacher model.
Box-driven Class-wise Region Masking and Filling Rate Guided Loss for Weakly Supervised Semantic Segmentation
To address this problem, it is a good choice to learn to segment with weak supervision from bounding boxes.
Weakly-supervised Learning
Weakly supervised Semantic Segmentation
+1
Libra R-CNN: Towards Balanced Learning for Object Detection
In this work, we carefully revisit the standard training practice of detectors, and find that the detection performance is often limited by the imbalance during the training process, which generally consists in three levels - sample level, feature level, and objective level.
Ranked #163 on
Object Detection
on COCO test-dev
Feature Intertwiner for Object Detection
We argue that the reliable set could guide the feature learning of the less reliable set during training - in spirit of student mimicking teacher behavior and thus pushing towards a more compact class centroid in the feature space.
Ranked #148 on
Object Detection
on COCO test-dev
Accurate Monocular Object Detection via Color-Embedded 3D Reconstruction for Autonomous Driving
To this end, we first leverage a stand-alone module to transform the input data from 2D image plane to 3D point clouds space for a better input representation, then we perform the 3D detection using PointNet backbone net to obtain objects 3D locations, dimensions and orientations.
GS3D: An Efficient 3D Object Detection Framework for Autonomous Driving
We present an efficient 3D object detection framework based on a single RGB image in the scenario of autonomous driving.
Ranked #18 on
Vehicle Pose Estimation
on KITTI Cars Hard
Multi-person Articulated Tracking with Spatial and Temporal Embeddings
Our framework consists of two main components,~\ie~SpatialNet and TemporalNet.
SR-LSTM: State Refinement for LSTM towards Pedestrian Trajectory Prediction
In order to address this issue, we propose a data-driven state refinement module for LSTM network (SR-LSTM), which activates the utilization of the current intention of neighbors, and jointly and iteratively refines the current states of all participants in the crowd through a message passing mechanism.