Search Results for author:
Found 77 papers, 23 papers with code
Instruction-Augmented Long-Horizon Planning: Embedding Grounding Mechanisms in Embodied Mobile Manipulation
Enabling humanoid robots to perform long-horizon mobile manipulation planning in real-world environments based on embodied perception and comprehension abilities has been a longstanding challenge.
REF-VLM: Triplet-Based Referring Paradigm for Unified Visual Decoding
To address complex visual decoding scenarios, we introduce the Triplet-Based Referring Paradigm (TRP), which explicitly decouples three critical dimensions in visual decoding tasks through a triplet structure: concepts, decoding types, and targets.
Graph Structure Refinement with Energy-based Contrastive Learning
To tackle these issues, we introduce an unsupervised method based on a joint of generative training and discriminative training to learn graph structure and representation, aiming to improve the discriminative performance of generative models.
NCL++: Nested Collaborative Learning for Long-Tailed Visual Recognition
To achieve the collaborative learning in long-tailed learning, the balanced online distillation is proposed to force the consistent predictions among different experts and augmented copies, which reduces the learning uncertainties.
DCP-NAS: Discrepant Child-Parent Neural Architecture Search for 1-bit CNNs
One natural approach is to use 1-bit CNNs to reduce the computation and memory cost of NAS by taking advantage of the strengths of each in a unified framework, while searching the 1-bit CNNs is more challenging due to the more complicated processes involved.
FM-ViT: Flexible Modal Vision Transformers for Face Anti-Spoofing
The availability of handy multi-modal (i. e., RGB-D) sensors has brought about a surge of face anti-spoofing research.
Q-DETR: An Efficient Low-Bit Quantized Detection Transformer
At the upper level, we introduce a new foreground-aware query matching scheme to effectively transfer the teacher information to distillation-desired features to minimize the conditional information entropy.
Vision Transformer with Attentive Pooling for Robust Facial Expression Recognition
The proposed APP is employed to select the most informative patches on CNN features, and ATP discards unimportant tokens in ViT.
Ranked #10 on
Facial Expression Recognition (FER)
on RAF-DB
Facial Expression Recognition
Facial Expression Recognition (FER)
+1
Q-ViT: Accurate and Fully Quantized Low-bit Vision Transformer
The large pre-trained vision transformers (ViTs) have demonstrated remarkable performance on various visual tasks, but suffer from expensive computational and memory cost problems when deployed on resource-constrained devices.
Perceptual Attacks of No-Reference Image Quality Models with Human-in-the-Loop
No-reference image quality assessment (NR-IQA) aims to quantify how humans perceive visual distortions of digital images without access to their undistorted references.
Adaptive Sparse ViT: Towards Learnable Adaptive Token Pruning by Fully Exploiting Self-Attention
The learnable thresholds are optimized in budget-aware training to balance accuracy and complexity, performing the corresponding pruning configurations for different input instances.
Ranked #6 on
Efficient ViTs
on ImageNet-1K (With LV-ViT-S)
Recurrent Bilinear Optimization for Binary Neural Networks
To address this issue, Recurrent Bilinear Optimization is proposed to improve the learning process of BNNs (RBONNs) by associating the intrinsic bilinear variables in the back propagation process.
Anti-Retroactive Interference for Lifelong Learning
Second, according to the similarity between incremental knowledge and base knowledge, we design an adaptive fusion of incremental knowledge, which helps the model allocate capacity to the knowledge of different difficulties.
SKFlow: Learning Optical Flow with Super Kernels
In this paper, we propose the Super Kernel Flow Network (SKFlow), a CNN architecture to ameliorate the impacts of occlusions on optical flow estimation.
Region-level Contrastive and Consistency Learning for Semi-Supervised Semantic Segmentation
Specifically, we first propose a Region Mask Contrastive (RMC) loss and a Region Feature Contrastive (RFC) loss to accomplish region-level contrastive property.
CATrans: Context and Affinity Transformer for Few-Shot Segmentation
In this work, we effectively integrate the context and affinity information via the proposed novel Context and Affinity Transformer (CATrans) in a hierarchical architecture.
Nested Collaborative Learning for Long-Tailed Visual Recognition
NCL consists of two core components, namely Nested Individual Learning (NIL) and Nested Balanced Online Distillation (NBOD), which focus on the individual supervised learning for each single expert and the knowledge transferring among multiple experts, respectively.
Ranked #7 on
Long-tail Learning
on CIFAR-10-LT (ρ=50)
Feature Selective Transformer for Semantic Image Segmentation
In this work, we focus on fusing multi-scale features from Transformer-based backbones for semantic segmentation, and propose a Feature Selective Transformer (FeSeFormer), which aggregates features from all scales (or levels) for each query feature.
Bi-level Doubly Variational Learning for Energy-based Latent Variable Models
In this paper, we propose Bi-level doubly variational learning (BiDVL), which is based on a new bi-level optimization framework and two tractable variational distributions to facilitate learning EBLVMs.
Coarse-to-Fine Cascaded Networks with Smooth Predicting for Video Facial Expression Recognition
To be specific, the universal features denote the general characteristic of facial emotions within a period and the unique features denote the specific characteristic at this moment.
Facial Expression Recognition
Facial Expression Recognition (FER)
End-to-End Human-Gaze-Target Detection with Transformers
In contrast, we redefine the HGT detection task as detecting human head locations and their gaze targets, simultaneously.
Iwin: Human-Object Interaction Detection via Transformer with Irregular Windows
Iwin Transformer is a hierarchical Transformer which progressively performs token representation learning and token agglomeration within irregular windows.
Confidence Dimension for Deep Learning based on Hoeffding Inequality and Relative Evaluation
Research on the generalization ability of deep neural networks (DNNs) has recently attracted a great deal of attention.
Defending Black-box Skeleton-based Human Activity Classifiers
Our method is featured by full Bayesian treatments of the clean data, the adversaries and the classifier, leading to (1) a new Bayesian Energy-based formulation of robust discriminative classifiers, (2) a new adversary sampling scheme based on natural motion manifolds, and (3) a new post-train Bayesian strategy for black-box defense.
Dynamic Group Transformer: A General Vision Transformer Backbone with Dynamic Group Attention
To reduce the quadratic computation complexity caused by each query attending to all keys/values, various methods have constrained the range of attention within local regions, where each query only attends to keys/values within a hand-crafted window.
Associative Adversarial Learning Based on Selective Attack
We show that our method improves the recognition accuracy of adversarial training on ImageNet by 8. 32% compared with the baseline.
Pale Transformer: A General Vision Transformer Backbone with Pale-Shaped Attention
To reduce the quadratic computation complexity caused by the global self-attention, various methods constrain the range of attention within a local region to improve its efficiency.
POEM: 1-bit Point-wise Operations based on Expectation-Maximization for Efficient Point Cloud Processing
Real-time point cloud processing is fundamental for lots of computer vision tasks, while still challenged by the computational problem on resource-limited edge devices.
LAE : Long-tailed Age Estimation
To improve the performance of facial age estimation, we first formulate a simple standard baseline and build a much strong one by collecting the tricks in pre-training, data augmentation, model architecture, and so on.
Sparse to Dense Motion Transfer for Face Image Animation
Given a source face image and a sequence of sparse face landmarks, our goal is to generate a video of the face imitating the motion of landmarks.
TransFER: Learning Relation-aware Facial Expression Representations with Transformers
Second, to build rich relations between different local patches, the Vision Transformers (ViT) are used in FER, called ViT-FER.
Facial Expression Recognition
Facial Expression Recognition (FER)
+2
The 2nd Anti-UAV Workshop & Challenge: Methods and Results
The 2nd Anti-UAV Workshop \& Challenge aims to encourage research in developing novel and accurate methods for multi-scale object tracking.
3D High-Fidelity Mask Face Presentation Attack Detection Challenge
The threat of 3D masks to face recognition systems is increasingly serious and has been widely concerned by researchers.
Self-Conditioned Probabilistic Learning of Video Rescaling
After optimization, the downscaled video by our framework preserves more meaningful information, which is beneficial for both the upscaling step and the downstream tasks, e. g., video action recognition task.
EAN: Event Adaptive Network for Enhanced Action Recognition
In this paper, we propose a unified action recognition framework to investigate the dynamic nature of video content by introducing the following designs.
Ranked #15 on
Action Recognition
on Something-Something V1
SAR-Net: Shape Alignment and Recovery Network for Category-level 6D Object Pose and Size Estimation
The concatenation of the observed point cloud and symmetric one reconstructs a coarse object shape, thus facilitating object center (3D translation) and 3D size estimation.
Fully Transformer Networks for Semantic Image Segmentation
Transformers have shown impressive performance in various natural language processing and computer vision tasks, due to the capability of modeling long-range dependencies.
Image-to-Video Generation via 3D Facial Dynamics
Video generation from a single face image is an interesting problem and usually tackled by utilizing Generative Adversarial Networks (GANs) to integrate information from the input face image and a sequence of sparse facial landmarks.
Joint Face Image Restoration and Frontalization for Recognition
First, MDFR is a well-designed encoder-decoder architecture which extracts feature representation from an input face image with arbitrary low-quality factors and restores it to a high-quality counterpart.
Contrastive Context-Aware Learning for 3D High-Fidelity Mask Face Presentation Attack Detection
To bridge the gap to real-world applications, we introduce a largescale High-Fidelity Mask dataset, namely CASIA-SURF HiFiMask (briefly HiFiMask).
Depth-conditioned Dynamic Message Propagation for Monocular 3D Object Detection
The objective of this paper is to learn context- and depth-aware feature representation to solve the problem of monocular 3D object detection.
Ranked #14 on
Monocular 3D Object Detection
on KITTI Cars Moderate
Anti-UAV: A Large Multi-Modal Benchmark for UAV Tracking
The releasing of such a large-scale dataset could be a useful initial step in research of tracking UAVs.
Looking Here or There? Gaze Following in 360-Degree Images
Specifically, the local region is obtained as a 2D cone-shaped field along the 2D projection of the sight line starting at the human subject's head position, and the distant region is obtained by searching along the sight line in 3D sphere space.
IDARTS: Interactive Differentiable Architecture Search
Differentiable Architecture Search (DARTS) improves the efficiency of architecture search by learning the architecture and network parameters end-to-end.
Cr-net: A deep classification-regression network for multimodal apparent personality analysis
First impressions strongly influence social interactions, having a high impact in the personal and professional life.
GINet: Graph Interaction Network for Scene Parsing
GI unit is further improved by the SC-loss to enhance the semantic representations over the exemplar-based semantic graph.
Binarized Neural Architecture Search for Efficient Object Recognition
In this paper, binarized neural architecture search (BNAS), with a search space of binarized convolutions, is introduced to produce extremely compressed models to reduce huge computational cost on embedded devices for edge computing.
iffDetector: Inference-aware Feature Filtering for Object Detection
In this paper, we propose a new feature optimization approach to enhance features and suppress background noise in both the training and inference stages.
Self-supervised Video Object Segmentation
The objective of this paper is self-supervised representation learning, with the goal of solving semi-supervised video object segmentation (a. k. a.
Cogradient Descent for Bilinear Optimization
Conventional learning methods simplify the bilinear model by regarding two intrinsically coupled factors independently, which degrades the optimization procedure.
3D Face Anti-spoofing with Factorized Bilinear Coding
We have witnessed rapid advances in both face presentation attack models and presentation attack detection (PAD) in recent years.
Cross-ethnicity Face Anti-spoofing Recognition Challenge: A Review
Although ethnic bias has been verified to severely affect the performance of face recognition systems, it still remains an open research problem in face anti-spoofing.
CASIA-SURF CeFA: A Benchmark for Multi-modal Cross-ethnicity Face Anti-spoofing
Ethnic bias has proven to negatively affect the performance of face recognition systems, and it remains an open research problem in face anti-spoofing.
Static and Dynamic Fusion for Multi-modal Cross-ethnicity Face Anti-spoofing
Regardless of the usage of deep learning and handcrafted methods, the dynamic information from videos and the effect of cross-ethnicity are rarely considered in face anti-spoofing.
Robust Invisible Hyperlinks in Physical Photographs Based on 3D Rendering Attacks
To train a robust decoder against the physical distortion from the real world, a distortion network based on 3D rendering is inserted between the encoder and the decoder to simulate the camera imaging process.
GBCNs: Genetic Binary Convolutional Networks for Enhancing the Performance of 1-bit DCNNs
The BGA method is proposed to modify the binary process of GBCNs to alleviate the local minima problem, which can significantly improve the performance of 1-bit DCNNs.
Aggregation Signature for Small Object Tracking
In this paper, we propose a novel aggregation signature suitable for small object tracking, especially aiming for the challenge of sudden and large drift.
Face Detection on Surveillance Images
In this paper, we perform a comparative performance analysis of some of the well known face detection methods including the few used in that competition, and, compare them to our proposed body pose based face detection method.
Learning to Recognize the Unseen Visual Predicates
Visual relationship recognition models are limited in the ability to generalize from finite seen predicates to unseen ones.
WiderPerson: A Diverse Dataset for Dense Pedestrian Detection in the Wild
To narrow this gap and facilitate future pedestrian detection research, we introduce a large and diverse dataset named WiderPerson for dense pedestrian detection in the wild.
Ranked #3 on
Object Detection
on WiderPerson
(mMR metric)
On visual BMI analysis from facial images
Various facial representations, including geometry based representations and deep learning based, are comprehensively evaluated and analyzed from three perspectives: the overall performance on visual BMI prediction, the redundancy in facial representations and the sensitivity to head pose changes.
RBCN: Rectified Binary Convolutional Networks for Enhancing the Performance of 1-bit DCNNs
Binarized convolutional neural networks (BCNNs) are widely used to improve memory and computation efficiency of deep convolutional neural networks (DCNNs) for mobile and AI chips based applications.
Bayesian Optimized 1-Bit CNNs
Deep convolutional neural networks (DCNNs) have dominated the recent developments in computer vision through making various record-breaking models.
ChaLearn Looking at People: IsoGD and ConGD Large-scale RGB-D Gesture Recognition
The ChaLearn large-scale gesture recognition challenge has been run twice in two workshops in conjunction with the International Conference on Pattern Recognition (ICPR) 2016 and International Conference on Computer Vision (ICCV) 2017, attracting more than $200$ teams round the world.
Consensus Feature Network for Scene Parsing
However, classification networks are dominated by the discriminative portion, so directly applying classification networks to scene parsing will result in inconsistent parsing predictions within one instance and among instances of the same category.
UGAN: Untraceable GAN for Multi-Domain Face Translation
To address this issue, we propose a method called Untraceable GAN, which has a novel source classifier to differentiate which domain an image is translated from, and determines whether the translated image still retains the characteristics of the source domain.
A database for face presentation attack using wax figure faces
Compared to 2D face presentation attacks (e. g. printed photos and video replays), 3D type attacks are more challenging to face recognition systems (FRS) by presenting 3D characteristics or materials similar to real faces.
Supervised Online Hashing via Similarity Distribution Learning
In this paper, we propose to model the similarity distributions between the input data and the hashing codes, upon which a novel supervised online hashing method, dubbed as Similarity Distribution based Online Hashing (SDOH), is proposed, to keep the intrinsic semantic relationship in the produced Hamming space.
How is Gaze Influenced by Image Transformations? Dataset and Model
Data size is the bottleneck for developing deep saliency models, because collecting eye-movement data is very time consuming and expensive.
Adversarial Attacks against Deep Saliency Models
The proposed attack only requires a part of the model information, and is able to generate a sparser and more insidious adversarial perturbation, compared to traditional image-space attacks.
Domain-Aware SE Network for Sketch-based Image Retrieval with Multiplicative Euclidean Margin Softmax
This paper proposes a novel approach for Sketch-Based Image Retrieval (SBIR), for which the key is to bridge the gap between sketches and photos in terms of the data representation.
Attributes in Multiple Facial Images
To address this question, we deploy deep training for facial attributes prediction, and we explore the inconsistency issue among the attributes computed from each single image.
Learning Channel Inter-dependencies at Multiple Scales on Dense Networks for Face Recognition
We propose a new deep network structure for unconstrained face recognition.
Unconstrained Face Detection and Open-Set Face Recognition Challenge
Face detection and recognition benchmarks have shifted toward more difficult environments.
Fusing multiple features for depth-based action recognition
The experiments are conducted on four challenging depth action databases, in order to evaluate and find the best fusion methods generally.
A Study on Cross-Population Age Estimation
Further, we study the amount of data needed in the target population to learn a cross-population age estimator.
