Search Results for author:
Found 168 papers, 81 papers with code
A Language-Based Approach to Fake News Detection Through Interpretable Features and BRNN
We demonstrate that our approach is promising as it achieves similar results on these two datasets as the best performing black box models reported in the literature.
Language that Captivates the Audience: Predicting Affective Ratings of TED Talks in a Multi-Label Classification Task
The aim of the paper is twofold: (1) to automatically predict the ratings assigned by viewers to 14 categories available for TED talks in a multi-label classification task and (2) to determine what types of features drive classification accuracy for each of the categories.
RBF-Softmax: Learning Deep Representative Prototypes with Radial Basis Function Softmax
To address this problem, this paper introduces a novel Radial Basis Function (RBF) distances to replace the commonly used inner products in the softmax loss function, such that it can adaptively assign losses to regularize the intra-class and inter-class distances by reshaping the relative differences, and thus creating more representative prototypes of classes to improve optimization.
Mining Inter-Video Proposal Relations for Video Object Detection
Recent studies have shown that, context aggregating information from proposals in different frames can clearly enhance the performance of video object detection.
Ranked #1 on
Video Object Detection
on ImageNet VID
Automated Classification of Written Proficiency Levels on the CEFR-Scale through Complexity Contours and RNNs
The key to the present paper is the combined use of what we refer to as ‘complexity contours’, a series of measurements of indices of L2 proficiency obtained by a computational tool that implements a sliding window technique, and recurrent neural network (RNN) classifiers that adequately capture the sequential information in those contours.
FANG-COVID: A New Large-Scale Benchmark Dataset for Fake News Detection in German
As the world continues to fight the COVID-19 pandemic, it is simultaneously fighting an ‘infodemic’ – a flood of disinformation and spread of conspiracy theories leading to health threats and the division of society.
Vision Transformer Adapter for Dense Predictions
When fine-tuning on downstream tasks, a modality-specific adapter is used to introduce the data and tasks' prior information into the model, making it suitable for these tasks.
Ranked #1 on
Semantic Segmentation
on ADE20K val
Evaluating the Generalization Ability of Super-Resolution Networks
However, research on the generalization ability of Super-Resolution (SR) networks is currently absent.
Blueprint Separable Residual Network for Efficient Image Super-Resolution
One is the usage of blueprint separable convolution (BSConv), which takes place of the redundant convolution operation.
NTIRE 2022 Challenge on Efficient Super-Resolution: Methods and Results
The aim was to design a network for single image super-resolution that achieved improvement of efficiency measured according to several metrics including runtime, parameters, FLOPs, activations, and memory consumption while at least maintaining the PSNR of 29. 00dB on DIV2K validation set.
ConvMAE: Masked Convolution Meets Masked Autoencoders
Masked auto-encoding for feature pretraining and multi-scale hybrid convolution-transformer architectures can further unleash the potentials of ViT, leading to state-of-the-art performances on image classification, detection and semantic segmentation.
Cross Domain Object Detection by Target-Perceived Dual Branch Distillation
It can adaptively enhance source detector to perceive objects in a target image, by leveraging target proposal contexts from iterative cross-attention.
Pushing on Personality Detection from Verbal Behavior: A Transformer Meets Text Contours of Psycholinguistic Features
Research at the intersection of personality psychology, computer science, and linguistics has recently focused increasingly on modeling and predicting personality from language use.
Dual-AI: Dual-path Actor Interaction Learning for Group Activity Recognition
Learning spatial-temporal relation among multiple actors is crucial for group activity recognition.
POS-BERT: Point Cloud One-Stage BERT Pre-Training
We propose to use the dynamically updated momentum encoder as the tokenizer, which is updated and outputs the dynamic supervision signal along with the training process.
MonoDETR: Depth-aware Transformer for Monocular 3D Object Detection
In this paper, we introduce a simple framework for Monocular DEtection with depth-aware TRansformer, named MonoDETR.
PersFormer: 3D Lane Detection via Perspective Transformer and the OpenLane Benchmark
Methods for 3D lane detection have been recently proposed to address the issue of inaccurate lane layouts in many autonomous driving scenarios (uphill/downhill, bump, etc.).
Ranked #1 on
3D Lane Detection
on OpenLane
X-Learner: Learning Cross Sources and Tasks for Universal Visual Representation
2) Squeeze Stage: X-Learner condenses the model to a reasonable size and learns the universal and generalizable representation for various tasks transferring.
Measuring the Impact of (Psycho-)Linguistic and Readability Features and Their Spill Over Effects on the Prediction of Eye Movement Patterns
There is a growing interest in the combined use of NLP and machine learning methods to predict gaze patterns during naturalistic reading.
Bamboo: Building Mega-Scale Vision Dataset Continually with Human-Machine Synergy
Specifically, we contribute Bamboo Dataset, a mega-scale and information-dense dataset for both classification and detection.
Distillation with Contrast is All You Need for Self-Supervised Point Cloud Representation Learning
Especially, we develop a variant of ViT for 3D point cloud feature extraction, which also achieves comparable results with existing backbones when combined with our framework, and visualization of the attention maps show that our model does understand the point cloud by combining the global shape information and multiple local structural information, which is consistent with the inspiration of our representation learning method.
UniFormer: Unifying Convolution and Self-attention for Visual Recognition
Different from the typical transformer blocks, the relation aggregators in our UniFormer block are equipped with local and global token affinity respectively in shallow and deep layers, allowing to tackle both redundancy and dependency for efficient and effective representation learning.
Ranked #72 on
Image Classification
on ImageNet
CP-Net: Contour-Perturbed Reconstruction Network for Self-Supervised Point Cloud Learning
To fill this gap, we propose a generic Contour-Perturbed Reconstruction Network (CP-Net), which can effectively guide self-supervised reconstruction to learn semantic content in the point cloud, and thus promote discriminative power of point cloud representation.
UniFormer: Unified Transformer for Efficient Spatiotemporal Representation Learning
For Something-Something V1 and V2, our UniFormer achieves new state-of-the-art performances of 60. 9% and 71. 2% top-1 accuracy respectively.
Multi-View Partial (MVP) Point Cloud Challenge 2021 on Completion and Registration: Methods and Results
Based on the MVP dataset, this paper reports methods and results in the Multi-View Partial Point Cloud Challenge 2021 on Completion and Registration.
Reflash Dropout in Image Super-Resolution
Dropout is designed to relieve the overfitting problem in high-level vision tasks but is rarely applied in low-level vision tasks, like image super-resolution (SR).
CPRAL: Collaborative Panoptic-Regional Active Learning for Semantic Segmentation
Acquiring the most representative examples via active learning (AL) can benefit many data-dependent computer vision tasks by minimizing efforts of image-level or pixel-wise annotations.
PointCLIP: Point Cloud Understanding by CLIP
On top of that, we design an inter-view adapter to better extract the global feature and adaptively fuse the few-shot knowledge learned from 3D into CLIP pre-trained in 2D.
A Simple Long-Tailed Recognition Baseline via Vision-Language Model
Recent advances in large-scale contrastive visual-language pretraining shed light on a new pathway for visual recognition.
Ranked #2 on
Long-tail Learning
on ImageNet-LT
VL-LTR: Learning Class-wise Visual-Linguistic Representation for Long-Tailed Visual Recognition
Deep learning-based models encounter challenges when processing long-tailed data in the real world.
Ranked #1 on
Long-tail Learning
on ImageNet-LT
(using extra training data)
Self-slimmed Vision Transformer
Vision transformers (ViTs) have become the popular structures and outperformed convolutional neural networks (CNNs) on various vision tasks.
MorphMLP: A Self-Attention Free, MLP-Like Backbone for Image and Video
Self-attention has become an integral component of the recent network architectures, e. g., Transformer, that dominate major image and video benchmarks.
Ranked #11 on
Action Recognition
on Something-Something V2
(using extra training data)
INTERN: A New Learning Paradigm Towards General Vision
Enormous waves of technological innovations over the past several years, marked by the advances in AI technologies, are profoundly reshaping the industry and the society.
Prediction of Listener Perception of Argumentative Speech in a Crowdsourced Dataset Using (Psycho-)Linguistic and Fluency Features
One of the key communicative competencies is the ability to maintain fluency in monologic speech and the ability to produce sophisticated language to argue a position convincingly.
Tip-Adapter: Training-free CLIP-Adapter for Better Vision-Language Modeling
To further enhance CLIP's few-shot capability, CLIP-Adapter proposed to fine-tune a lightweight residual feature adapter and significantly improves the performance for few-shot classification.
Estimating IRI based on pavement distress type, density, and severity: Insights from machine learning techniques
However, it is costly to measure IRI, and for this reason, certain road classes are excluded from IRI measurements at a network level.
CLIP-Adapter: Better Vision-Language Models with Feature Adapters
Large-scale contrastive vision-language pre-training has shown significant progress in visual representation learning.
Temporally Consistent Video Colorization with Deep Feature Propagation and Self-regularization Learning
We address this problem from a new perspective, by jointly considering colorization and temporal consistency in a unified framework.
UniFormer: Unified Transformer for Efficient Spatial-Temporal Representation Learning
For Something-Something V1 and V2, our UniFormer achieves new state-of-the-art performances of 60. 8% and 71. 4% top-1 accuracy respectively.
Ranked #1 on
Action Recognition
on Something-Something V1
Self-Slimming Vision Transformer
Specifically, we first design a novel Token Slimming Module (TSM), which can boost the inference efficiency of ViTs by dynamic token aggregation.
A Novel Hybrid Convolutional Neural Network for Accurate Organ Segmentation in 3D Head and Neck CT Images
An essential step of RT planning is the accurate segmentation of various organs-at-risks (OARs) in HaN CT images.
Group Shift Pointwise Convolution for Volumetric Medical Image Segmentation
Recent studies have witnessed the effectiveness of 3D convolutions on segmenting volumetric medical images.
Learning Dynamical Human-Joint Affinity for 3D Pose Estimation in Videos
Graph Convolution Network (GCN) has been successfully used for 3D human pose estimation in videos.
Digging into Uncertainty in Self-supervised Multi-view Stereo
Specially, the limitations can be categorized into two types: ambiguious supervision in foreground and invalid supervision in background.
A New Journey from SDRTV to HDRTV
However, most available resources are still in standard dynamic range (SDR).
Discovering "Semantics" in Super-Resolution Networks
Super-resolution (SR) is a fundamental and representative task of low-level vision area.
Transferable Knowledge-Based Multi-Granularity Aggregation Network for Temporal Action Localization: Submission to ActivityNet Challenge 2021
This technical report presents an overview of our solution used in the submission to 2021 HACS Temporal Action Localization Challenge on both Supervised Learning Track and Weakly-Supervised Learning Track.
Transfer Learning
Weakly-supervised Temporal Action Localization
+1
RankSRGAN: Super Resolution Generative Adversarial Networks with Learning to Rank
To address the problem, we propose Super-Resolution Generative Adversarial Networks with Ranker (RankSRGAN) to optimize generator in the direction of different perceptual metrics.
Blind Image Super-Resolution: A Survey and Beyond
This paper serves as a systematic review on recent progress in blind image SR, and proposes a taxonomy to categorize existing methods into three different classes according to their ways of degradation modelling and the data used for solving the SR model.
MixStyle Neural Networks for Domain Generalization and Adaptation
In this work, we address domain generalization with MixStyle, a plug-and-play, parameter-free module that is simply inserted to shallow CNN layers and requires no modification to training objectives.
Prior-Induced Information Alignment for Image Matting
Image matting is an ill-posed problem that aims to estimate the opacity of foreground pixels in an image.
Alzheimer's Disease Detection from Spontaneous Speech through Combining Linguistic Complexity and (Dis)Fluency Features with Pretrained Language Models
In this paper, we combined linguistic complexity and (dis)fluency features with pretrained language models for the task of Alzheimer's disease detection of the 2021 ADReSSo (Alzheimer's Dementia Recognition through Spontaneous Speech) challenge.
Refining Pseudo Labels with Clustering Consensus over Generations for Unsupervised Object Re-identification
Unsupervised object re-identification targets at learning discriminative representations for object retrieval without any annotations.
Scalable Transformers for Neural Machine Translation
In this paper, we propose a novel Scalable Transformers, which naturally contains sub-Transformers of different scales and have shared parameters.
CT-Net: Channel Tensorization Network for Video Classification
It can learn to exploit spatial, temporal and channel attention in a high-dimensional manner, to improve the cooperative power of all the feature dimensions in our CT-Module.
Ranked #6 on
Action Recognition
on Something-Something V1
TSI: Temporal Saliency Integration for Video Action Recognition
Specifically, SME aims to highlight the motion-sensitive area through local-global motion modeling, where the saliency alignment and pyramidal feature difference are conducted successively between neighboring frames to capture motion dynamics with less noises caused by misaligned background.
HDRUNet: Single Image HDR Reconstruction with Denoising and Dequantization
In this work, we propose a novel learning-based approach using a spatially dynamic encoder-decoder network, HDRUNet, to learn an end-to-end mapping for single image HDR reconstruction with denoising and dequantization.
Multiple Domain Experts Collaborative Learning: Multi-Source Domain Generalization For Person Re-Identification
In UDCL, a universal expert supervises the learning of domain experts and continuously gathers knowledge from all domain experts.
FineAction: A Fine-Grained Video Dataset for Temporal Action Localization
Second, the coarse action classes often lead to the ambiguous annotations of temporal boundaries, which are inappropriate for temporal action localization.
Neighbourhood-guided Feature Reconstruction for Occluded Person Re-Identification
Person images captured by surveillance cameras are often occluded by various obstacles, which lead to defective feature representation and harm person re-identification (Re-ID) performance.
NTIRE 2021 Challenge on Perceptual Image Quality Assessment
This paper reports on the NTIRE 2021 challenge on perceptual image quality assessment (IQA), held in conjunction with the New Trends in Image Restoration and Enhancement workshop (NTIRE) workshop at CVPR 2021.
The Impact of ASR on the Automatic Analysis of Linguistic Complexity and Sophistication in Spontaneous L2 Speech
In recent years, automated approaches to assessing linguistic complexity in second language (L2) writing have made significant progress in gauging learner performance, predicting human ratings of the quality of learner productions, and benchmarking L2 development.
Very Lightweight Photo Retouching Network with Conditional Sequential Modulation
Photo retouching aims at improving the aesthetic visual quality of images that suffer from photographic defects such as poor contrast, over/under exposure, and inharmonious saturation.
Self-supervised Multi-view Stereo via Effective Co-Segmentation and Data-Augmentation
Recent studies have witnessed that self-supervised methods based on view synthesis obtain clear progress on multi-view stereo (MVS).
Affordance Transfer Learning for Human-Object Interaction Detection
The proposed method can thus be used to 1) improve the performance of HOI detection, especially for the HOIs with unseen objects; and 2) infer the affordances of novel objects.
Domain Generalization with MixStyle
Our method, termed MixStyle, is motivated by the observation that visual domain is closely related to image style (e. g., photo vs.~sketch images).
Ranked #32 on
Domain Generalization
on PACS
Smart Scribbles for Image Mating
Image matting is an ill-posed problem that usually requires additional user input, such as trimaps or scribbles.
Temporal Context Aggregation Network for Temporal Action Proposal Refinement
In this paper, we propose Temporal Context Aggregation Network (TCANet) to generate high-quality action proposals through "local and global" temporal context aggregation and complementary as well as progressive boundary refinement.
Ranked #3 on
Temporal Action Localization
on ActivityNet-1.3
Investigate Indistinguishable Points in Semantic Segmentation of 3D Point Cloud
This paper investigates the indistinguishable points (difficult to predict label) in semantic segmentation for large-scale 3D point clouds.
PC-HMR: Pose Calibration for 3D Human Mesh Recovery from 2D Images/Videos
By coupling advanced 3D pose estimators and HMR in a serial or parallel manner, these two frameworks can effectively correct human mesh with guidance of a concise pose calibration module.
Detecting Human-Object Interaction via Fabricated Compositional Learning
With the proposed object fabricator, we are able to generate large-scale HOI samples for rare and unseen categories to alleviate the open long-tailed issues in HOI detection.
Unsupervised Person Re-Identification with Multi-Label Learning Guided Self-Paced Clustering
The multi-label learning module leverages a memory feature bank and assigns each image with a multi-label vector based on the similarities between the image and feature bank.
ClassSR: A General Framework to Accelerate Super-Resolution Networks by Data Characteristic
On this basis, we propose a new solution pipeline -- ClassSR that combines classification and SR in a unified framework.
Domain Generalization: A Survey
Generalization to out-of-distribution (OOD) data is a capability natural to humans yet challenging for machines to reproduce.
Multi-scale Information Assembly for Image Matting
Image matting is a long-standing problem in computer graphics and vision, mostly identified as the accurate estimation of the foreground in input images.
Tripartite Information Mining and Integration for Image Matting
Regarding the nature of image matting, most researches have focused on solutions for transition regions.
Exploring Emotion Features and Fusion Strategies for Audio-Video Emotion Recognition
The audio-video based emotion recognition aims to classify a given video into basic emotions.
Learning Geometry-Disentangled Representation for Complementary Understanding of 3D Object Point Cloud
GDANet introduces Geometry-Disentangle Module to dynamically disentangle point clouds into the contour and flat part of 3D objects, respectively denoted by sharp and gentle variation components.
Ranked #5 on
3D Part Segmentation
on ShapeNet-Part
Attention-Driven Dynamic Graph Convolutional Network for Multi-Label Image Recognition
To this end, we propose an Attention-Driven Dynamic Graph Convolutional Network (ADD-GCN) to dynamically generate a specific graph for each image.
Suppressing Mislabeled Data via Grouping and Self-Attention
Specifically, this plug-and-play AFM first leverages a \textit{group-to-attend} module to construct groups and assign attention weights for group-wise samples, and then uses a \textit{mixup} module with the attention weights to interpolate massive noisy-suppressed samples.
Efficient Image Super-Resolution Using Pixel Attention
Pixel attention (PA) is similar as channel attention and spatial attention in formulation.
Conditional Sequential Modulation for Efficient Global Image Retouching
The base network acts like an MLP that processes each pixel independently and the condition network extracts the global features of the input image to generate a condition vector.
AIM 2020 Challenge on Efficient Super-Resolution: Methods and Results
This paper reviews the AIM 2020 challenge on efficient single image super-resolution with focus on the proposed solutions and results.
Collaborative Distillation in the Parameter and Spectrum Domains for Video Action Recognition
Second, the parameter frequency distribution is further adopted to guide the student network to learn the appearance modeling process from the teacher.
BSN++: Complementary Boundary Regressor with Scale-Balanced Relation Modeling for Temporal Action Proposal Generation
In this paper, we present BSN++, a new framework which exploits complementary boundary regressor and relation modeling for temporal proposal generation.
Enhanced Quadratic Video Interpolation
In this work, we further improve the performance of QVI from three facets and propose an enhanced quadratic video interpolation (EQVI) model.
Exploring Multi-Scale Feature Propagation and Communication for Image Super Resolution
Multi-scale techniques have achieved great success in a wide range of computer vision tasks.
Visual Compositional Learning for Human-Object Interaction Detection
The integration of decomposition and composition enables VCL to share object and verb features among different HOI samples and images, and to generate new interaction samples and new types of HOI, and thus largely alleviates the long-tail distribution problem and benefits low-shot or zero-shot HOI detection.
Becoming Linguistically Mature: Modeling English and German Children's Writing Development Across School Grades
In this paper we employ a novel approach to advancing our understanding of the development of writing in English and German children across school grades using classification tasks.
SmallBigNet: Integrating Core and Contextual Views for Video Classification
Our SmallBig network outperforms a number of recent state-of-the-art approaches, in terms of accuracy and/or efficiency.
Attention-Guided Hierarchical Structure Aggregation for Image Matting
In this paper, we propose an end-to-end Hierarchical Attention Matting Network (HAttMatting), which can predict the better structure of alpha mattes from single RGB images without additional input.
Ranked #4 on
Image Matting
on P3M-10k
COCAS: A Large-Scale Clothes Changing Person Dataset for Re-identification
To address the clothes changing person re-id problem, we construct a novel large-scale re-id benchmark named ClOthes ChAnging Person Set (COCAS), which provides multiple images of the same identity with different clothes.
Understanding the Dynamics of Second Language Writing through Keystroke Logging and Complexity Contours
The purpose of this paper is twofold: [1] to introduce, to our knowledge, the largest available resource of keystroke logging (KSL) data generated by Etherpad (https://etherpad. org/), an open-source, web-based collaborative real-time editor, that captures the dynamics of second language (L2) production and [2] to relate the behavioral data from KSL to indices of syntactic and lexical complexity of the texts produced obtained from a tool that implements a sliding window approach capturing the progression of complexity within a text.
Learning to Predict Context-adaptive Convolution for Semantic Segmentation
Long-range contextual information is essential for achieving high-performance semantic segmentation.
Context-Transformer: Tackling Object Confusion for Few-Shot Detection
Few-shot object detection is a challenging but realistic scenario, where only a few annotated training images are available for training detectors.
Domain Adaptive Ensemble Learning
Each such classifier is an expert to its own domain and a non-expert to others.
TTPP: Temporal Transformer with Progressive Prediction for Efficient Action Anticipation
Video action anticipation aims to predict future action categories from observed frames.
Refined Gate: A Simple and Effective Gating Mechanism for Recurrent Units
Recurrent neural network (RNN) has been widely studied in sequence learning tasks, while the mainstream models (e. g., LSTM and GRU) rely on the gating mechanism (in control of how information flows between hidden states).
Suppressing Uncertainties for Large-Scale Facial Expression Recognition
Annotating a qualitative large-scale facial expression dataset is extremely difficult due to the uncertainties caused by ambiguous facial expressions, low-quality facial images, and the subjectiveness of annotators.
Learning Attentive Pairwise Interaction for Fine-Grained Classification
These distinct gate vectors inherit mutual context on semantic differences, which allow API-Net to attentively capture contrastive clues by pairwise interaction between two images.
Ranked #3 on
Fine-Grained Image Classification
on Stanford Dogs
Progressive Object Transfer Detection
Inspired by this procedure of learning to detect, we propose a novel Progressive Object Transfer Detection (POTD) framework.
A Comprehensive Study on Temporal Modeling for Online Action Detection
Online action detection (OAD) is a practical yet challenging task, which has attracted increasing attention in recent years.
FD-GAN: Generative Adversarial Networks with Fusion-discriminator for Single Image Dehazing
With the proposed Fusion-discriminator which takes frequency information as additional priors, our model can generator more natural and realistic dehazed images with less color distortion and fewer artifacts.
Pose-Assisted Multi-Camera Collaboration for Active Object Tracking
In the system, each camera is equipped with two controllers and a switcher: The vision-based controller tracks targets based on observed images.
Geometry Sharing Network for 3D Point Cloud Classification and Segmentation
Specially, GS-Net consists of Geometry Similarity Connection (GSC) modules which exploit Eigen-Graph to group distant points with similar and relevant geometric information, and aggregate features from nearest neighbors in both Euclidean space and Eigenvalue space.
Ranked #7 on
3D Point Cloud Classification
on IntrA
Interactive Multi-Dimension Modulation with Dynamic Controllable Residual Learning for Image Restoration
To make a step forward, this paper presents a new problem setup, called multi-dimension (MD) modulation, which aims at modulating output effects across multiple degradation types and levels.
Learning Category Correlations for Multi-label Image Recognition with Graph Networks
In this paper, instead of using a pre-defined graph which is inflexible and may be sub-optimal for multi-label classification, we propose the A-GCN, which leverages the popular Graph Convolutional Networks with an Adaptive label correlation graph to model label dependencies.
RankSRGAN: Generative Adversarial Networks with Ranker for Image Super-Resolution
To address the problem, we propose Super-Resolution Generative Adversarial Networks with Ranker (RankSRGAN) to optimize generator in the direction of perceptual metrics.
Ranked #1 on
Image Super-Resolution
on PIRM-test
Product Image Recognition with Guidance Learning and Noisy Supervision
Instead of collecting product images by labor-and time-intensive image capturing, we take advantage of the web and download images from the reviews of several e-commerce websites where the images are casually captured by consumers.
Bootstrap Model Ensemble and Rank Loss for Engagement Intensity Regression
Based on our winner solution last year, we mainly explore head features and body features with a bootstrap strategy and two novel loss functions in this paper.
Frame attention networks for facial expression recognition in videos
The feature embedding module is a deep Convolutional Neural Network (CNN) which embeds face images into feature vectors.
Ranked #2 on
Facial Expression Recognition
on CK+
(Accuracy (7 emotion) metric)
Suppressing Model Overfitting for Image Super-Resolution Networks
Large deep networks have demonstrated competitive performance in single image super-resolution (SISR), with a huge volume of data involved.
Region Attention Networks for Pose and Occlusion Robust Facial Expression Recognition
Extensive experiments show that our RAN and region biased loss largely improve the performance of FER with occlusion and variant pose.
Ranked #1 on
Facial Expression Recognition
on SFEW
P2SGrad: Refined Gradients for Optimizing Deep Face Models
Cosine-based softmax losses significantly improve the performance of deep face recognition networks.
AdaCos: Adaptively Scaling Cosine Logits for Effectively Learning Deep Face Representations
Our results show that training deep neural networks with the AdaCos loss is stable and able to achieve high face recognition accuracy.
Ranked #5 on
Face Verification
on MegaFace
Modulating Image Restoration with Continual Levels via Adaptive Feature Modification Layers
In image restoration tasks, like denoising and super resolution, continual modulation of restoration levels is of great importance for real-world applications, but has failed most of existing deep learning based image restoration methods.
Ranked #1 on
Color Image Denoising
on CBSD68 sigma75
Super-Identity Convolutional Neural Network for Face Hallucination
Face hallucination is a generative task to super-resolve the facial image with low resolution while human perception of face heavily relies on identity information.
PIRM Challenge on Perceptual Image Enhancement on Smartphones: Report
This paper reviews the first challenge on efficient perceptual image enhancement with the focus on deploying deep learning models on smartphones.
Find and Focus: Retrieve and Localize Video Events with Natural Language Queries
The thriving of video sharing services brings new challenges to video retrieval, e. g. the rapid growth in video duration and content diversity.
ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks
To further enhance the visual quality, we thoroughly study three key components of SRGAN - network architecture, adversarial loss and perceptual loss, and improve each of them to derive an Enhanced SRGAN (ESRGAN).
Ranked #2 on
Image Super-Resolution
on PIRM-test
Prostate Segmentation using 2D Bridged U-net
To address the aforementioned three problems, we propose and validate a deeper network that can fit medical image datasets that are usually small in the sample size.
Temporal Hallucinating for Action Recognition With Few Still Images
To mimic this capacity, we propose a novel Hybrid Video Memory (HVM) machine, which can hallucinate temporal features of still images from video memory, in order to boost action recognition with few still images.
Knowledge-based Fully Convolutional Network and Its Application in Segmentation of Lung CT Images
A variety of deep neural networks have been applied in medical image segmentation and achieve good performance.
Boosting up Scene Text Detectors with Guided CNN
Deep CNNs have achieved great success in text detection.
SpiderCNN: Deep Learning on Point Sets with Parameterized Convolutional Filters
Deep neural networks have enjoyed remarkable success for various vision tasks, however it remains challenging to apply CNNs to domains lacking a regular underlying structures such as 3D point clouds.
Ranked #6 on
3D Part Segmentation
on IntrA
An end-to-end TextSpotter with Explicit Alignment and Attention
This allows the two tasks to work collaboratively by shar- ing convolutional features, which is critical to identify challenging text instances.
LSTD: A Low-Shot Transfer Detector for Object Detection
Second, we introduce a novel regularized transfer learning framework for low-shot detection, where the transfer knowledge (TK) and background depression (BD) regularizations are proposed to leverage object knowledge respectively from source and target domains, in order to further enhance fine-tuning with a few target images.
Ranked #14 on
Few-Shot Object Detection
on MS-COCO (30-shot)
Structured Triplet Learning with POS-tag Guided Attention for Visual Question Answering
Visual question answering (VQA) is of significant interest due to its potential to be a strong test of image understanding systems and to probe the connection between language and vision.
FOTS: Fast Oriented Text Spotting with a Unified Network
Incidental scene text spotting is considered one of the most difficult and valuable challenges in the document analysis community.
Ranked #4 on
Scene Text Detection
on ICDAR 2015
Deep Reinforcement Learning for Unsupervised Video Summarization with Diversity-Representativeness Reward
Video summarization aims to facilitate large-scale video browsing by producing short, concise summaries that are diverse and representative of original videos.
Ranked #5 on
Unsupervised Video Summarization
on TvSum
RPAN: An End-to-End Recurrent Pose-Attention Network for Action Recognition in Videos
Firstly, unlike previous works on pose-related action recognition, our RPAN is an end-to-end recurrent network which can exploit important spatial-temporal evolutions of human pose to assist action recognition in a unified framework.
Ranked #5 on
Skeleton Based Action Recognition
on J-HMDB
Detecting Faces Using Inside Cascaded Contextual CNN
Deep Convolutional Neural Networks (CNNs) achieve substantial improvements in face detection in the wild.
Range Loss for Deep Face Recognition With Long-Tailed Training Data
Unlike these work, this paper investigated how long-tailed data impact the training of face CNNs and develop a novel loss function, called range loss, to effectively utilize the tailed data in training process.
Deep Embedding Convolutional Neural Network for Synthesizing CT Image from T1-Weighted MR Image
After repeat-ing this embedding procedure for several times in the network, we can eventually synthesize a final CT image in the end of the DECNN.
Single Shot Text Detector with Regional Attention
Our text detector achieves an F-measure of 77% on the ICDAR 2015 bench- mark, advancing the state-of-the-art results in [18, 28].
Ranked #4 on
Scene Text Detection
on COCO-Text
Temporal Segment Networks for Action Recognition in Videos
Furthermore, based on the temporal segment networks, we won the video classification track at the ActivityNet challenge 2016 among 24 teams, which demonstrates the effectiveness of TSN and the proposed good practices.
Ranked #17 on
Action Classification
on Moments in Time
(Top 5 Accuracy metric)
Range Loss for Deep Face Recognition with Long-tail
Convolutional neural networks have achieved great improvement on face recognition in recent years because of its extraordinary ability in learning discriminative features of people with different identities.
Knowledge Guided Disambiguation for Large-Scale Scene Classification with Multi-Resolution CNNs
Convolutional Neural Networks (CNNs) have made remarkable progress on scene recognition, partially due to these recent large-scale scene datasets, such as the Places and Places2.
A Discriminative Feature Learning Approach for Deep Face Recognition
In most of the available CNNs, the softmax loss function is used as the supervision signal to train the deep model.
Detecting Text in Natural Image with Connectionist Text Proposal Network
We propose a novel Connectionist Text Proposal Network (CTPN) that accurately localizes text lines in natural image.
Transferring Object-Scene Convolutional Neural Networks for Event Recognition in Still Images
These newly designed transferring techniques exploit multi-task learning frameworks to incorporate extra knowledge from other networks and additional datasets into the training procedure of event CNNs.
Weakly Supervised PatchNets: Describing and Aggregating Local Patches for Scene Recognition
In this paper, we propose a hybrid representation, which leverages the discriminative capacity of CNNs and the simplicity of descriptor encoding schema for image recognition, with a focus on scene recognition.
Temporal Segment Networks: Towards Good Practices for Deep Action Recognition
The other contribution is our study on a series of good practices in learning ConvNets on video data with the help of temporal segment network.
Ranked #3 on
Multimodal Activity Recognition
on EV-Action
CUHK & ETHZ & SIAT Submission to ActivityNet Challenge 2016
This paper presents the method that underlies our submission to the untrimmed video classification task of ActivityNet Challenge 2016.
DeepWriter: A Multi-Stream Deep CNN for Text-independent Writer Identification
The main contributions are: 1) we design and optimize multi-stream structure for writer identification task; 2) we introduce data augmentation learning to enhance the performance of DeepWriter; 3) we introduce a patch scanning strategy to handle text image with different lengths.
A Key Volume Mining Deep Framework for Action Recognition
Training with a large proportion of irrelevant volumes will hurt performance.
Latent Factor Guided Convolutional Neural Networks for Age-Invariant Face Recognition
In order to address this problem, we propose a novel deep face recognition framework to learn the age-invariant deep face features through a carefully designed CNN model.
Ranked #7 on
Age-Invariant Face Recognition
on CACDVS
Real-time Action Recognition with Enhanced Motion Vector CNNs
The deep two-stream architecture exhibited excellent performance on video based action recognition.