Search Results for author:
Found 72 papers, 36 papers with code
Open-sourced Data Ecosystem in Autonomous Driving: the Present and Future
With the continuous maturation and application of autonomous driving technology, a systematic examination of open-source autonomous driving datasets becomes instrumental in fostering the robust evolution of the industry ecosystem.
FlowMap: Path Generation for Automated Vehicles in Open Space Using Traffic Flow
However, how to cognize the ``road'' for automated vehicles where there is no well-defined ``roads'' remains an open problem.
Graph-based Topology Reasoning for Driving Scenes
Understanding the road genome is essential to realize autonomous driving.
Ranked #5 on
3D Lane Detection
on OpenLane-V2 val
Visual Exemplar Driven Task-Prompting for Unified Perception in Autonomous Driving
Multi-task learning has emerged as a powerful paradigm to solve a range of tasks simultaneously with good efficiency in both computation resources and inference time.
NLIP: Noise-robust Language-Image Pre-training
Large-scale cross-modal pre-training paradigms have recently shown ubiquitous success on a wide range of downstream tasks, e. g., zero-shot classification, retrieval and image captioning.
Fine-grained Visual-Text Prompt-Driven Self-Training for Open-Vocabulary Object Detection
Inspired by the success of vision-language methods (VLMs) in zero-shot classification, recent works attempt to extend this line of work into object detection by leveraging the localization ability of pre-trained VLMs and generating pseudo labels for unseen classes in a self-training manner.
DetCLIP: Dictionary-Enriched Visual-Concept Paralleled Pre-training for Open-world Detection
We further design a concept dictionary~(with descriptions) from various online sources and detection datasets to provide prior knowledge for each concept.
Effective Adaptation in Multi-Task Co-Training for Unified Autonomous Driving
Aiming towards a holistic understanding of multiple downstream tasks simultaneously, there is a need for extracting features with better transferability.
Open-world Semantic Segmentation via Contrasting and Clustering Vision-Language Embedding
To bridge the gap between supervised semantic segmentation and real-world applications that acquires one model to recognize arbitrary new concepts, recent zero-shot segmentation attracts a lot of attention by exploring the relationships between unseen and seen object categories, yet requiring large amounts of densely-annotated data with diverse base classes.
Task-Customized Self-Supervised Pre-training with Scalable Dynamic Routing
On the other hand, for existing SSL methods, it is burdensome and infeasible to use different downstream-task-customized datasets in pre-training for different tasks.
ManiTrans: Entity-Level Text-Guided Image Manipulation via Token-wise Semantic Alignment and Generation
Existing text-guided image manipulation methods aim to modify the appearance of the image or to edit a few objects in a virtual or simple scenario, which is far from practical application.
Laneformer: Object-aware Row-Column Transformers for Lane Detection
We present Laneformer, a conceptually simple yet powerful transformer-based architecture tailored for lane detection that is a long-standing research topic for visual perception in autonomous driving.
CODA: A Real-World Road Corner Case Dataset for Object Detection in Autonomous Driving
One main reason that impedes the development of truly reliably self-driving systems is the lack of public datasets for evaluating the performance of object detectors on corner cases.
Wukong: A 100 Million Large-scale Chinese Cross-modal Pre-training Benchmark
Experiments show that Wukong can serve as a promising Chinese pre-training dataset and benchmark for different cross-modal learning methods.
Ranked #6 on
Image Retrieval
on MUGE Retrieval
GhostNets on Heterogeneous Devices via Cheap Operations
The proposed C-Ghost module can be taken as a plug-and-play component to upgrade existing convolutional neural networks.
An Empirical Study of Adder Neural Networks for Object Detection
Adder neural networks (AdderNets) have shown impressive performance on image classification with only addition operations, which are more energy efficient than traditional convolutional neural networks built with multiplications.
FILIP: Fine-grained Interactive Language-Image Pre-Training
In this paper, we introduce a large-scale Fine-grained Interactive Language-Image Pre-training (FILIP) to achieve finer-level alignment through a cross-modal late interaction mechanism, which uses a token-wise maximum similarity between visual and textual tokens to guide the contrastive objective.
SOFT: Softmax-free Transformer with Linear Complexity
Crucially, with a linear complexity, much longer token sequences are permitted in SOFT, resulting in superior trade-off between accuracy and complexity.
Learning Versatile Convolution Filters for Efficient Visual Recognition
A series of secondary filters can be derived from a primary filter with the help of binary masks.
Voxel Transformer for 3D Object Detection
We present Voxel Transformer (VoTr), a novel and effective voxel-based Transformer backbone for 3D object detection from point clouds.
Ranked #3 on
3D Object Detection
on waymo vehicle
(L1 mAP metric)
Pyramid R-CNN: Towards Better Performance and Adaptability for 3D Object Detection
To resolve the problems, we propose a novel second-stage module, named pyramid RoI head, to adaptively learn the features from the sparse points of interest.
Ranked #2 on
3D Object Detection
on waymo vehicle
(AP metric)
Greedy Network Enlarging
Recent studies on deep convolutional neural networks present a simple paradigm of architecture design, i. e., models with more MACs typically achieve better accuracy, such as EfficientNet and RegNet.
$S^3$: Sign-Sparse-Shift Reparametrization for Effective Training of Low-bit Shift Networks
Shift neural networks reduce computation complexity by removing expensive multiplication operations and quantizing continuous weights into low-bit discrete values, which are fast and energy efficient compared to conventional neural networks.
SODA10M: A Large-Scale 2D Self/Semi-Supervised Object Detection Dataset for Autonomous Driving
Experiments show that SODA10M can serve as a promising pre-training dataset for different self-supervised learning methods, which gives superior performance when fine-tuning with different downstream tasks (i. e., detection, semantic/instance segmentation) in autonomous driving domain.
One Million Scenes for Autonomous Driving: ONCE Dataset
To facilitate future research on exploiting unlabeled data for 3D detection, we additionally provide a benchmark in which we reproduce and evaluate a variety of self-supervised and semi-supervised methods on the ONCE dataset.
ReNAS: Relativistic Evaluation of Neural Architecture Search
An effective and efficient architecture performance evaluation scheme is essential for the success of Neural Architecture Search (NAS).
Positive-Unlabeled Data Purification in the Wild for Object Detection
In this paper, we present a positive-unlabeled learning based scheme to expand training data by purifying valuable images from massive unlabeled ones, where the original training data are viewed as positive data and the unlabeled images in the wild are unlabeled data.
Learning Student Networks in the Wild
Experiments on various datasets demonstrate that the student networks learned by the proposed method can achieve comparable performance with those using the original dataset.
Data-Free Knowledge Distillation for Image Super-Resolution
Experiments on various datasets and architectures demonstrate that the proposed method is able to be utilized for effectively learning portable student networks without the original data, e. g., with 0. 16dB PSNR drop on Set5 for x2 super resolution.
Universal Adder Neural Networks
The widely-used convolutions in deep neural networks are exactly cross-correlation to measure the similarity between input feature and convolution filters, which involves massive multiplications between float values.
S$^3$: Sign-Sparse-Shift Reparametrization for Effective Training of Low-bit Shift Networks
Shift neural networks reduce computation complexity by removing expensive multiplication operations and quantizing continuous weights into low-bit discrete values, which are fast and energy-efficient compared to conventional neural networks.
Winograd Algorithm for AdderNet
Adder neural network (AdderNet) is a new kind of deep model that replaces the original massive multiplications in convolutions by additions while preserving the high performance.
Distilling Object Detectors via Decoupled Features
To this end, we present a novel distillation algorithm via decoupled features (DeFeat) for learning a better student detector.
Learning Frequency-aware Dynamic Network for Efficient Super-Resolution
Extensive experiments conducted on benchmark SISR models and datasets show that the frequency-aware dynamic network can be employed for various SISR neural architectures to obtain the better tradeoff between visual quality and computational complexity.
Learning Frequency Domain Approximation for Binary Neural Networks
Binary neural networks (BNNs) represent original full-precision weights and activations into 1-bit with sign function.
Transformer in Transformer
In this paper, we point out that the attention inside these local patches are also essential for building visual transformers with high performance and we explore a new architecture, namely, Transformer iN Transformer (TNT).
AdderNet and its Minimalist Hardware Design for Energy-Efficient Artificial Intelligence
With a comprehensive comparison on the performance, power consumption, hardware resource consumption and network generalization capability, we conclude the AdderNet is able to surpass all the other competitors including the classical CNN, novel memristor-network, XNOR-Net and the shift-kernel based network, indicating its great potential in future high performance and energy-efficient artificial intelligence applications.
A Survey on Visual Transformer
Transformer, first applied to the field of natural language processing, is a type of deep neural network mainly based on the self-attention mechanism.
Model Rubik’s Cube: Twisting Resolution, Depth and Width for TinyNets
To this end, we summarize a tiny formula for downsizing neural architectures through a series of smaller models derived from the EfficientNet-B0 with the FLOPs constraint.
Pre-Trained Image Processing Transformer
To maximally excavate the capability of transformer, we present to utilize the well-known ImageNet benchmark for generating a large amount of corrupted image pairs.
Ranked #1 on
Single Image Deraining
on Rain100L
(using extra training data)
VEGA: Towards an End-to-End Configurable AutoML Pipeline
Automated Machine Learning (AutoML) is an important industrial solution for automatic discovery and deployment of the machine learning models.
Model Rubik's Cube: Twisting Resolution, Depth and Width for TinyNets
To this end, we summarize a tiny formula for downsizing neural architectures through a series of smaller models derived from the EfficientNet-B0 with the FLOPs constraint.
Ranked #692 on
Image Classification
on ImageNet
SCOP: Scientific Control for Reliable Neural Network Pruning
To increase the reliability of the results, we prefer to have a more rigorous research design by including a scientific control group as an essential part to minimize the effect of all factors except the association between the filter and expected network output.
Training Binary Neural Networks through Learning with Noisy Supervision
This paper formalizes the binarization operations over neural networks from a learning perspective.
Kernel Based Progressive Distillation for Adder Neural Networks
A convolutional neural network (CNN) with the same architecture is simultaneously initialized and trained as a teacher network, features and weights of ANN and CNN will be transformed to a new space to eliminate the accuracy drop.
AdderSR: Towards Energy Efficient Image Super-Resolution
To this end, we thoroughly analyze the relationship between an adder operation and the identity mapping and insert shortcuts to enhance the performance of SR models using adder networks.
Searching for Low-Bit Weights in Quantized Neural Networks
Quantized neural networks with low-bit weights and activations are attractive for developing AI accelerators.
Video Super-resolution with Temporal Group Attention
Video super-resolution, which aims at producing a high-resolution video from its corresponding low-resolution version, has recently drawn increasing attention.
Optical Flow Distillation: Towards Efficient and Stable Video Style Transfer
This paper proposes to learn a lightweight video style transfer network via knowledge distillation paradigm.
HourNAS: Extremely Fast Neural Architecture Search Through an Hourglass Lens
To achieve an extremely fast NAS while preserving the high accuracy, we propose to identify the vital blocks and make them the priority in the architecture search.
A Semi-Supervised Assessor of Neural Architectures
A graph convolutional neural network is introduced to predict the performance of architectures based on the learned representations and their relation modeled by the graph.
Distilling portable Generative Adversarial Networks for Image Translation
To promote the capability of student generator, we include a student discriminator to measure the distances between real images, and images generated by student and teacher generators.
Beyond Dropout: Feature Map Distortion to Regularize Deep Neural Networks
On one hand, massive trainable parameters significantly enhance the performance of these deep networks.
Discernible Image Compression
Experiments on benchmarks demonstrate that images compressed by using the proposed method can also be well recognized by subsequent visual recognition and detection models.
Widening and Squeezing: Towards Accurate and Efficient QNNs
Quantization neural networks (QNNs) are very attractive to the industry because their extremely cheap calculation and storage overhead, but their performance is still worse than that of networks with full-precision parameters.
AdderNet: Do We Really Need Multiplications in Deep Learning?
The widely-used convolutions in deep neural networks are exactly cross-correlation to measure the similarity between input feature and convolution filters, which involves massive multiplications between float values.
GhostNet: More Features from Cheap Operations
Deploying convolutional neural networks (CNNs) on embedded devices is difficult due to the limited memory and computation resources.
Ranked #864 on
Image Classification
on ImageNet
Unsupervised Image Super-Resolution with an Indirect Supervised Path
The task of single image super-resolution (SISR) aims at reconstructing a high-resolution (HR) image from a low-resolution (LR) image.
ReNAS:Relativistic Evaluation of Neural Architecture Search
An effective and efficient architecture performance evaluation scheme is essential for the success of Neural Architecture Search (NAS).
Efficient Residual Dense Block Search for Image Super-Resolution
Focusing on this issue, we propose an efficient residual dense block search algorithm with multiple objectives to hunt for fast, lightweight and accurate networks for image super-resolution.
Positive-Unlabeled Compression on the Cloud
In practice, only a small portion of the original training set is required as positive examples and more useful training examples can be obtained from the massive unlabeled data on the cloud through a PU classifier with an attention based multi-scale feature extractor.
Searching for Accurate Binary Neural Architectures
Binary neural networks have attracted tremendous attention due to the efficiency for deploying them on mobile devices.
CARS: Continuous Evolution for Efficient Neural Architecture Search
Architectures in the population that share parameters within one SuperNet in the latest generation will be tuned over the training dataset with a few epochs.
Full-Stack Filters to Build Minimum Viable CNNs
Existing works used to decrease the number or size of requested convolution filters for a minimum viable CNN on edge devices.
Attribute Aware Pooling for Pedestrian Attribute Recognition
This paper expands the strength of deep convolutional neural networks (CNNs) to the pedestrian attribute recognition problem by devising a novel attribute aware pooling algorithm.
Learning Instance-wise Sparsity for Accelerating Deep Models
Exploring deep convolutional neural networks of high efficiency and low memory usage is very essential for a wide variety of machine learning tasks.
Co-Evolutionary Compression for Unpaired Image Translation
Generative adversarial networks (GANs) have been successfully used for considerable computer vision tasks, especially the image-to-image translation.
Deep Fitting Degree Scoring Network for Monocular 3D Object Detection
In this paper, we propose to learn a deep fitting degree scoring network for monocular 3D object detection, which aims to score fitting degree between proposals and object conclusively.
Ranked #7 on
Vehicle Pose Estimation
on KITTI Cars Hard
BridgeNet: A Continuity-Aware Probabilistic Network for Age Estimation
Existing methods for age estimation usually apply a divide-and-conquer strategy to deal with heterogeneous data caused by the non-stationary aging process.
Ranked #2 on
Age Estimation
on FGNET
Data-Free Learning of Student Networks
Learning portable neural networks is very essential for computer vision for the purpose that pre-trained heavy deep models can be well applied on edge devices such as mobile phones and micro sensors.
Learning Versatile Filters for Efficient Convolutional Neural Networks
A series of secondary filters can be derived from a primary filter.
Transitive Distance Clustering with K-Means Duality
We propose a very intuitive and simple approximation for the conventional spectral clustering methods.
