Search Results for author:
Found 11 papers, 6 papers with code
Accelerating Vision Transformers Based on Heterogeneous Attention Patterns
On one hand, different images share more similar attention patterns in early layers than later layers, indicating that the dynamic query-by-key self-attention matrix may be replaced with a static self-attention matrix in early layers.
Open-TransMind: A New Baseline and Benchmark for 1st Foundation Model Challenge of Intelligent Transportation
To address these, we designed the 1st Foundation Model Challenge, with the goal of increasing the popularity of foundation model technology in traffic scenarios and promoting the rapid development of the intelligent transportation industry.
Ranked #1 on
2D Object Detection
on CeyMo
A Unified Continual Learning Framework with General Parameter-Efficient Tuning
1) Learning: the pre-trained model adapts to the new task by tuning an online PET module, along with our adaptation speed calibration to align different PET modules, 2) Accumulation: the task-specific knowledge learned by the online PET module is accumulated into an offline PET module through momentum update, 3) Ensemble: During inference, we respectively construct two experts with online/offline PET modules (which are favored by the novel/historical tasks) for prediction ensemble.
UFO: Unified Feature Optimization
UFO aims to benefit each single task with a large-scale pretraining on all tasks.
An Information Theory-inspired Strategy for Automatic Network Pruning
This practically limits the application of model compression when the model needs to be deployed on a wide range of devices.
Dynamic Class Queue for Large Scale Face Recognition In the Wild
Since only a subset of classes is selected for each iteration, the computing requirement is reduced.
Ranked #3 on
Face Recognition
on AgeDB-30
EC-DARTS: Inducing Equalized and Consistent Optimization Into DARTS
EC-DARTS decouples different operations based on their categories to optimize the operation weights so that the operation gap between them is shrinked.
AIM 2020 Challenge on Real Image Super-Resolution: Methods and Results
This paper introduces the real image Super-Resolution (SR) challenge that was part of the Advances in Image Manipulation (AIM) workshop, held in conjunction with ECCV 2020.
Real Image Super Resolution Via Heterogeneous Model Ensemble using GP-NAS
With advancement in deep neural network (DNN), recent state-of-the-art (SOTA) image superresolution (SR) methods have achieved impressive performance using deep residual network with dense skip connections.
NTIRE 2020 Challenge on Real Image Denoising: Dataset, Methods and Results
This challenge is based on a newly collected validation and testing image datasets, and hence, named SIDD+.
Grand Challenge of 106-Point Facial Landmark Localization
However, previous competitions on facial landmark localization (i. e., the 300-W, 300-VW and Menpo challenges) aim to predict 68-point landmarks, which are incompetent to depict the structure of facial components.
