1 code implementation • 30 Oct 2024 • Shangquan Sun, Wenqi Ren, Zikun Liu, Hyunhee Park, Rui Wang, Xiaochun Cao
We estimate the range-wise ensemble weights on a reference set and store them in a lookup table (LUT) for efficient ensemble inference on the test set.
1 code implementation • 31 Aug 2024 • Shangquan Sun, Wenqi Ren, Juxiang Zhou, Jianhou Gan, Rui Wang, Xiaochun Cao
Existing deraining Transformers employ self-attention mechanisms with fixed-range windows or along channel dimensions, limiting the exploitation of non-local receptive fields.
1 code implementation • 14 Jul 2024 • Shangquan Sun, Wenqi Ren, Xinwei Gao, Rui Wang, Xiaochun Cao
It is powered by a mechanism dubbed histogram self-attention, which sorts and segments spatial features into intensity-based bins.
no code implementations • 4 Apr 2024 • Shangquan Sun, Wenqi Ren, Jingyang Peng, Fenglong Song, Xiaochun Cao
Many existing methods for low-light image enhancement (LLIE) based on Retinex theory ignore important factors that affect the validity of this theory in digital imaging, such as noise, quantization error, non-linearity, and dynamic range overflow.
1 code implementation • CVPR 2024 • Shangquan Sun, Wenqi Ren, Jingzhi Li, Rui Wang, Xiaochun Cao
Knowledge distillation involves transferring soft labels from a teacher to a student using a shared temperature-based softmax function.
Ranked #2 on
Knowledge Distillation
on CIFAR-100
1 code implementation • NIPS 2022 • Shangquan Sun, Wenqi Ren, Tao Wang, Xiaochun Cao
To address the issue, we propose a targeted adversarial attack in the restoration procedure to boost object detection performance after restoration.