Search Results for author: Wei Dong

Found 42 papers, 22 papers with code

PromptGuard: Soft Prompt-Guided Unsafe Content Moderation for Text-to-Image Models

no code implementations7 Jan 2025 Lingzhi Yuan, Xinfeng Li, Chejian Xu, Guanhong Tao, Xiaojun Jia, Yihao Huang, Wei Dong, Yang Liu, XiaoFeng Wang, Bo Li

Text-to-image (T2I) models have been shown to be vulnerable to misuse, particularly in generating not-safe-for-work (NSFW) content, raising serious ethical concerns.

Image Generation Safety Alignment

Low-Light Image Enhancement via Generative Perceptual Priors

no code implementations30 Dec 2024 Han Zhou, Wei Dong, Xiaohong Liu, Yulun Zhang, Guangtao Zhai, Jun Chen

Although significant progress has been made in enhancing visibility, retrieving texture details, and mitigating noise in Low-Light (LL) images, the challenge persists in applying current Low-Light Image Enhancement (LLIE) methods to real-world scenarios, primarily due to the diverse illumination conditions encountered.

Low-Light Image Enhancement

A Survey on Large Language Model Acceleration based on KV Cache Management

1 code implementation27 Dec 2024 Haoyang Li, Yiming Li, Anxin Tian, Tianhao Tang, Zhanchao Xu, Xuejia Chen, Nicole Hu, Wei Dong, Qing Li, Lei Chen

This survey provides a comprehensive overview of KV cache management strategies for LLM acceleration, categorizing them into token-level, model-level, and system-level optimizations.

Language Modeling Language Modelling +5

CORAG: A Cost-Constrained Retrieval Optimization System for Retrieval-Augmented Generation

no code implementations1 Nov 2024 Ziting Wang, Haitao Yuan, Wei Dong, Gao Cong, Feifei Li

We employ a Monte Carlo Tree Search (MCTS) based policy framework to find optimal chunk combinations sequentially, allowing for a comprehensive consideration of correlations among chunks.

RAG Retrieval

Efficient Adaptation of Pre-trained Vision Transformer via Householder Transformation

no code implementations30 Oct 2024 Wei Dong, Yuan Sun, Yiting Yang, Xing Zhang, Zhijun Lin, Qingsen Yan, Haokui Zhang, Peng Wang, Yang Yang, HengTao Shen

A common strategy for Parameter-Efficient Fine-Tuning (PEFT) of pre-trained Vision Transformers (ViTs) involves adapting the model to downstream tasks by learning a low-rank adaptation matrix.

parameter-efficient fine-tuning

ECMamba: Consolidating Selective State Space Model with Retinex Guidance for Efficient Multiple Exposure Correction

1 code implementation28 Oct 2024 Wei Dong, Han Zhou, Yulun Zhang, Xiaohong Liu, Jun Chen

Inspired by Mamba which demonstrates powerful and highly efficient sequence modeling, we introduce a novel framework based on Mamba for Exposure Correction (ECMamba) with dual pathways, each dedicated to the restoration of reflectance and illumination map, respectively.

Exposure Correction Mamba

TG-LLaVA: Text Guided LLaVA via Learnable Latent Embeddings

no code implementations15 Sep 2024 Dawei Yan, Pengcheng Li, Yang Li, Hao Chen, QingGuo Chen, Weihua Luo, Wei Dong, Qingsen Yan, Haokui Zhang, Chunhua Shen

In contrast, we propose Text Guided LLaVA (TG-LLaVA) in this paper, which optimizes VLMs by guiding the vision encoder with text, offering a new and orthogonal optimization direction.

Language Modelling

Start from Video-Music Retrieval: An Inter-Intra Modal Loss for Cross Modal Retrieval

no code implementations28 Jul 2024 Zeyu Chen, Pengfei Zhang, Kai Ye, Wei Dong, Xin Feng, Yana Zhang

In reality, a video can use different music as background music, and a music can be used as background music for different videos.

Contrastive Learning Cross-Modal Retrieval +1

GLARE: Low Light Image Enhancement via Generative Latent Feature based Codebook Retrieval

1 code implementation17 Jul 2024 Han Zhou, Wei Dong, Xiaohong Liu, Shuaicheng Liu, Xiongkuo Min, Guangtao Zhai, Jun Chen

Most existing Low-light Image Enhancement (LLIE) methods either directly map Low-Light (LL) to Normal-Light (NL) images or use semantic or illumination maps as guides.

Decoder Low-Light Image Enhancement +5

CRNet: A Detail-Preserving Network for Unified Image Restoration and Enhancement Task

1 code implementation22 Apr 2024 Kangzhen Yang, Tao Hu, Kexin Dai, Genggeng Chen, Yu Cao, Wei Dong, Peng Wu, Yanning Zhang, Qingsen Yan

In real-world scenarios, images captured often suffer from blurring, noise, and other forms of image degradation, and due to sensor limitations, people usually can only obtain low dynamic range images.

Deblurring Denoising +2

NTIRE 2024 Challenge on Low Light Image Enhancement: Methods and Results

3 code implementations22 Apr 2024 Xiaoning Liu, Zongwei Wu, Ao Li, Florin-Alexandru Vasluianu, Yulun Zhang, Shuhang Gu, Le Zhang, Ce Zhu, Radu Timofte, Zhi Jin, Hongjun Wu, Chenxi Wang, Haitao Ling, Yuanhao Cai, Hao Bian, Yuxin Zheng, Jing Lin, Alan Yuille, Ben Shao, Jin Guo, Tianli Liu, Mohao Wu, Yixu Feng, Shuo Hou, Haotian Lin, Yu Zhu, Peng Wu, Wei Dong, Jinqiu Sun, Yanning Zhang, Qingsen Yan, Wenbin Zou, Weipeng Yang, Yunxiang Li, Qiaomu Wei, Tian Ye, Sixiang Chen, Zhao Zhang, Suiyi Zhao, Bo wang, Yan Luo, Zhichao Zuo, Mingshen Wang, Junhu Wang, Yanyan Wei, Xiaopeng Sun, Yu Gao, Jiancheng Huang, Hongming Chen, Xiang Chen, Hui Tang, Yuanbin Chen, Yuanbo Zhou, Xinwei Dai, Xintao Qiu, Wei Deng, Qinquan Gao, Tong Tong, Mingjia Li, Jin Hu, Xinyu He, Xiaojie Guo, sabarinathan, K Uma, A Sasithradevi, B Sathya Bama, S. Mohamed Mansoor Roomi, V. Srivatsav, Jinjuan Wang, Long Sun, Qiuying Chen, Jiahong Shao, Yizhi Zhang, Marcos V. Conde, Daniel Feijoo, Juan C. Benito, Alvaro García, Jaeho Lee, Seongwan Kim, Sharif S M A, Nodirkhuja Khujaev, Roman Tsoy, Ali Murtaza, Uswah Khairuddin, Ahmad 'Athif Mohd Faudzi, Sampada Malagi, Amogh Joshi, Nikhil Akalwadi, Chaitra Desai, Ramesh Ashok Tabib, Uma Mudenagudi, Wenyi Lian, Wenjing Lian, Jagadeesh Kalyanshetti, Vijayalaxmi Ashok Aralikatti, Palani Yashaswini, Nitish Upasi, Dikshit Hegde, Ujwala Patil, Sujata C, Xingzhuo Yan, Wei Hao, Minghan Fu, Pooja Choksy, Anjali Sarvaiya, Kishor Upla, Kiran Raja, Hailong Yan, Yunkai Zhang, Baiang Li, Jingyi Zhang, Huan Zheng

This paper reviews the NTIRE 2024 low light image enhancement challenge, highlighting the proposed solutions and results.

4k Low-Light Image Enhancement +1

ShadowRefiner: Towards Mask-free Shadow Removal via Fast Fourier Transformer

1 code implementation18 Apr 2024 Wei Dong, Han Zhou, Yuqiong Tian, Jingke Sun, Xiaohong Liu, Guangtao Zhai, Jun Chen

Shadow-affected images often exhibit pronounced spatial discrepancies in color and illumination, consequently degrading various vision applications including object detection and segmentation systems.

Image Shadow Removal object-detection +3

Low-Rank Rescaled Vision Transformer Fine-Tuning: A Residual Design Approach

1 code implementation CVPR 2024 Wei Dong, Xing Zhang, Bihui Chen, Dawei Yan, Zhijun Lin, Qingsen Yan, Peng Wang, Yang Yang

Parameter-efficient fine-tuning for pre-trained Vision Transformers aims to adeptly tailor a model to downstream tasks by learning a minimal set of new adaptation parameters while preserving the frozen majority of pre-trained parameters.

Image Classification parameter-efficient fine-tuning

You Only Need One Color Space: An Efficient Network for Low-light Image Enhancement

1 code implementation8 Feb 2024 Qingsen Yan, Yixu Feng, Cheng Zhang, Pei Wang, Peng Wu, Wei Dong, Jinqiu Sun, Yanning Zhang

Further, we design a novel Color and Intensity Decoupling Network (CIDNet) with two branches dedicated to processing the decoupled image brightness and color in the HVI space.

Low-light Image Deblurring and Enhancement Low-Light Image Enhancement

Data-Centric Evolution in Autonomous Driving: A Comprehensive Survey of Big Data System, Data Mining, and Closed-Loop Technologies

1 code implementation23 Jan 2024 Lincan Li, Wei Shao, Wei Dong, Yijun Tian, Qiming Zhang, Kaixiang Yang, Wenjie Zhang

There has been a huge bottleneck regarding the upper bound of autonomous driving algorithm performance, a consensus from academia and industry believes that the key to surmount the bottleneck lies in data-centric autonomous driving technology.

Autonomous Driving

Towards High-quality HDR Deghosting with Conditional Diffusion Models

no code implementations2 Nov 2023 Qingsen Yan, Tao Hu, Yuan Sun, Hao Tang, Yu Zhu, Wei Dong, Luc van Gool, Yanning Zhang

To address this challenge, we formulate the HDR deghosting problem as an image generation that leverages LDR features as the diffusion model's condition, consisting of the feature condition generator and the noise predictor.

Denoising Image Generation

Efficient Adaptation of Large Vision Transformer via Adapter Re-Composing

1 code implementation NeurIPS 2023 Wei Dong, Dawei Yan, Zhijun Lin, Peng Wang

Consequently, effectively adapting large pre-trained models to downstream tasks in an efficient manner has become a prominent research area.

ARC Image Classification +1

Fast Monocular Scene Reconstruction with Global-Sparse Local-Dense Grids

no code implementations CVPR 2023 Wei Dong, Chris Choy, Charles Loop, Or Litany, Yuke Zhu, Anima Anandkumar

To apply this representation to monocular scene reconstruction, we develop a scale calibration algorithm for fast geometric initialization from monocular depth priors.

Indoor Scene Reconstruction

Breaking Through the Haze: An Advanced Non-Homogeneous Dehazing Method based on Fast Fourier Convolution and ConvNeXt

1 code implementation8 May 2023 Han Zhou, Wei Dong, Yangyi Liu, Jun Chen

To tackle these two challenges, we propose a novel two branch network that leverages 2D discrete wavelete transform (DWT), fast Fourier convolution (FFC) residual block and a pretrained ConvNeXt model.

One Adapter for All Programming Languages? Adapter Tuning for Code Search and Summarization

1 code implementation28 Mar 2023 Deze Wang, Boxing Chen, Shanshan Li, Wei Luo, Shaoliang Peng, Wei Dong, Xiangke Liao

To alleviate the potentially catastrophic forgetting issue in multilingual models, we fix all pre-trained model parameters, insert the parameter-efficient structure adapter, and fine-tune it.

Code Search Code Summarization

Self-Supervised Node Representation Learning via Node-to-Neighbourhood Alignment

1 code implementation9 Feb 2023 Wei Dong, Dawei Yan, Peng Wang

Considering the excessive memory overheads of contrastive learning, we further propose a negative-free solution, where the main contribution is a Graph Signal Decorrelation (GSD) constraint to avoid representation collapse and over-smoothing.

Contrastive Learning Node Classification +1

RISE-Based Adaptive Control with Mass-Inertia Parameter Estimation for Aerial Transportation of Multi-Rotor UAVs

no code implementations17 Sep 2022 Shuyang Shi, Yuzhu Li, Wei Dong

Then, adaptive estimation laws for mass-inertia parameters are designed based on a filter operation.

Differentially Private Covariance Revisited

2 code implementations28 May 2022 Wei Dong, Yuting Liang, Ke Yi

In this paper, we present two new algorithms for covariance estimation under concentrated differential privacy (zCDP).

Node Representation Learning in Graph via Node-to-Neighbourhood Mutual Information Maximization

2 code implementations CVPR 2022 Wei Dong, Junsheng Wu, Yi Luo, ZongYuan Ge, Peng Wang

In this work, we present a simple-yet-effective self-supervised node representation learning strategy via directly maximizing the mutual information between the hidden representations of nodes and their neighbourhood, which can be theoretically justified by its link to graph smoothing.

Node Classification Representation Learning

Revisiting LiDAR Registration and Reconstruction: A Range Image Perspective

no code implementations6 Dec 2021 Wei Dong, Kwonyoung Ryu, Michael Kaess, Jaesik Park

We further collect a dataset of indoor and outdoor LiDAR scenes in the posed range image format.

Surface Reconstruction

ASH: A Modern Framework for Parallel Spatial Hashing in 3D Perception

no code implementations1 Oct 2021 Wei Dong, Yixing Lao, Michael Kaess, Vladlen Koltun

Unlike existing GPU hash maps, the ASH framework provides a versatile tensor interface, hiding low-level details from the users.

Point Cloud Registration

deGraphCS: Embedding Variable-based Flow Graph for Neural Code Search

1 code implementation24 Mar 2021 Chen Zeng, Yue Yu, Shanshan Li, Xin Xia, Zhiming Wang, Mingyang Geng, Bailin Xiao, Wei Dong, Xiangke Liao

With the rapid increase in the amount of public code repositories, developers maintain a great desire to retrieve precise code snippets by using natural language.

Code Search Graph Neural Network

Self-supervised Geometric Perception

2 code implementations CVPR 2021 Heng Yang, Wei Dong, Luca Carlone, Vladlen Koltun

We present self-supervised geometric perception (SGP), the first general framework to learn a feature descriptor for correspondence matching without any ground-truth geometric model labels (e. g., camera poses, rigid transformations).

Camera Pose Estimation Point Cloud Registration +1

Compositional Scalable Object SLAM

no code implementations5 Nov 2020 Akash Sharma, Wei Dong, Michael Kaess

We present a fast, scalable, and accurate Simultaneous Localization and Mapping (SLAM) system that represents indoor scenes as a graph of objects.

Object Object SLAM

Interpretable Disease Prediction based on Reinforcement Path Reasoning over Knowledge Graphs

no code implementations16 Oct 2020 Zhoujian Sun, Wei Dong, Jinlong Shi, Zhengxing Huang

In the disease prediction task, our model achieves 0. 743 and 0. 639 in terms of macro area under the curve (AUC) in predicting 53 circulation system diseases in the two datasets, respectively.

Disease Prediction Knowledge Graphs +1

Deep Global Registration

2 code implementations CVPR 2020 Christopher Choy, Wei Dong, Vladlen Koltun

We present Deep Global Registration, a differentiable framework for pairwise registration of real-world 3D scans.

Point Cloud Registration Pose Estimation

Learning to Navigate from Simulation via Spatial and Semantic Information Synthesis with Noise Model Embedding

no code implementations13 Oct 2019 Gang Chen, Hongzhe Yu, Wei Dong, Xinjun Sheng, Xiangyang Zhu, Han Ding

While training an end-to-end navigation network in the real world is usually of high cost, simulation provides a safe and cheap environment in this training stage.

Navigate

Document Hashing with Mixture-Prior Generative Models

no code implementations IJCNLP 2019 Wei Dong, Qinliang Su, Dinghan Shen, Changyou Chen

Hashing is promising for large-scale information retrieval tasks thanks to the efficiency of distance evaluation between binary codes.

Information Retrieval Retrieval

Guided Feature Selection for Deep Visual Odometry

no code implementations25 Nov 2018 Fei Xue, Qiuyuan Wang, Xin Wang, Wei Dong, Junqiu Wang, Hongbin Zha

We present a novel end-to-end visual odometry architecture with guided feature selection based on deep convolutional recurrent neural networks.

feature selection Monocular Visual Odometry +1

Boosting the Robustness Verification of DNN by Identifying the Achilles's Heel

no code implementations17 Nov 2018 Chengdong Feng, Zhenbang Chen, Weijiang Hong, Hengbiao Yu, Wei Dong, Ji Wang

How to ensure the safety of DNN-based system is a critical problem for the research and application of DNN.

Cannot find the paper you are looking for? You can Submit a new open access paper.