Search Results for author: Renjing Xu

Found 19 papers, 6 papers with code

Prompting Multi-Modal Tokens to Enhance End-to-End Autonomous Driving Imitation Learning with LLMs

no code implementations7 Apr 2024 Yiqun Duan, Qiang Zhang, Renjing Xu

The utilization of Large Language Models (LLMs) within the realm of reinforcement learning, particularly as planners, has garnered a significant degree of attention in recent scholarly literature.

Autonomous Driving Imitation Learning

Spiking Wavelet Transformer

no code implementations17 Mar 2024 Yuetong Fang, Ziqing Wang, Lingfeng Zhang, Jiahang Cao, Honglei Chen, Renjing Xu

Spiking neural networks (SNNs) offer an energy-efficient alternative to conventional deep learning by mimicking the event-driven processing of the brain.

EventRPG: Event Data Augmentation with Relevance Propagation Guidance

1 code implementation14 Mar 2024 Mingyuan Sun, Donghao Zhang, ZongYuan Ge, Jiaxu Wang, Jia Li, Zheng Fang, Renjing Xu

Based on this, we propose EventRPG, which leverages relevance propagation on the spiking neural network for more efficient augmentation.

Action Recognition Data Augmentation +1

Decode Neural signal as Speech

2 code implementations4 Mar 2024 Yiqian Yang, Yiqun Duan, Qiang Zhang, Renjing Xu, Hui Xiong

In this paper, we explore the brain-to-text translation of MEG signals in a speech-decoding formation.

Brain Computer Interface EEG

Unveiling Typographic Deceptions: Insights of the Typographic Vulnerability in Large Vision-Language Model

no code implementations29 Feb 2024 Hao Cheng, Erjia Xiao, Jindong Gu, Le Yang, Jinhao Duan, Jize Zhang, Jiahang Cao, Kaidi Xu, Renjing Xu

Large Vision-Language Models (LVLMs) rely on vision encoders and Large Language Models (LLMs) to exhibit remarkable capabilities on various multi-modal tasks in the joint space of vision and language.

Language Modelling Object Recognition +1

Learning Robust Generalizable Radiance Field with Visibility and Feature Augmented Point Representation

no code implementations25 Jan 2024 Jiaxu Wang, Ziyi Zhang, Renjing Xu

Experiments show that our model can deliver better geometries, view consistencies, and rendering quality than all counterparts and benchmarks on three datasets in both generalization and finetuning settings, preliminarily proving the potential of the new paradigm for generalizable NeRF.

Neural Rendering

Adaptive Calibration: A Unified Conversion Framework of Spiking Neural Networks

1 code implementation24 Nov 2023 Ziqing Wang, Yuetong Fang, Jiahang Cao, Renjing Xu

Spiking Neural Networks (SNNs) have emerged as a promising energy-efficient alternative to traditional Artificial Neural Networks (ANNs).

Event-based vision object-detection +1

Pursing the Sparse Limitation of Spiking Deep Learning Structures

no code implementations18 Nov 2023 Hao Cheng, Jiahang Cao, Erjia Xiao, Mengshu Sun, Le Yang, Jize Zhang, Xue Lin, Bhavya Kailkhura, Kaidi Xu, Renjing Xu

It posits that within dense neural networks, there exist winning tickets or subnetworks that are sparser but do not compromise performance.

Fully Spiking Neural Network for Legged Robots

no code implementations8 Oct 2023 Xiaoyang Jiang, Qiang Zhang, Jingkai Sun, Jiahang Cao, Jingtong Ma, Renjing Xu

In recent years, legged robots based on deep reinforcement learning have made remarkable progress.

reinforcement-learning

RBFormer: Improve Adversarial Robustness of Transformer by Robust Bias

no code implementations23 Sep 2023 Hao Cheng, Jinhao Duan, Hui Li, Lyutianyang Zhang, Jiahang Cao, Ping Wang, Jize Zhang, Kaidi Xu, Renjing Xu

Recently, there has been a surge of interest and attention in Transformer-based structures, such as Vision Transformer (ViT) and Vision Multilayer Perceptron (VMLP).

Adversarial Robustness

Gaining the Sparse Rewards by Exploring Lottery Tickets in Spiking Neural Network

no code implementations23 Sep 2023 Hao Cheng, Jiahang Cao, Erjia Xiao, Mengshu Sun, Renjing Xu

Deploying energy-efficient deep learning algorithms on computational-limited devices, such as robots, is still a pressing issue for real-world applications.

Binarization

Chasing Day and Night: Towards Robust and Efficient All-Day Object Detection Guided by an Event Camera

no code implementations17 Sep 2023 Jiahang Cao, Xu Zheng, Yuanhuiyi Lyu, Jiaxu Wang, Renjing Xu, Lin Wang

The ability to detect objects in all lighting (i. e., normal-, over-, and under-exposed) conditions is crucial for real-world applications, such as self-driving. Traditional RGB-based detectors often fail under such varying lighting conditions. Therefore, recent works utilize novel event cameras to supplement or guide the RGB modality; however, these methods typically adopt asymmetric network structures that rely predominantly on the RGB modality, resulting in limited robustness for all-day detection.

Novel Object Detection object-detection +2

TTPOINT: A Tensorized Point Cloud Network for Lightweight Action Recognition with Event Cameras

no code implementations19 Aug 2023 Hongwei Ren, Yue Zhou, Haotian Fu, Yulong Huang, Renjing Xu, Bojun Cheng

In the experiment, TTPOINT emerged as the SOTA method on three datasets while also attaining SOTA among point cloud methods on all five datasets.

Action Recognition

Shifting Attention to Relevance: Towards the Uncertainty Estimation of Large Language Models

1 code implementation3 Jul 2023 Jinhao Duan, Hao Cheng, Shiqi Wang, Alex Zavalny, Chenan Wang, Renjing Xu, Bhavya Kailkhura, Kaidi Xu

While Large Language Models (LLMs) have demonstrated remarkable potential in natural language generation and instruction following, a persistent challenge lies in their susceptibility to "hallucinations", which erodes trust in their outputs.

Instruction Following Question Answering +4

Spiking Denoising Diffusion Probabilistic Models

1 code implementation29 Jun 2023 Jiahang Cao, Ziqing Wang, Hanzhong Guo, Hao Cheng, Qiang Zhang, Renjing Xu

In our paper, we put forward Spiking Denoising Diffusion Probabilistic Models (SDDPM), a new class of SNN-based generative models that achieve high sample quality.

Denoising

Masked Spiking Transformer

1 code implementation ICCV 2023 Ziqing Wang, Yuetong Fang, Jiahang Cao, Qiang Zhang, Zhongrui Wang, Renjing Xu

The combination of Spiking Neural Networks (SNNs) and Transformers has attracted significant attention due to their potential for high energy efficiency and high-performance nature.

Cannot find the paper you are looking for? You can Submit a new open access paper.