Search Results for author:
Found 40 papers, 8 papers with code
PandaGuard: Systematic Evaluation of LLM Safety against Jailbreaking Attacks
Large language models (LLMs) have achieved remarkable capabilities but remain vulnerable to adversarial prompts known as jailbreaks, which can bypass safety alignment and elicit harmful outputs.
STEP: A Unified Spiking Transformer Evaluation Platform for Fair and Reproducible Benchmarking
Spiking Transformers have recently emerged as promising architectures for combining the efficiency of spiking neural networks with the representational power of self-attention.
Incorporating brain-inspired mechanisms for multimodal learning in artificial intelligence
Inspired by this biological mechanism, we explore the relationship between multimodal output and information from individual modalities, proposing an inverse effectiveness driven multimodal fusion (IEMF) strategy.
Biologically Inspired Spiking Diffusion Model with Adaptive Lateral Selection Mechanism
We leverage this spiking inner loop alongside a lateral connection mechanism to iteratively refine the substructure selection network, enhancing model adaptability and expressivity.
Enhancing Audio-Visual Spiking Neural Networks through Semantic-Alignment and Cross-Modal Residual Learning
However, existing SNN models primarily focus on unimodal processing and lack efficient cross-modal information fusion, thereby limiting their effectiveness in real-world multimodal scenarios.
$SpikePack$: Enhanced Information Flow in Spiking Neural Networks with High Hardware Compatibility
${SpikePack}$ achieves constant $\mathcal{O}(1)$ time and space complexity, enabling efficient parallel processing on GPUs and also supporting serial inference on existing SNN hardware accelerators.
Harnessing Task Overload for Scalable Jailbreak Attacks on Large Language Models
Existing attack methods are fixed or specifically tailored for certain models and cannot flexibly adjust attack strength, which is critical for generalization when attacking models of various sizes.
Jailbreak Antidote: Runtime Safety-Utility Balance via Sparse Representation Adjustment in Large Language Models
In this paper, we introduce Jailbreak Antidote, a method that enables real-time adjustment of LLM safety preferences by manipulating a sparse subset of the model's internal states during inference.
StressPrompt: Does Stress Impact Large Language Models and Human Performance Similarly?
Moreover, this study contributes to the broader AI research community by offering a new perspective on how LLMs handle different scenarios and their similarities to human cognition.
Brain-Inspired Stepwise Patch Merging for Vision Transformers
The hierarchical architecture has become a mainstream design paradigm for Vision Transformers (ViTs), with Patch Merging serving as the pivotal component that transforms a columnar architecture into a hierarchical one.
CACE-Net: Co-guidance Attention and Contrastive Enhancement for Effective Audio-Visual Event Localization
Specifically, we have enhanced the model's ability to discern subtle differences between event and background and improved the accuracy of event classification in our model.
Directly Training Temporal Spiking Neural Network with Sparse Surrogate Gradient
Brain-inspired Spiking Neural Networks (SNNs) have attracted much attention due to their event-based computing and energy-efficient features.
EventZoom: A Progressive Approach to Event-Based Data Augmentation for Enhanced Neuromorphic Vision
However, existing augmentation methods often neglect the preservation of spatial integrity and temporal continuity.
Time Cell Inspired Temporal Codebook in Spiking Neural Networks for Enhanced Image Generation
This paper presents a novel approach leveraging Spiking Neural Networks (SNNs) to construct a Variational Quantized Autoencoder (VQ-VAE) with a temporal codebook inspired by hippocampal time cells.
Neuro-Vision to Language: Enhancing Brain Recording-based Visual Reconstruction and Language Interaction
Decoding non-invasive brain recordings is pivotal for advancing our understanding of human cognition but faces challenges due to individual differences and complex neural signal representations.
Brain-inspired and Self-based Artificial Intelligence
In this paper, we introduce a Brain-inspired and Self-based Artificial Intelligence (BriSe AI) paradigm.
Parallel Spiking Unit for Efficient Training of Spiking Neural Networks
Efficient parallel computing has become a pivotal element in advancing artificial intelligence.
TIM: An Efficient Temporal Interaction Module for Spiking Transformer
Spiking Neural Networks (SNNs), as the third generation of neural networks, have gained prominence for their biological plausibility and computational efficiency, especially in processing diverse datasets.
Are Conventional SNNs Really Efficient? A Perspective from Network Quantization
This paper introduces a unified perspective illustrating that the time steps in SNNs and quantized bit-widths of activation values present analogous representations.
Astrocyte-Enabled Advancements in Spiking Neural Networks for Large Language Modeling
Within the complex neuroarchitecture of the brain, astrocytes play crucial roles in development, structure, and metabolism.
Is Conventional SNN Really Efficient? A Perspective from Network Quantization
This paper introduces a unified perspective, illustrating that the time steps in SNNs and quantized bit-widths of activation values present analogous representations.
FireFly v2: Advancing Hardware Support for High-Performance Spiking Neural Network with a Spatiotemporal FPGA Accelerator
As a further step in supporting high-performance SNNs on specialized hardware, we introduce FireFly v2, an FPGA SNN accelerator that can address the issue of non-spike operation in current SOTA SNN algorithms, which presents an obstacle in the end-to-end deployment onto existing SNN hardware.
Learning the Plasticity: Plasticity-Driven Learning Framework in Spiking Neural Networks
This shift in focus from weight adjustment to mastering the intricacies of synaptic change offers a more flexible and dynamic pathway for neural networks to evolve and adapt.
Improving Stability and Performance of Spiking Neural Networks through Enhancing Temporal Consistency
Notably, our algorithm has achieved state-of-the-art performance on neuromorphic datasets DVS-CIFAR10 and N-Caltech101, and can achieve superior performance in the test phase with timestep T=1.
Dive into the Power of Neuronal Heterogeneity
The biological neural network is a vast and diverse structure with high neural heterogeneity.
Spiking Generative Adversarial Network with Attention Scoring Decoding
As it stands, such models are primarily limited to the domain of artificial neural networks.
Temporal Knowledge Sharing enable Spiking Neural Network Learning from Past and Future
However, SNNs typically grapple with challenges such as extended time steps, low temporal information utilization, and the requirement for consistent time step between testing and training.
MSAT: Biologically Inspired Multi-Stage Adaptive Threshold for Conversion of Spiking Neural Networks
The self-adaptation to membrane potential and input allows a timely adjustment of the threshold to fire spike faster and transmit more information.
An Efficient Knowledge Transfer Strategy for Spiking Neural Networks from Static to Event Domain
In order to improve the generalization ability of SNNs on event-based datasets, we use static images to assist SNN training on event data.
Exploiting High Performance Spiking Neural Networks with Efficient Spiking Patterns
Inspired by spike patterns in biological neurons, this paper introduces the dynamic Burst pattern and designs the Leaky Integrate and Fire or Burst (LIFB) neuron that can make a trade-off between short-time performance and dynamic temporal performance from the perspective of network information capacity.
FireFly: A High-Throughput Hardware Accelerator for Spiking Neural Networks with Efficient DSP and Memory Optimization
To improve memory efficiency, we design a memory system to enable efficient synaptic weights and membrane voltage memory access with reasonable on-chip RAM consumption.
BrainCog: A Spiking Neural Network based Brain-inspired Cognitive Intelligence Engine for Brain-inspired AI and Brain Simulation
These brain-inspired AI models have been effectively validated on various supervised, unsupervised, and reinforcement learning tasks, and they can be used to enable AI models to be with multiple brain-inspired cognitive functions.
An Unsupervised STDP-based Spiking Neural Network Inspired By Biologically Plausible Learning Rules and Connections
By integrating the above three adaptive mechanisms and STB-STDP, our model greatly accelerates the training of unsupervised spiking neural networks and improves the performance of unsupervised SNNs on complex tasks.
DPSNN: A Differentially Private Spiking Neural Network with Temporal Enhanced Pooling
Privacy protection is a crucial issue in machine learning algorithms, and the current privacy protection is combined with traditional artificial neural networks based on real values.
EventMix: An Efficient Augmentation Strategy for Event-Based Data
Data augmentation can improve the quantity and quality of the original data by processing more representations from the original data.
N-Omniglot, a large-scale neuromorphic dataset for spatio-temporal sparse few-shot learning
Few-shot learning (learning with a few samples) is one of the most important cognitive abilities of the human brain.
Spiking CapsNet: A Spiking Neural Network With A Biologically Plausible Routing Rule Between Capsules
Our Spiking CapsNet fully combines the strengthens of SNN and CapsNet, and shows strong robustness to noise and affine transformation.
Backpropagation with Biologically Plausible Spatio-Temporal Adjustment For Training Deep Spiking Neural Networks
Secondly, we propose a biologically plausible temporal adjustment making the error propagate across the spikes in the temporal dimension, which overcomes the problem of the temporal dependency within a single spike period of the traditional spiking neurons.
BSNN: Towards Faster and Better Conversion of Artificial Neural Networks to Spiking Neural Networks with Bistable Neurons
Also, when ResNet structure-based ANNs are converted, the information of output neurons is incomplete due to the rapid transmission of the shortcut path.
BackEISNN: A Deep Spiking Neural Network with Adaptive Self-Feedback and Balanced Excitatory-Inhibitory Neurons
With the combination of the two mechanisms, we propose a deep spiking neural network with adaptive self-feedback and balanced excitatory and inhibitory neurons (BackEISNN).
