Search Results for author:
Found 135 papers, 75 papers with code
Deep Transfer Learning for Person Re-identification
Second, a two-stepped fine-tuning strategy is developed to transfer knowledge from auxiliary datasets.
HARDVS: Revisiting Human Activity Recognition with Dynamic Vision Sensors
The main streams of human activity recognition (HAR) algorithms are developed based on RGB cameras which are suffered from illumination, fast motion, privacy-preserving, and large energy consumption.
SpikingJelly: An open-source machine learning infrastructure platform for spike-based intelligence
Spiking neural networks (SNNs) aim to realize brain-inspired intelligence on neuromorphic chips with high energy efficiency by introducing neural dynamics and spike properties.
Masked Autoencoders for Point Cloud Self-supervised Learning
Then, a standard Transformer based autoencoder, with an asymmetric design and a shifting mask tokens operation, learns high-level latent features from unmasked point patches, aiming to reconstruct the masked point patches.
Ranked #2 on
Point Cloud Segmentation
on PointCloud-C
3D Part Segmentation
Few-Shot 3D Point Cloud Classification
+2
Machine Mindset: An MBTI Exploration of Large Language Models
We present a novel approach for integrating Myers-Briggs Type Indicator (MBTI) personality traits into large language models (LLMs), addressing the challenges of personality consistency in personalized AI.
Towards More Flexible and Accurate Object Tracking with Natural Language: Algorithms and Benchmark
We believe this benchmark will greatly boost related researches on natural language guided tracking.
Ranked #3 on
Visual Object Tracking
on TNL2K
(precision metric)
Event Stream-based Visual Object Tracking: A High-Resolution Benchmark Dataset and A Novel Baseline
Tracking using bio-inspired event cameras has drawn more and more attention in recent years.
Masked Face Recognition with Latent Part Detection
The proposed LPD model is trained in an end-to-end manner and only utilizes the original and synthetic training data.
Large-scale Multi-Modal Pre-trained Models: A Comprehensive Survey
We also give visualization and analysis of the model parameters and results on representative downstream tasks.
HRank: Filter Pruning using High-Rank Feature Map
The principle behind our pruning is that low-rank feature maps contain less information, and thus pruned results can be easily reproduced.
Spikformer: When Spiking Neural Network Meets Transformer
Spikformer (66. 3M parameters) with comparable size to SEW-ResNet-152 (60. 2M, 69. 26%) can achieve 74. 81% top1 accuracy on ImageNet using 4 time steps, which is the state-of-the-art in directly trained SNNs models.
Spikformer V2: Join the High Accuracy Club on ImageNet with an SNN Ticket
To the best of our knowledge, this is the first time that the SNN achieves 80+% accuracy on ImageNet.
PanGu-$α$: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computation
To enhance the generalization ability of PanGu-$\alpha$, we collect 1. 1TB high-quality Chinese data from a wide range of domains to pretrain the model.
Ranked #1 on
Reading Comprehension (One-Shot)
on DuReader
Cloze (multi-choices) (Few-Shot)
Cloze (multi-choices) (One-Shot)
+19
Rethinking Performance Estimation in Neural Architecture Search
In this paper, we provide a novel yet systematic rethinking of PE in a resource constrained regime, termed budgeted PE (BPE), which precisely and effectively estimates the performance of an architecture sampled from an architecture space.
Spike-driven Transformer
In this paper, we incorporate the spike-driven paradigm into Transformer by the proposed Spike-driven Transformer with four unique properties: 1) Event-driven, no calculation is triggered when the input of Transformer is zero; 2) Binary spike communication, all matrix multiplications associated with the spike matrix can be transformed into sparse additions; 3) Self-attention with linear complexity at both token and channel dimensions; 4) The operations between spike-form Query, Key, and Value are mask and addition.
Channel Pruning via Automatic Structure Search
In this paper, we propose a new channel pruning method based on artificial bee colony algorithm (ABC), dubbed as ABCPruner, which aims to efficiently find optimal pruned structure, i. e., channel number in each layer, rather than selecting "important" channels as previous works did.
Adversarial Reciprocal Points Learning for Open Set Recognition
Then, an adversarial margin constraint is proposed to reduce the open space risk by limiting the latent open space constructed by reciprocal points.
Deep Residual Learning in Spiking Neural Networks
Previous Spiking ResNet mimics the standard residual block in ANNs and simply replaces ReLU activation layers with spiking neurons, which suffers the degradation problem and can hardly implement residual learning.
State Space Model for New-Generation Network Alternative to Transformers: A Survey
In this paper, we give the first comprehensive review of these works and also provide experimental comparisons and analysis to better demonstrate the features and advantages of SSM.
Multiple Expert Brainstorming for Domain Adaptive Person Re-identification
Often the best performing deep neural models are ensembles of multiple base-level networks, nevertheless, ensemble learning with respect to domain adaptive person re-ID remains unexplored.
Domain Adaptive Person Re-Identification
Ensemble Learning
+1
VisEvent: Reliable Object Tracking via Collaboration of Frame and Event Flows
Different from visible cameras which record intensity images frame by frame, the biologically inspired event camera produces a stream of asynchronous and sparse events with much lower latency.
Ranked #1 on
Object Tracking
on VisEvent
Revisiting Color-Event based Tracking: A Unified Network, Dataset, and Metric
In this paper, we propose a single-stage backbone network for Color-Event Unified Tracking (CEUTrack), which achieves the above functions simultaneously.
Ranked #3 on
Object Tracking
on COESOT
Incorporating Learnable Membrane Time Constant to Enhance Learning of Spiking Neural Networks
In this paper, we take inspiration from the observation that membrane-related parameters are different across brain regions, and propose a training algorithm that is capable of learning not only the synaptic weights but also the membrane time constants of SNNs.
Meta Architecture for Point Cloud Analysis
However, the lack of a unified framework to interpret those networks makes any systematic comparison, contrast, or analysis challenging, and practically limits healthy development of the field.
Ranked #2 on
3D Semantic Segmentation
on OpenTrench3D
Amplitude-Phase Recombination: Rethinking Robustness of Convolutional Neural Networks in Frequency Domain
This observation leads to more explanations of the CNN's generalization behaviors in both robustness to common perturbations and out-of-distribution detection, and motivates a new perspective on data augmentation designed by re-combing the phase spectrum of the current image and the amplitude spectrum of the distracter image.
Ranked #7 on
Out-of-Distribution Detection
on CIFAR-10
Spike-driven Transformer V2: Meta Spiking Neural Network Architecture Inspiring the Design of Next-generation Neuromorphic Chips
CNN-based SNNs are the current mainstream of neuromorphic computing.
Learning with Fantasy: Semantic-Aware Virtual Contrastive Constraint for Few-Shot Class-Incremental Learning
However, in this work, we find that the CE loss is not ideal for the base session training as it suffers poor class separation in terms of representations, which further degrades generalization to novel classes.
Spikingformer: Spike-driven Residual Learning for Transformer-based Spiking Neural Network
Based on this residual design, we develop Spikingformer, a pure transformer-based spiking neural network.
Filter Sketch for Network Pruning
Our approach, referred to as FilterSketch, encodes the second-order information of pre-trained weights, which enables the representation capacity of pruned networks to be recovered with a simple fine-tuning procedure.
Greedy Hash: Towards Fast Optimization for Accurate Hash Coding in CNN
To convert the input into binary code, hashing algorithm has been widely used for approximate nearest neighbor search on large-scale image sets due to its computation and storage efficiency.
Neural Architecture Search With Representation Mutual Information
Building upon RMI, we further propose a new search algorithm termed RMI-NAS, facilitating with a theorem to guarantee the global optimal of the searched architecture.
Event-based Video Reconstruction via Potential-assisted Spiking Neural Network
We propose a novel Event-based Video reconstruction framework based on a fully Spiking Neural Network (EVSNN), which utilizes Leaky-Integrate-and-Fire (LIF) neuron and Membrane Potential (MP) neuron.
Computational Efficiency
Event-Based Video Reconstruction
+2
SEKD: Self-Evolving Keypoint Detection and Description
Researchers have attempted utilizing deep neural network (DNN) to learn novel local features from images inspired by its recent successes on a variety of vision tasks.
1xN Pattern for Pruning Convolutional Neural Networks
We also provide a workflow of filter rearrangement that first rearranges the weight matrix in the output channel dimension to derive more influential blocks for accuracy improvements and then applies similar rearrangement to the next-layer weights in the input channel dimension to ensure correct convolutional operations.
Long-term Frame-Event Visual Tracking: Benchmark Dataset and Baseline
Current event-/frame-event based trackers undergo evaluation on short-term tracking datasets, however, the tracking of real-world scenarios involves long-term tracking, and the performance of existing tracking algorithms in these scenarios remains unclear.
ReCU: Reviving the Dead Weights in Binary Neural Networks
We prove that reviving the "dead weights" by ReCU can result in a smaller quantization error.
Training Full Spike Neural Networks via Auxiliary Accumulation Pathway
The accumulation in AAP could compensate for the information loss during the forward and backward of full spike propagation, and facilitate the training of the FSNN.
Parallel Spiking Neurons with High Efficiency and Ability to Learn Long-term Dependencies
Vanilla spiking neurons in Spiking Neural Networks (SNNs) use charge-fire-reset neuronal dynamics, which can only be simulated serially and can hardly learn long-time dependencies.
MetaVIM: Meta Variationally Intrinsic Motivated Reinforcement Learning for Decentralized Traffic Signal Control
To make the policy learned from a training scenario generalizable to new unseen scenarios, a novel Meta Variationally Intrinsic Motivated (MetaVIM) RL method is proposed to learn the decentralized policy for each intersection that considers neighbor information in a latent way.
Training-free Transformer Architecture Search
Recently, Vision Transformer (ViT) has achieved remarkable success in several computer vision tasks.
Enhancing the Performance of Transformer-based Spiking Neural Networks by SNN-optimized Downsampling with Precise Gradient Backpropagation
In this paper, we propose ConvBN-MaxPooling-LIF (CML), an SNN-optimized downsampling with precise gradient backpropagation.
Learning long-term dependencies for action recognition with a biologically-inspired deep network
Despite a lot of research efforts devoted in recent years, how to efficiently learn long-term dependencies from sequences still remains a pretty challenging task.
QKFormer: Hierarchical Spiking Transformer using Q-K Attention
ii) We incorporate the hierarchical structure, which significantly benefits the performance of both the brain and artificial neural networks, into spiking transformers to obtain multi-scale spiking representation.
Distilling a Powerful Student Model via Online Knowledge Distillation
Besides, a self-distillation module is adopted to convert the feature map of deeper layers into a shallower one.
IntraQ: Learning Synthetic Images with Intra-Class Heterogeneity for Zero-Shot Network Quantization
In this paper, we observe an interesting phenomenon of intra-class heterogeneity in real data and show that existing methods fail to retain this property in their synthetic images, which causes a limited performance increase.
SODFormer: Streaming Object Detection with Transformer Using Events and Frames
Then, we design a spatiotemporal Transformer architecture to detect objects via an end-to-end sequence prediction problem, where the novel temporal Transformer module leverages rich temporal cues from two visual streams to improve the detection performance.
Pruning of Deep Spiking Neural Networks through Gradient Rewiring
Our key innovation is to redefine the gradient to a new synaptic parameter, allowing better exploration of network structures by taking full advantage of the competition between pruning and regrowth of connections.
Optimal ANN-SNN Conversion for Fast and Accurate Inference in Deep Spiking Neural Networks
We show that the inference time can be reduced by optimizing the upper bound of the fit curve in the revised ANN to achieve fast inference.
MADAv2: Advanced Multi-Anchor Based Active Domain Adaptation Segmentation
Unsupervised domain adaption has been widely adopted in tasks with scarce annotated data.
An Information Theory-inspired Strategy for Automatic Network Pruning
This practically limits the application of model compression when the model needs to be deployed on a wide range of devices.
Fine-Grained Object Classification via Self-Supervised Pose Alignment
Semantic patterns of fine-grained objects are determined by subtle appearance difference of local parts, which thus inspires a number of part-based methods.
Learning Open Set Network with Discriminative Reciprocal Points
In this process, one of the key challenges is to reduce the risk of generalizing the inherent characteristics of numerous unknown samples learned from a small amount of known data.
Heterogeneous Relational Complement for Vehicle Re-identification
The crucial problem in vehicle re-identification is to find the same vehicle identity when reviewing this object from cross-view cameras, which sets a higher demand for learning viewpoint-invariant representations.
Universal Object Detection with Large Vision Model
In this study, our focus is on a specific challenge: the large-scale, multi-domain universal object detection problem, which contributes to the broader goal of achieving a universal vision system.
Part-guided Relational Transformers for Fine-grained Visual Recognition
This framework, namely PArt-guided Relational Transformers (PART), is proposed to learn the discriminative part features with an automatic part discovery module, and to explore the intrinsic correlations with a feature transformation module by adapting the Transformer models from the field of natural language processing.
Ranked #7 on
Fine-Grained Image Classification
on FGVC Aircraft
Fine-Grained Image Classification
Fine-Grained Visual Recognition
+1
Carrying out CNN Channel Pruning in a White Box
Specifically, to model the contribution of each channel to differentiating categories, we develop a class-wise mask for each channel, implemented in a dynamic training manner w. r. t.
Dual Adaptive Representation Alignment for Cross-domain Few-shot Learning
Recent progress in this setting assumes that the base knowledge and novel query samples are distributed in the same domains, which are usually infeasible for realistic applications.
A Unified Framework for Soft Threshold Pruning
In this work, we reformulate soft threshold pruning as an implicit optimization problem solved using the Iterative Shrinkage-Thresholding Algorithm (ISTA), a classic method from the fields of sparse recovery and compressed sensing.
MFGNet: Dynamic Modality-Aware Filter Generation for RGB-T Tracking
The visible and thermal filters will be used to conduct a dynamic convolutional operation on their corresponding input feature maps respectively.
Ranked #17 on
Rgb-T Tracking
on RGBT234
PowerGear: Early-Stage Power Estimation in FPGA HLS via Heterogeneous Edge-Centric GNNs
Specifically, in the graph construction flow, we introduce buffer insertion, datapath merging, graph trimming and feature annotation techniques to transform HLS designs into graph-structured data, which encode both intra-operation micro-architectures and inter-operation interconnects annotated with switching activities.
Deep Spiking Neural Networks with High Representation Similarity Model Visual Pathways of Macaque and Mouse
However, they highly simplify the computational properties of neurons compared to their biological counterparts.
SSTFormer: Bridging Spiking Neural Network and Memory Support Transformer for Frame-Event based Recognition
Secondly, they adopt either Spiking Neural Networks (SNN) for energy-efficient recognition with suboptimal results, or Artificial Neural Networks (ANN) for energy-intensive, high-performance recognition.
Tracking by Joint Local and Global Search: A Target-aware Attention based Approach
In this paper, we propose a novel and general target-aware attention mechanism (termed TANet) and integrate it with tracking-by-detection framework to conduct joint local and global search for robust tracking.
CRSOT: Cross-Resolution Object Tracking using Unaligned Frame and Event Cameras
In this work, we formally propose the task of object tracking using unaligned neuromorphic and visible cameras.
Dynamic Attention guided Multi-Trajectory Analysis for Single Object Tracking
In this paper, we propose to introduce more dynamics by devising a dynamic attention-guided multi-trajectory tracking strategy.
Point-Voxel Absorbing Graph Representation Learning for Event Stream based Recognition
To address these issues, we propose a novel dual point-voxel absorbing graph representation learning for event stream data representation.
Knowledge Prompt-tuning for Sequential Recommendation
Pre-trained language models (PLMs) have demonstrated strong performance in sequential recommendation (SR), which are utilized to extract general knowledge.
Optimal ANN-SNN Conversion with Group Neurons
For instance, while converting artificial neural networks (ANNs) to SNNs circumvents the need for direct training of SNNs, it encounters issues related to conversion errors and high inference time delays.
Salient Object Detection with Purificatory Mechanism and Structural Similarity Loss
Through these two attentions, we use the Purificatory Mechanism to impose strict weights with different regions of the whole salient objects and purify results from hard-to-distinguish regions, thus accurately predicting the locations and details of salient objects.
Unleashing the Power of CNN and Transformer for Balanced RGB-Event Video Recognition
It is intuitive to combine them for high-performance RGB-Event based video recognition, however, existing works fail to achieve a good balance between the accuracy and model parameters, as shown in Fig.~\ref{firstimage}.
Cooperative Bi-path Metric for Few-shot Learning
Given base classes with sufficient labeled samples, the target of few-shot classification is to recognize unlabeled samples of novel classes with only a few labeled samples.
Shadow Removal by High-Quality Shadow Synthesis
Specifically, the encoder extracts the shadow feature of a region identity which is then paired with another region identity to serve as the generator input to synthesize a pseudo image.
Picking Up Quantization Steps for Compressed Image Classification
The sensitivity of deep neural networks to compressed images hinders their usage in many real applications, which means classification networks may fail just after taking a screenshot and saving it as a compressed file.
Learning a Repression Network for Precise Vehicle Search
The growing explosion in the use of surveillance cameras in public security highlights the importance of vehicle search from large-scale image databases.
A simple blind-denoising filter inspired by electrically coupled photoreceptors in the retina
Photoreceptors in the retina are coupled by electrical synapses called "gap junctions".
Peeking the Impact of Points of Interests on Didi
Recently, the online car-hailing service, Didi, has emerged as a leader in the sharing economy.
YoTube: Searching Action Proposal via Recurrent and Static Regression Networks
In this paper, we present YoTube-a novel network fusion framework for searching action proposals in untrimmed videos, where each action proposal corresponds to a spatialtemporal video tube that potentially locates one human action.
Sequential Deep Trajectory Descriptor for Action Recognition with Three-stream CNN
Nevertheless, most of the existing features or descriptors cannot capture motion information effectively, especially for long-term motion.
Joint Network based Attention for Action Recognition
We also introduce an attention mechanism on the temporal domain to capture the long-term dependence meanwhile finding the salient portions.
Hierarchical Deep Co-segmentation of Primary Objects in Aerial Videos
Primary object segmentation plays an important role in understanding videos generated by unmanned aerial vehicles.
Winner-Take-All as Basic Probabilistic Inference Unit of Neuronal Circuits
Taken together, our results suggest that the WTA circuit could be seen as the minimal inference unit of neuronal circuits.
Neural System Identification with Spike-triggered Non-negative Matrix Factorization
Furthermore, we show that STNMF can separate spikes of a ganglion cell into a few subsets of spikes where each subset is contributed by one presynaptic bipolar cell.
Revealing Fine Structures of the Retinal Receptive Field by Deep Learning Networks
When a deep CNN with many layers is used for the visual system, it is not easy to compare the structure components of CNNs with possible neuroscience underpinnings due to highly complex circuits from the retina to higher visual cortex.
Model-guided Multi-path Knowledge Aggregation for Aerial Saliency Prediction
After that, the visual saliency knowledge encoded in the most representative paths is selected and aggregated to improve the capability of MM-Net in predicting spatial saliency in aerial scenarios.
Selectivity or Invariance: Boundary-aware Salient Object Detection
In this network, the feature selectivity at boundaries is enhanced by incorporating a boundary localization stream, while the feature invariance at interiors is guaranteed with a complex interior perception stream.
ODN: Opening the Deep Network for Open-set Action Recognition
Most of the existing action recognition works hold the \textit{closed-set} assumption that all action categories are known beforehand while deep networks can be well trained for these categories.
Quality Assessment for Comparing Image Enhancement Algorithms
As the image enhancement algorithms developed in recent years, how to compare the performances of different image enhancement algorithms becomes a novel task.
Unsupervised Cross-Dataset Transfer Learning for Person Re-Identification
Most existing person re-identification (Re-ID) approaches follow a supervised learning framework, in which a large number of labelled matching pairs are required for training.
Deep Relative Distance Learning: Tell the Difference Between Similar Vehicles
To further facilitate the future research on this problem, we also present a carefully-organized large-scale image database "VehicleID", which includes multiple images of the same vehicle captured by different real-world cameras in a city.
Exploiting Multi-Grain Ranking Constraints for Precisely Searching Visually-Similar Vehicles
In this paper, we model the relationship of vehicle images as multiple grains.
2D LiDAR Map Prediction via Estimating Motion Flow with GRU
To tackle this problem, we resort to the motion flow between adjacent maps, as motion flow is a powerful tool to process and analyze the dynamic data, which is named optical flow in video processing.
Probabilistic Inference of Binary Markov Random Fields in Spiking Neural Networks through Mean-field Approximation
Recent studies have suggested that the cognitive process of the human brain is realized as probabilistic inference and can be further modeled by probabilistic graphical models like Markov random fields.
Reconstruction of Natural Visual Scenes from Neural Spikes with Deep Neural Networks
The SID is an end-to-end decoder with one end as neural spikes and the other end as images, which can be trained directly such that visual scenes are reconstructed from spikes in a highly accurate fashion.
P-ODN: Prototype based Open Deep Network for Open Set Recognition
Predictors for new categories are added to the classification layer to "open" the deep neural networks to incorporate new categories dynamically.
A Retina-inspired Sampling Method for Visual Texture Reconstruction
Conventional frame-based camera is not able to meet the demand of rapid reaction for real-time applications, while the emerging dynamic vision sensor (DVS) can realize high speed capturing for moving objects.
Learning Local Feature Descriptor with Motion Attribute for Vision-based Localization
For better performance, the features used for open-loop localization are required to be short-term globally static, and the ones used for re-localization or loop closure detection need to be long-term static.
Distortion-adaptive Salient Object Detection in 360$^\circ$ Omnidirectional Images
Moreover, benchmarking results of the proposed baseline approach and other methods on 360$^\circ$ SOD dataset show the proposed dataset is very challenging, which also validate the usefulness of the proposed dataset and approach to boost the development of SOD on 360$^\circ$ omnidirectional scenes.
Exploring Reciprocal Attention for Salient Object Detection by Cooperative Learning
Typically, objects with the same semantics are not always prominent in images containing different backgrounds.
Transductive Episodic-Wise Adaptive Metric for Few-Shot Learning
By solving the problem with its closed-form solution on the fly with the setup of transduction, our approach efficiently tailors an episodic-wise metric for each task to adapt all features from a shared task-agnostic embedding space into a more discriminative task-specific metric space.
Self-Guided Adaptation: Progressive Representation Alignment for Domain Adaptive Object Detection
In this work, we propose a Self-Guided Adaptation (SGA) model, target at aligning feature representation and transferring object detection models across domains while considering the instantaneous alignment difficulty.
AD-Cluster: Augmented Discriminative Clustering for Domain Adaptive Person Re-identification
Domain adaptive person re-identification (re-ID) is a challenging task, especially when person identities in target domains are unknown.
Ranked #8 on
Unsupervised Domain Adaptation
on Duke to Market
Compositional Few-Shot Recognition with Primitive Discovery and Enhancing
Inspired by such capability of humans, to imitate humans' ability of learning visual primitives and composing primitives to recognize novel classes, we propose an approach to FSL to learn a feature representation composed of important primitives, which is jointly trained with two parts, i. e. primitive discovery and primitive enhancing.
Revisiting Mid-Level Patterns for Cross-Domain Few-Shot Recognition
To solve this problem, cross-domain FSL (CDFSL) is proposed very recently to transfer knowledge from general-domain base classes to special-domain novel classes.
Intrinsic Relationship Reasoning for Small Object Detection
In this paper, we propose a novel context reasoning approach for small object detection which models and infers the intrinsic semantic and spatial layout relationships between objects.
Rethinking Convolution: Towards an Optimal Efficiency
In this research, we propose a novel operator called \emph{optimal separable convolution} which can be calculated at $O(C^{\frac{3}{2}}KHW)$ by optimal design for the internal number of groups and kernel sizes for general separable convolutions.
Annotation-Efficient Untrimmed Video Action Recognition
In this paper, we target a new problem, Annotation-Efficient Video Recognition, to reduce the requirement of annotations for both large amount of samples and the action location.
Fast Class-wise Updating for Online Hashing
To achieve fast online adaptivity, a class-wise updating method is developed to decompose the binary code learning and alternatively renew the hash functions in a class-wise fashion, which well addresses the burden on large amounts of training batches.
Collaborative Intelligence: Challenges and Opportunities
This paper presents an overview of the emerging area of collaborative intelligence (CI).
High-Speed Image Reconstruction Through Short-Term Plasticity for Spiking Cameras
Mimicking the sampling mechanism of the fovea, a retina-inspired camera, named spiking camera, is developed to record the external information with a sampling rate of 40, 000 Hz, and outputs asynchronous binary spike streams.
NeuSpike-Net: High Speed Video Reconstruction via Bio-Inspired Neuromorphic Cameras
In this paper, we propose a NeuSpike-Net to learn both the high dynamic range and high motion sensitivity of DVS and the full texture sampling of spike camera to achieve high-speed and high dynamic image reconstruction.
Optimized Separable Convolution: Yet Another Efficient Convolution Operator
In this research, we propose a novel and principled operator called optimized separable convolution by optimal design for the internal number of groups and kernel sizes for general separable convolutions can achieve the complexity of O(C^{\frac{3}{2}}K).
Uncovering the Over-smoothing Challenge in Image Super-Resolution: Entropy-based Quantification and Contrastive Optimization
PSNR-oriented models are a critical class of super-resolution models with applications across various fields.
Deep Reinforcement Learning with Spiking Q-learning
With the help of special neuromorphic hardware, spiking neural networks (SNNs) are expected to realize artificial intelligence (AI) with less energy consumption.
1000x Faster Camera and Machine Vision with Ordinary Devices
By treating vidar as spike trains in biological vision, we have further developed a spiking neural network-based machine vision system that combines the speed of the machine and the mechanism of biological vision, achieving high-speed object detection and tracking 1, 000x faster than human vision.
Transformations in Learned Image Compression from a Modulation Perspective
In the view of TSM, the existing transformation methods are mathematically reduced to a linear modulation.
Annotation Efficient Person Re-Identification with Diverse Cluster-Based Pair Selection
To solve this problem, we propose the Annotation Efficient Person Re-Identification method to select image pairs from an alternative pair set according to the fallibility and diversity of pairs, and train the Re-ID model based on the annotation.
Attention Spiking Neural Networks
On ImageNet-1K, we achieve top-1 accuracy of 75. 92% and 77. 08% on single/4-step Res-SNN-104, which are state-of-the-art results in SNNs.
SNN-SC: A Spiking Semantic Communication Framework for Feature Transmission
However, most of the existing SC works only transmit analog information on the AWGN channel and cannot be directly used for digital channels.
Unsupervised Deraining: Where Asymmetric Contrastive Learning Meets Self-similarity
In addition, considering that the existing real rain datasets are of low quality, either small scale or downloaded from the internet, we collect a real large-scale dataset under various rainy kinds of weather that contains high-resolution rainy images.
Event-based Monocular Dense Depth Estimation with Recurrent Transformers
Event cameras, offering high temporal resolutions and high dynamic ranges, have brought a new perspective to address common challenges (e. g., motion blur and low light) in monocular depth estimation.
Parsing Objects at a Finer Granularity: A Survey
Fine-grained visual parsing, including fine-grained part segmentation and fine-grained object recognition, has attracted considerable critical attention due to its importance in many real-world applications, e. g., agriculture, remote sensing, and space technologies.
Album Storytelling with Iterative Story-aware Captioning and Large Language Models
One natural approach is to use caption models to describe each photo in the album, and then use LLMs to summarize and rewrite the generated captions into an engaging story.
Probabilistic Modeling: Proving the Lottery Ticket Hypothesis in Spiking Neural Network
LTH opens up a new path for network pruning.
Temporal Contrastive Learning for Spiking Neural Networks
However, in this work, we find the method above is not ideal for the SNNs training as it omits the temporal dynamics of SNNs and degrades the performance quickly with the decrease of inference time steps.
Auto-Spikformer: Spikformer Architecture Search
The integration of self-attention mechanisms into Spiking Neural Networks (SNNs) has garnered considerable interest in the realm of advanced deep learning, primarily due to their biological properties.
Deep recurrent spiking neural networks capture both static and dynamic representations of the visual cortex under movie stimuli
Taken together, our work is the first to apply deep recurrent SNNs to model the mouse visual cortex under movie stimuli and we establish that these networks are competent to capture both static and dynamic representations and make contributions to understanding the movie information processing mechanisms of the visual cortex.
Population-Based Evolutionary Gaming for Unsupervised Person Re-identification
Extensive experiments demonstrate that (1) CRS approximately measures the performance of models without labeled samples; (2) and PEG produces new state-of-the-art accuracy for person re-identification, indicating the great potential of population-based network cooperative training for unsupervised learning.
Knowledge Distillation
Unsupervised Person Re-Identification
Learning Sparse Neural Networks with Identity Layers
Applying such theory, we propose a plug-and-play CKA-based Sparsity Regularization for sparse network training, dubbed CKA-SR, which utilizes CKA to reduce feature similarity between layers and increase network sparsity.
Simoun: Synergizing Interactive Motion-appearance Understanding for Vision-based Reinforcement Learning
Efficient motion and appearance modeling are critical for vision-based Reinforcement Learning (RL).
Stabilizing Visual Reinforcement Learning via Asymmetric Interactive Cooperation
Vision-based reinforcement learning (RL) depends on discriminative representation encoders to abstract the observation states.
HiFi-123: Towards High-fidelity One Image to 3D Content Generation
Our contributions are twofold: First, we propose a Reference-Guided Novel View Enhancement (RGNV) technique that significantly improves the fidelity of diffusion-based zero-shot novel view synthesis methods.
Fully Spiking Actor Network with Intra-layer Connections for Reinforcement Learning
Recently, the surrogate gradient method has been utilized for training multi-layer SNNs, which allows SNNs to achieve comparable performance with the corresponding deep networks in this task.
Adaptive Discovering and Merging for Incremental Novel Class Discovery
One important desideratum of lifelong learning aims to discover novel classes from unlabelled data in a continuous manner.
Noisy Spiking Actor Network for Exploration
As a general method for exploration in deep reinforcement learning (RL), NoisyNet can produce problem-specific exploration strategies.
MTLight: Efficient Multi-Task Reinforcement Learning for Traffic Signal Control
Traffic signal control has a great impact on alleviating traffic congestion in modern cities.
