Search Results for author:
Found 33 papers, 11 papers with code
ReconDreamer: Crafting World Models for Driving Scene Reconstruction via Online Restoration
This is complemented by a progressive data update strategy designed to ensure high-quality rendering for more complex maneuvers.
EgoVid-5M: A Large-Scale Video-Action Dataset for Egocentric Video Generation
Video generation has emerged as a promising tool for world simulation, leveraging visual data to replicate real-world environments.
DriveDreamer4D: World Models Are Effective Data Machines for 4D Driving Scene Representation
Contemporary sensor simulation methods, such as NeRF and 3DGS, rely predominantly on conditions closely aligned with training data distributions, which are largely confined to forward-driving scenarios.
CoReS: Orchestrating the Dance of Reasoning and Segmentation
We believe that the act of reasoning segmentation should mirror the cognitive stages of human visual search, where each step is a progressive refinement of thought toward the final object.
DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generation
DriveDreamer-2 is the first world model to generate customized driving videos, it can generate uncommon driving videos (e. g., vehicles abruptly cut in) in a user-friendly manner.
Relevant Intrinsic Feature Enhancement Network for Few-Shot Semantic Segmentation
To improve the semantic consistency of foreground instances, we propose an unlabeled branch as an efficient data utilization method, which teaches the model how to extract intrinsic features robust to intra-class differences.
Inferring Attracting Basins of Power System with Machine Learning
Power systems dominated by renewable energy encounter frequently large, random disturbances, and a critical challenge faced in power-system management is how to anticipate accurately whether the perturbed systems will return to the functional state after the transient or collapse.
FreeSeg: Unified, Universal and Open-Vocabulary Image Segmentation
Recently, open-vocabulary learning has emerged to accomplish segmentation for arbitrary categories of text-based descriptions, which popularizes the segmentation system to more general-purpose application scenarios.
Ranked #7 on
Open Vocabulary Panoptic Segmentation
on ADE20K
DiffBEV: Conditional Diffusion Model for Bird's Eye View Perception
Diffusion models naturally have the ability to denoise noisy samples to the ideal data, which motivates us to utilize the diffusion model to get a better BEV representation.
OpenOccupancy: A Large Scale Benchmark for Surrounding Semantic Occupancy Perception
Towards a comprehensive benchmarking of surrounding perception algorithms, we propose OpenOccupancy, which is the first surrounding semantic occupancy perception benchmark.
Breathing cluster in complex neuron-astrocyte networks
It is revealed that the contents of the cluster are determined by the network symmetry and the breathing activities are due to the interplay between the neural network and the astrocyte.
Are We Ready for Vision-Centric Driving Streaming Perception? The ASAP Benchmark
To mitigate the problem, we propose the Autonomous-driving StreAming Perception (ASAP) benchmark, which is the first benchmark to evaluate the online performance of vision-centric perception in autonomous driving.
Multi-Granularity Distillation Scheme Towards Lightweight Semi-Supervised Semantic Segmentation
Consequently, we offer the first attempt to provide lightweight SSSS models via a novel multi-granularity distillation (MGD) scheme, where multi-granularity is captured from three aspects: i) complementary teacher structure; ii) labeled-unlabeled data cooperative distillation; iii) hierarchical and multi-levels loss setting.
Knowledge Distillation
Semi-Supervised Semantic Segmentation
Crafting Monocular Cues and Velocity Guidance for Self-Supervised Multi-Frame Depth Learning
In contrast, multi-frame depth estimation methods improve the depth accuracy thanks to the success of Multi-View Stereo (MVS), which directly makes use of geometric constraints.
MVSTER: Epipolar Transformer for Efficient Multi-View Stereo
Therefore, we present MVSTER, which leverages the proposed epipolar Transformer to learn both 2D semantics and 3D spatial associations efficiently.
HFT: Lifting Perspective Representations via Hybrid Feature Transformation
In order to reap the benefits and avoid the drawbacks of CBFT and CFFT, we propose a novel framework with a Hybrid Feature Transformation module (HFT).
Activation Modulation and Recalibration Scheme for Weakly Supervised Semantic Segmentation
Extensive experiments show that AMR establishes a new state-of-the-art performance on the PASCAL VOC 2012 dataset, surpassing not only current methods trained with the image-level of supervision but also some methods relying on stronger supervision, such as saliency label.
Criticality in Reservoir Computer of Coupled Phase Oscillators
Additionally, it is found that despite the synchronization degree of the original network, once properly trained, the reservoir network is always developed to the same critical state, exemplifying the "attractor" nature of this state in machine learning.
Learning Hamiltonian dynamics by reservoir computer
Reconstructing the KAM dynamics diagram of Hamiltonian system from the time series of a limited number of parameters is an outstanding question in nonlinear science, especially when the Hamiltonian governing the system dynamics are unknown.
Anticipating synchronization with machine learning
In applications of dynamical systems, situations can arise where it is desired to predict the onset of synchronization as it can lead to characteristic and significant changes in the system performance and behaviors, for better or worse.
ResizeMix: Mixing Data with Preserved Object Information and True Labels
Especially, CutMix uses a simple but effective method to improve the classifiers by randomly cropping a patch from one image and pasting it on another image.
Synchronization within synchronization: transients and intermittency in ecological networks
Transients are fundamental to ecological systems with significant implications to management, conservation, and biological control.
Transfer learning of chaotic systems
Here we investigate transfer learning of chaotic systems from the perspective of synchronization-based state inference, in which a reservoir computer trained by chaotic system A is used to infer the unmeasured variables of chaotic system B, while A is different from B in either parameter or dynamics.
Learning Dynamic Routing for Semantic Segmentation
To demonstrate the superiority of the dynamic property, we compare with several static architectures, which can be modeled as special cases in the routing space.
Long-term prediction of chaotic systems with recurrent neural networks
Reservoir computing systems, a class of recurrent neural networks, have recently been exploited for model-free, data-based prediction of the state evolution of a variety of chaotic dynamical systems.
Directional Deep Embedding and Appearance Learning for Fast Video Object Segmentation
We propose a directional deep embedding and appearance learning (DDEAL) method, which is free of the online fine-tuning process, for fast VOS.
Multiple receptive fields and small-object-focusing weakly-supervised segmentation network for fast object detection
To address this problem, we propose a multiple receptive field and small-object-focusing weakly-supervised segmentation network (MRFSWSnet) to achieve fast object detection.
Cluster Regularized Quantization for Deep Networks Compression
Deep neural networks (DNNs) have achieved great success in a wide range of computer vision areas, but the applications to mobile devices is limited due to their high storage and computational cost.
Multi-loss-aware Channel Pruning of Deep Networks
Particularly, we introduce an additional loss to encode the differences in the feature and semantic distributions within feature maps between the baseline model and the pruned one.
Identity-Enhanced Network for Facial Expression Recognition
Facial expression recognition is a challenging task, arguably because of large intra-class variations and high inter-class similarities.
Facial Expression Recognition
Facial Expression Recognition (FER)
+1
Attention-guided Unified Network for Panoptic Segmentation
This paper studies panoptic segmentation, a recently proposed task which segments foreground (FG) objects at the instance level as well as background (BG) contents at the semantic level.
Ranked #24 on
Panoptic Segmentation
on COCO test-dev
Adversarial Feature Sampling Learning for Efficient Visual Tracking
The tracking-by-detection framework usually consist of two stages: drawing samples around the target object in the first stage and classifying each sample as the target object or background in the second stage.
A novel channel pruning method for deep neural network compression
In order to accelerate the selection process, the proposed method formulates it as a search problem, which can be solved efficiently by genetic algorithm.
