Search Results for author:
Found 55 papers, 24 papers with code
Diffusion-driven SpatioTemporal Graph KANsformer for Medical Examination Recommendation
In the second stage, a spatiotemporal graph KANsformer is proposed to simultaneously model the complex spatial and temporal relationships.
WVEmbs with its Masking: A Method For Radar Signal Sorting
Our study proposes a novel embedding method, Wide-Value-Embeddings (WVEmbs), for processing Pulse Descriptor Words (PDWs) as normalized inputs to neural networks.
Learned Correction Methods for Ultrasound Computed Tomography Imaging Using Simplified Physics Models
This work systematically assessed learned reconstruction methods incorporating an approximated physical model for USCT imaging.
Goku: Flow Based Video Generative Foundation Models
This paper introduces Goku, a state-of-the-art family of joint image-and-video generation models leveraging rectified flow Transformers to achieve industry-leading performance.
Adaptive Progressive Attention Graph Neural Network for EEG Emotion Recognition
In recent years, numerous neuroscientific studies demonstrate that specific areas of the brain are connected to human emotional responses, with these regions exhibiting variability across individuals and emotional states.
Integrating Language-Image Prior into EEG Decoding for Cross-Task Zero-Calibration RSVP-BCI
Specifically, we propose a prompt encoder based on the language-image pre-trained model to extract language-image features from task-specific prompts and stimulus images as prior knowledge for enhancing EEG decoding.
BeSimulator: A Large Language Model Powered Text-based Behavior Simulator
Traditional robot simulators focus on physical process modeling and realistic rendering, often suffering from high computational costs, inefficiencies, and limited adaptability.
Learning from the Web: Language Drives Weakly-Supervised Incremental Learning for Semantic Segmentation
Current weakly-supervised incremental learning for semantic segmentation (WILSS) approaches only consider replacing pixel-level annotations with image-level labels, while the training images are still from well-designed datasets.
A Study on Training and Developing Large Language Models for Behavior Tree Generation
The core contribution of this paper lies in the design of a BT generation framework based on LLM, which encompasses the entire process, from data synthesis and model training to application developing and data verification.
Investigating the Use of Traveltime and Reflection Tomography for Deep Learning-Based Sound-Speed Estimation in Ultrasound Computed Tomography
Ensemble average of the NRMSE, SSIM, and PSNR evaluated on this clinical dataset were 0. 2355, 0. 8845, and 28. 33 dB, respectively.
Retinex-guided Channel-grouping based Patch Swap for Arbitrary Style Transfer
The basic principle of the patch-matching based style transfer is to substitute the patches of the content image feature maps by the closest patches from the style image feature maps.
VideoGen: A Reference-Guided Latent Diffusion Approach for High Definition Text-to-Video Generation
In this paper, we present VideoGen, a text-to-video generation approach, which can generate a high-definition video with high frame fidelity and strong temporal consistency using reference-guided latent diffusion.
Learned Full Waveform Inversion Incorporating Task Information for Ultrasound Computed Tomography
Once trained, the CNN can perform real-time FWI image reconstruction from USCT waveform data.
EEG-based Emotion Style Transfer Network for Cross-dataset Emotion Recognition
The transfer module encodes the domain-specific information of source and target domains and then re-constructs the source domain's emotional pattern and the target domain's statistical characteristics into the new stylized EEG representations.
Vision Transformer with Attention Map Hallucination and FFN Compaction
Vision Transformer(ViT) is now dominating many vision tasks.
Revisiting Neural Retrieval on Accelerators
A key component of retrieval is to model (user, item) similarity, which is commonly represented as the dot product of two learned embeddings.
Master: Meta Style Transformer for Controllable Zero-Shot and Few-Shot Artistic Style Transfer
On the other hand, different from the vanilla version, we adopt a learnable scaling operation on content features before content-style feature interaction, which better preserves the original similarity between a pair of content features while ensuring the stylization quality.
DeltaEdit: Exploring Text-free Training for Text-Driven Image Manipulation
Our key idea is to investigate and identify a space, namely delta image and text space that has well-aligned distribution between CLIP visual feature differences of two images and CLIP textual embedding differences of source and target texts.
AdaCM: Adaptive ColorMLP for Real-Time Universal Photo-realistic Style Transfer
Then, in \textbf{AdaCM}, we adopt a CNN encoder to adaptively predict all parameters for the ColorMLP conditioned on each input content and style image pair.
RRSR:Reciprocal Reference-based Image Super-Resolution with Progressive Feature Alignment and Selection
While previous state-of-the-art RefSR methods mainly focus on improving the efficacy and robustness of reference feature transfer, it is generally overlooked that a well reconstructed SR image should enable better SR reconstruction for its similar LR images when it is referred to as.
It Takes Two: Masked Appearance-Motion Modeling for Self-supervised Video Transformer Pre-training
In order to guide the encoder to fully excavate spatial-temporal features, two separate decoders are used for two pretext tasks of disentangled appearance and motion prediction.
AIM 2022 Challenge on Super-Resolution of Compressed Image and Video: Dataset, Methods and Results
The homepage of this challenge is at https://github. com/RenYang-home/AIM22_CompressSR.
CODER: Coupled Diversity-Sensitive Momentum Contrastive Learning for Image-Text Retrieval
We introduce dynamic dictionaries for both modalities to enlarge the scale of image-text pairs, and diversity-sensitiveness is achieved by adaptive negative pair weighting.
Boosting Video-Text Retrieval with Explicit High-Level Semantics
Video-text retrieval (VTR) is an attractive yet challenging task for multi-modal understanding, which aims to search for relevant video (text) given a query (video).
Neural Color Operators for Sequential Image Retouching
The neural color operator mimics the behavior of traditional color operators and learns pixelwise color transformation while its strength is controlled by a scalar.
GMSS: Graph-Based Multi-Task Self-Supervised Learning for EEG Emotion Recognition
GMSS has the ability to learn more general representations by integrating multiple self-supervised tasks, including spatial and frequency jigsaw puzzle tasks, and contrastive learning tasks.
OSOP: A Multi-Stage One Shot Object Pose Estimation Framework
We present a novel one-shot method for object detection and 6 DoF pose estimation, that does not require training on target objects.
NeRF-Pose: A First-Reconstruct-Then-Regress Approach for Weakly-supervised 6D Object Pose Estimation
Pose estimation of 3D objects in monocular images is a fundamental and long-standing problem in computer vision.
Adversarial Dual-Student with Differentiable Spatial Warping for Semi-Supervised Semantic Segmentation
The perturbations for unlabeled data enable the consistency training loss, which benefits semi-supervised semantic segmentation.
Progressive Graph Convolution Network for EEG Emotion Recognition
Moreover, motivated by the observation of the relationship between coarse- and fine-grained emotions, we adopt a dual-head module that enables the PGCN to progressively learn more discriminative EEG features, from coarse-grained (easy) to fine-grained categories (difficult), referring to the hierarchical characteristic of emotion.
Predict, Prevent, and Evaluate: Disentangled Text-Driven Image Manipulation Empowered by Pre-Trained Vision-Language Model
We propose a novel framework, i. e., Predict, Prevent, and Evaluate (PPE), for disentangled text-driven image manipulation that requires little manual annotation while being applicable to a wide variety of manipulations.
CoFiNet: Reliable Coarse-to-fine Correspondences for Robust Point Cloud Registration
We study the problem of extracting correspondences between a pair of point clouds for registration.
Paint Transformer: Feed Forward Neural Painting with Stroke Prediction
Neural painting refers to the procedure of producing a series of strokes for a given image and non-photo-realistically recreating it using neural networks.
Ranked #1 on
Object Detection
on A2D
AdaAttN: Revisit Attention Mechanism in Arbitrary Neural Style Transfer
Finally, the content feature is normalized so that they demonstrate the same local feature statistics as the calculated per-point weighted style feature statistics.
Ranked #5 on
Style Transfer
on StyleBench
DOLG: Single-Stage Image Retrieval with Deep Orthogonal Fusion of Local and Global Features
Components orthogonal to the global image representation are then extracted from the local information.
CoFiNet: Reliable Coarse-to-fine Correspondences for Robust PointCloud Registration
We study the problem of extracting correspondences between a pair of point clouds for registration.
Image Inpainting by End-to-End Cascaded Refinement with Mask Awareness
Inpainting arbitrary missing regions is challenging because learning valid features for various masked regions is nontrivial.
Ranked #5 on
Image Inpainting
on CelebA-HQ
NTIRE 2021 Challenge on Quality Enhancement of Compressed Video: Methods and Results
This paper reviews the first NTIRE challenge on quality enhancement of compressed video, with a focus on the proposed methods and results.
Learning Semantic Person Image Generation by Region-Adaptive Normalization
In the first stage, we predict the target semantic parsing maps to eliminate the difficulties of pose transfer and further benefit the latter translation of per-region appearance style.
Drafting and Revision: Laplacian Pyramid Network for Fast High-Quality Artistic Style Transfer
Inspired by the common painting process of drawing a draft and revising the details, we introduce a novel feed-forward method named Laplacian Pyramid Network (LapStyle).
Beyond Self-Supervision: A Simple Yet Effective Network Distillation Alternative to Improve Backbones
Recently, research efforts have been concentrated on revealing how pre-trained model makes a difference in neural network performance.
Experimental study of decoherence of the two-mode squeezed vacuum state via second harmonic generation
Such a correlation is the most important characteristic of a two-mode squeezed state.
Optics Quantum Physics
MVFNet: Multi-View Fusion Network for Efficient Video Recognition
Existing state-of-the-art methods have achieved excellent accuracy regardless of the complexity meanwhile efficient spatiotemporal modeling solutions are slightly inferior in performance.
Ranked #34 on
Action Recognition
on Something-Something V1
A Novel Transferability Attention Neural Network Model for EEG Emotion Recognition
So it is necessary to give more attention to the EEG samples with strong transferability rather than forcefully training a classification model by all the samples.
NTIRE 2020 Challenge on Video Quality Mapping: Methods and Results
For track 2, some existing methods are evaluated, showing promising solutions to the weakly-supervised video quality mapping problem.
NTIRE 2020 Challenge on Perceptual Extreme Super-Resolution: Methods and Results
This paper reviews the NTIRE 2020 challenge on perceptual extreme super-resolution with focus on proposed solutions and results.
Multi-Label Classification with Label Graph Superimposing
In this paper, we propose a label graph superimposing framework to improve the conventional GCN+CNN framework developed for multi-label recognition in the following two aspects.
Ranked #30 on
Multi-Label Classification
on MS-COCO
TruNet: Short Videos Generation from Long Videos via Story-Preserving Truncation
In this work, we introduce a new problem, named as {\em story-preserving long video truncation}, that requires an algorithm to automatically truncate a long-duration video into multiple short and attractive sub-videos with each one containing an unbroken story.
Deep Concept-wise Temporal Convolutional Networks for Action Localization
In this paper, we empirically find that stacking more conventional temporal convolution layers actually deteriorates action classification performance, possibly ascribing to that all channels of 1D feature map, which generally are highly abstract and can be regarded as latent concepts, are excessively recombined in temporal convolution.
Read, Watch, and Move: Reinforcement Learning for Temporally Grounding Natural Language Descriptions in Videos
The task of video grounding, which temporally localizes a natural language description in a video, plays an important role in understanding videos.
StNet: Local and Global Spatial-Temporal Modeling for Action Recognition
In this paper, in contrast to the existing CNN+RNN or pure 3D convolution based approaches, we explore a novel spatial temporal network (StNet) architecture for both local and global spatial-temporal modeling in videos.
Exploiting Spatial-Temporal Modelling and Multi-Modal Fusion for Human Action Recognition
In this challenge, we propose spatial-temporal network (StNet) for better joint spatial-temporal modelling and comprehensively video understanding.
Revisiting the Effectiveness of Off-the-shelf Temporal Modeling Approaches for Large-scale Video Classification
Experiment results on the challenging Kinetics dataset demonstrate that our proposed temporal modeling approaches can significantly improve existing approaches in the large-scale video recognition tasks.
Ranked #169 on
Action Classification
on Kinetics-400
Temporal Modeling Approaches for Large-scale Youtube-8M Video Understanding
This paper describes our solution for the video recognition task of the Google Cloud and YouTube-8M Video Understanding Challenge that ranked the 3rd place.
Combinatorial Multi-Armed Bandit with General Reward Functions
Our framework enables a much larger class of reward functions such as the $\max()$ function and nonlinear utility functions.
