Search Results for author:
Found 113 papers, 54 papers with code
Learning Efficient Unsupervised Satellite Image-based Building Damage Detection
Existing Building Damage Detection (BDD) methods always require labour-intensive pixel-level annotations of buildings and their conditions, hence largely limiting their applications.
Text-Guided 3D Face Synthesis -- From Generation to Editing
In the editing stage, we first employ a pre-trained diffusion model to update facial geometry or texture based on the texts.
Functional Bayesian Tucker Decomposition for Continuous-indexed Tensor Data
To generalize Tucker decomposition to such scenarios, we propose Functional Bayesian Tucker Decomposition (FunBaT).
Text-to-3D with Classifier Score Distillation
In this paper, we re-evaluate the role of classifier-free guidance in score distillation and discover a surprising finding: the guidance alone is enough for effective text-to-3D generation tasks.
Towards Open World Active Learning for 3D Object Detection
To seek effective solutions, we investigate a more practical yet challenging research task: Open World Active Learning for 3D Object Detection (OWAL-3D), aiming at selecting a small number of 3D boxes to annotate while maximizing detection performance on both known and unknown classes.
CBARF: Cascaded Bundle-Adjusting Neural Radiance Fields from Imperfect Camera Poses
Existing volumetric neural rendering techniques, such as Neural Radiance Fields (NeRF), face limitations in synthesizing high-quality novel views when the camera poses of input images are imperfect.
Divide and Ensemble: Progressively Learning for the Unknown
In the wheat nutrient deficiencies classification challenge, we present the DividE and EnseMble (DEEM) method for progressive test data predictions.
DeformUX-Net: Exploring a 3D Foundation Backbone for Medical Image Segmentation with Depthwise Deformable Convolution
We hypothesize that deformable convolution can be an exploratory alternative to combine all advantages from the previous operators, providing long-range dependency, adaptive spatial aggregation and computational efficiency as a foundation backbone.
Multi-Resolution Active Learning of Fourier Neural Operators
Fourier Neural Operator (FNO) is a popular operator learning framework, which not only achieves the state-of-the-art performance in many tasks, but also is highly efficient in training and prediction.
Baichuan 2: Open Large-scale Language Models
Large language models (LLMs) have demonstrated remarkable performance on a variety of natural language tasks based on just a few examples of natural language instructions, reducing the need for extensive feature engineering.
Deep conditional generative models for longitudinal single-slice abdominal computed tomography harmonization
We further evaluate our method's capability to harmonize longitudinal positional variation on 1033 subjects from the Baltimore Longitudinal Study of Aging (BLSA) dataset, which contains longitudinal single abdominal slices, and confirmed that our method can harmonize the slice positional variance in terms of visceral fat area.
Enhancing Hierarchical Transformers for Whole Brain Segmentation with Intracranial Measurements Integration
Subsequently, the model is finetuned with 45 T1w 3D volumes from Open Access Series Imaging Studies (OASIS) where both 133 whole brain classes and TICV/PFV labels are available.
When 3D Bounding-Box Meets SAM: Point Cloud Instance Segmentation with Weak-and-Noisy Supervision
CIP-WPIS leverages pretrained knowledge embedded in the 2D foundation model SAM and 3D geometric prior to achieve accurate point-wise instance labels from the bounding box annotations.
EfficientDreamer: High-Fidelity and Robust 3D Creation via Orthogonal-view Diffusion Prior
Specifically, we introduce a novel 2D diffusion model that generates an image consisting of four orthogonal-view sub-images for the given text prompt.
Texture Generation on 3D Meshes with Point-UV Diffusion
In this work, we focus on synthesizing high-quality textures on 3D meshes.
BAVS: Bootstrapping Audio-Visual Segmentation by Integrating Foundation Knowledge
In a nutshell, our BAVS is designed to eliminate the interference of background noise or off-screen sounds in segmentation by establishing the audio-visual correspondences in an explicit manner.
Audio-Visual Segmentation by Exploring Cross-Modal Mutual Semantics
However, we observed that prior arts are prone to segment a certain salient object in a video regardless of the audio information.
ESP: Exploiting Symmetry Prior for Multi-Agent Reinforcement Learning
In addition, the proposed framework is model-agnostic and can be applied to most of the current MARL algorithms.
Boosting Model Inversion Attacks with Adversarial Examples
Hence, in this paper, we propose a new training paradigm for a learning-based model inversion attack that can achieve higher attack accuracy in a black-box setting.
Multi-Contrast Computed Tomography Atlas of Healthy Pancreas
Briefly, DEEDs affine and non-rigid registration are performed to transfer patient abdominal volumes to a fixed high-resolution atlas template.
EmotionGesture: Audio-Driven Diverse Emotional Co-Speech 3D Gesture Generation
In this work, we propose EmotionGesture, a novel framework for synthesizing vivid and diverse emotional co-speech 3D gestures from audio.
Autonomous Stabilization of Retinal Videos for Streamlining Assessment of Spontaneous Venous Pulsations
Both of the evaluations support its effectiveness in facilitating the observation of SVPs.
Hybrid Neural Rendering for Large-Scale Scenes with Motion Blur
Rendering novel view images is highly desirable for many applications.
TalkCLIP: Talking Head Generation with Text-Guided Expressive Speaking Styles
In this work, we propose an expression-controllable one-shot talking head method, dubbed TalkCLIP, where the expression in a speech is specified by the natural language.
2D Semantic Segmentation task 3 (25 classes)
Talking Head Generation
NeFII: Inverse Rendering for Reflectance Decomposition with Near-Field Indirect Illumination
Inverse rendering methods aim to estimate geometry, materials and illumination from multi-view RGB images.
DyGait: Exploiting Dynamic Representations for High-performance Gait Recognition
This is the first framework on gait recognition that is designed to focus on the extraction of dynamic features.
Low-frequency Image Deep Steganography: Manipulate the Frequency Distribution to Hide Secrets with Tenacious Robustness
By avoiding high-frequency artifacts and manipulating the frequency distribution of the embedded feature map, LIDS achieves improved robustness against attacks that distort the high-frequency components of container images.
Scaling Up 3D Kernels with Bayesian Frequency Re-parameterization for Medical Image Segmentation
We hypothesize that convolution with LK sizes is limited to maintain an optimal convergence for locality learning.
Diverse 3D Hand Gesture Prediction from Body Dynamics by Bilateral Hand Disentanglement
Considering the asymmetric gestures and motions of two hands, we introduce a Spatial-Residual Memory (SRM) module to model spatial interaction between the body and each hand by residual learning.
DMMG: Dual Min-Max Games for Self-Supervised Skeleton-Based Action Recognition
Our DMMG consists of a viewpoint variation min-max game and an edge perturbation min-max game.
Attacking Cooperative Multi-Agent Reinforcement Learning by Adversarial Minority Influence
To achieve maximum deviation in victim policies under complex agent-wise interactions, our unilateral attack aims to characterize and maximize the impact of the adversary on the victims.
Exploring Active 3D Object Detection from a Generalization Perspective
To alleviate the high annotation cost in LiDAR-based 3D object detection, active learning is a promising solution that learns to select only a small portion of unlabeled data to annotate, without compromising model performance.
Getting Away with More Network Pruning: From Sparsity to Geometry and Linear Regions
One surprising trait of neural networks is the extent to which their connections can be pruned with little to no effect on accuracy.
StyleTalk: One-shot Talking Head Generation with Controllable Speaking Styles
In a nutshell, we aim to attain a speaking style from an arbitrary reference speaking video and then drive the one-shot portrait to speak with the reference speaking style and another piece of audio.
Object-Goal Visual Navigation via Effective Exploration of Relations Among Historical Navigation States
In HiNL, we propose a History-aware State Estimation (HaSE) module to alleviate the impacts of dominant historical states on the current state estimation.
Image Inpainting via Iteratively Decoupled Probabilistic Modeling
To achieve high-quality results with low computational cost, we present a novel pixel spread model (PSM) that iteratively employs decoupled probabilistic modeling, combining the optimization efficiency of GANs with the prediction tractability of probabilistic models.
FlowFace: Semantic Flow-guided Shape-aware Face Swapping
Unlike most previous methods that focus on transferring the source inner facial features but neglect facial contours, our FlowFace can transfer both of them to a target face, thus leading to more realistic face swapping.
Single Slice Thigh CT Muscle Group Segmentation with Domain Adaptation and Self-Training
The proposed pipeline is effective and robust in extracting muscle groups on 2D single slice CT thigh images. The container is available for public use at https://github. com/MASILab/DA_CT_muscle_seg
Uncertainty-aware Gait Recognition via Learning from Dirichlet Distribution-based Evidence
Existing gait recognition frameworks retrieve an identity in the gallery based on the distance between a probe sample and the identities in the gallery.
Facial Action Units Detection Aided by Global-Local Expression Embedding
We find that AUs and facial expressions are highly associated, and existing facial expression datasets often contain a large number of identities.
Batch Multi-Fidelity Active Learning with Budget Constraints
However, this method only queries at one pair of fidelity and input at a time, and hence has a risk to bring in strongly correlated examples to reduce the learning efficiency.
Adaptive Contrastive Learning with Dynamic Correlation for Multi-Phase Organ Segmentation
We evaluate our proposed approach on multi-organ segmentation with both non-contrast CT (NCCT) datasets and the MICCAI 2015 BTCV Challenge contrast-enhance CT (CECT) datasets.
Is synthetic data from generative models ready for image recognition?
Recent text-to-image generation models have shown promising results in generating high-fidelity photo-realistic images.
Deep Idempotent Network for Efficient Single Image Blind Deblurring
Single image blind deblurring is highly ill-posed as neither the latent sharp image nor the blur kernel is known.
Meta Knowledge Condensation for Federated Learning
In this work, we first introduce a meta knowledge representation method that extracts meta knowledge from distributed clients.
Reducing Positional Variance in Cross-sectional Abdominal CT Slices with Deep Conditional Generative Models
External experiments on 20 subjects from the Baltimore Longitudinal Study of Aging (BLSA) dataset that contains longitudinal single abdominal slices validate that our method can harmonize the slice positional variance in terms of muscle and visceral fat area.
UNesT: Local Spatial Representation Learning with Hierarchical Transformer for Efficient Medical Segmentation
Transformer-based models, capable of learning better global dependencies, have recently demonstrated exceptional representation learning capabilities in computer vision and medical image analysis.
Longitudinal Variability Analysis on Low-dose Abdominal CT with Deep Learning-based Segmentation
Metabolic health is increasingly implicated as a risk factor across conditions from cardiology to neurology, and efficiency assessment of body composition is critical to quantitatively characterizing these relationships.
CVLNet: Cross-View Semantic Correspondence Learning for Video-based Camera Localization
The critical challenge of this task is to learn a powerful global feature descriptor for the sequential ground-view images while considering its domain alignment with reference satellite images.
Instance As Identity: A Generic Online Paradigm for Video Instance Segmentation
In this work, we propose a new online VIS paradigm named Instance As Identity (IAI), which models temporal information for both detection and tracking in an efficient way.
GaitGL: Learning Discriminative Global-Local Feature Representations for Gait Recognition
GFR extractor aims to extract contextual information, e. g., the relationship among various body parts, and the mask-based LFR extractor is presented to exploit the detailed posture changes of local regions.
Towards Efficient and Scale-Robust Ultra-High-Definition Image Demoireing
With the rapid development of mobile devices, modern widely-used mobile phones typically allow users to capture 4K resolution (i. e., ultra-high-definition) images.
Ranked #1 on
Image Restoration
on UHDM
MHR-Net: Multiple-Hypothesis Reconstruction of Non-Rigid Shapes from 2D Views
We propose MHR-Net, a novel method for recovering Non-Rigid Shapes from Motion (NRSfM).
"Understanding Robustness Lottery": A Geometric Visual Comparative Analysis of Neural Network Pruning Approaches
We decomposed and evaluated a set of critical geometric concepts from the common adopted classification loss, and used them to design a visualization system to compare and highlight the impact of pruning on model performance and feature representation.
Recall Distortion in Neural Network Pruning and the Undecayed Pruning Algorithm
In this work, we study such relative distortions in recall by hypothesizing an intensification effect that is inherent to the model.
PSTNet: Point Spatio-Temporal Convolution on Point Cloud Sequences
Then, a spatial convolution is employed to capture the local structure of points in the 3D space, and a temporal convolution is used to model the dynamics of the spatial regions along the time dimension.
Pseudo-Label Guided Multi-Contrast Generalization for Non-Contrast Organ-Aware Segmentation
In this paper, we propose a novel unsupervised approach that leverages pairwise contrast-enhanced CT (CECT) context to compute non-contrast segmentation without ground-truth label.
Video Demoireing with Relation-Based Temporal Consistency
Moire patterns, appearing as color distortions, severely degrade image and video qualities when filming a screen with digital cameras.
Accurate 3-DoF Camera Geo-Localization via Ground-to-Satellite Image Matching
We address the problem of ground-to-satellite image geo-localization, that is, estimating the camera latitude, longitude and orientation (azimuth angle) by matching a query image captured at the ground level against a large-scale database with geotagged satellite images.
The Combinatorial Brain Surgeon: Pruning Weights That Cancel One Another in Neural Networks
We propose a tractable heuristic for solving the combinatorial extension of OBS, in which we select weights for simultaneous removal, as well as a systematic update of the remaining weights.
Gait Recognition with Mask-based Regularization
Also, we design an Inception-like ReverseMask Block, which has three branches composed of a global branch, a feature dropping branch, and a feature scaling branch.
Ranked #2 on
Gait Recognition
on OUMVLP
GaitStrip: Gait Recognition via Effective Strip-based Feature Representations and Multi-Level Framework
ECM consists of the Spatial-Temporal feature extractor (ST), the Frame-Level feature extractor (FL) and SPB, and has two obvious advantages: First, each branch focuses on a specific representation, which can be used to improve the robustness of the network.
Characterizing Renal Structures with 3D Block Aggregate Transformers
Efficiently quantifying renal structures can provide distinct spatial context and facilitate biomarker discovery for kidney morphology.
Learning Implicit Body Representations from Double Diffusion Based Neural Radiance Fields
In this paper, we present a novel double diffusion based neural radiance field, dubbed DD-NeRF, to reconstruct human body geometry and render the human body appearance in novel views from a sparse set of images.
One-shot Talking Face Generation from Single-speaker Audio-Visual Correlation Learning
Hence, we propose a novel one-shot talking face generation framework by exploring consistent correlations between audio and visual motions from a specific speaker and then transferring audio-driven motion fields to a reference image.
Joint 3D Human Shape Recovery and Pose Estimation from a Single Image with Bilayer Graph
We use a coarse graph, derived from a dense graph, to estimate the human's 3D pose, and the dense graph to estimate the 3D shape.
Ranked #247 on
3D Human Pose Estimation
on Human3.6M
RGB-D Saliency Detection via Cascaded Mutual Information Minimization
In this paper, we introduce a novel multi-stage cascaded learning framework via mutual information minimization to "explicitly" model the multi-modal information between RGB image and depth data.
FDA: Feature Decomposition and Aggregation for Robust Airway Segmentation
Compared to other state-of-the-art transfer learning methods, our method accurately segmented more bronchi in the noisy CT scans.
PR-RRN: Pairwise-Regularized Residual-Recursive Networks for Non-rigid Structure-from-Motion
As NRSfM is a highly under-constrained problem, we propose two new pairwise regularization to further regularize the reconstruction.
Pro-UIGAN: Progressive Face Hallucination from Occluded Thumbnails
Specifically, we design a novel cross-modal transformer module for facial priors estimation, in which an input face and its landmark features are formulated as queries and keys, respectively.
Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motion
As this keypoint based representation models the motions of facial regions, head, and backgrounds integrally, our method can better constrain the spatial and temporal consistency of the generated videos.
Removing Raindrops and Rain Streaks in One Go
First, we propose a complementary cascaded network architecture, namely CCN, to remove rain streaks and raindrops in a unified framework.
Semantic-Aware Contrastive Learning for Multi-object Medical Image Segmentation
Medical image segmentation, or computing voxelwise semantic masks, is a fundamental yet challenging task to compute a voxel-level semantic mask.
VidFace: A Full-Transformer Solver for Video FaceHallucination with Unaligned Tiny Snapshots
In this paper, we investigate the task of hallucinating an authentic high-resolution (HR) human face from multiple low-resolution (LR) video snapshots.
VTNet: Visual Transformer Network for Object Goal Navigation
In this paper, we introduce a Visual Transformer Network (VTNet) for learning informative visual representation in navigation.
Write-a-speaker: Text-based Emotional and Rhythmic Talking-head Generation
To be specific, our framework consists of a speaker-independent stage and a speaker-specific stage.
DSC-PoseNet: Learning 6DoF Object Pose Estimation via Dual-scale Consistency
In the first step, the framework learns to segment objects from real and synthetic data in a weakly-supervised fashion, and the segmentation masks will act as a prior for pose estimation.
Self-Supervised Visibility Learning for Novel View Synthesis
We then warp and aggregate source view pixels to synthesize a novel view based on the estimated source-view visibility and target-view depth.
Super-Resolving Cross-Domain Face Miniatures by Peeking at One-Shot Exemplar
By iteratively updating the latent representations and our decoder, our DAP-FSR will be adapted to the target domain, thus achieving authentic and high-quality upsampled HR faces.
ARVo: Learning All-Range Volumetric Correspondence for Video Deblurring
Video deblurring models exploit consecutive frames to remove blurs from camera shakes and object motions.
Geometry-Guided Street-View Panorama Synthesis from Satellite Imagery
Specifically, we observe that when a 3D point in the real world is visible in both views, there is a deterministic mapping between the projected points in the two-view images given the height information of this 3D point.
Scaling Up Exact Neural Network Compression by ReLU Stability
We can compress a rectifier network while exactly preserving its underlying functionality with respect to a given input domain if some of its neurons are stable.
Modeling the Probabilistic Distribution of Unlabeled Data forOne-shot Medical Image Segmentation
Thus, it is more desirable to employ only a few labeled data in pursuing high segmentation performance.
Iterative Optimisation with an Innovation CNN for Pose Refinement
Object pose estimation from a single RGB image is a challenging problem due to variable lighting conditions and viewpoint changes.
RFNet: Region-Aware Fusion Network for Incomplete Multi-Modal Brain Tumor Segmentation
In this work, we propose a Region-aware Fusion Network (RFNet) that is able to exploit different combinations of multi-modal data adaptively and effectively for tumor segmentation.
Ranked #65 on
Semantic Segmentation
on NYU Depth v2
Uncertainty-Aware Deep Calibrated Salient Object Detection
Existing deep neural network based salient object detection (SOD) methods mainly focus on pursuing high network accuracy.
Gait Recognition via Effective Global-Local Feature Representation and Local Temporal Aggregation
Towards this goal, we take advantage of both global visual information and local region details and develop a Global and Local Feature Extractor (GLFE).
TSPNet: Hierarchical Feature Learning via Temporal Semantic Pyramid for Sign Language Translation
Sign language translation (SLT) aims to interpret sign video sequences into text-based natural language sentences.
Mapping of Sparse 3D Data using Alternating Projection
We propose a novel technique to register sparse 3D scans in the absence of texture.
Learning Object Relation Graph and Tentative Policy for Visual Navigation
Aiming to improve these two components, this paper proposes three complementary techniques, object relation graph (ORG), trial-driven imitation learning (IL), and a memory-augmented tentative policy network (TPN).
The IKEA ASM Dataset: Understanding People Assembling Furniture through Actions, Objects and Pose
The availability of a large labeled dataset is a key requirement for applying deep learning methods to solve various computer vision tasks.
Where am I looking at? Joint Location and Orientation Estimation by Cross-View Matching
Cross-view geo-localization is the problem of estimating the position and orientation (latitude, longitude and azimuth angle) of a camera at ground level given a large-scale database of geo-tagged aerial (e. g., satellite) images.
Weakly-Supervised Salient Object Detection via Scribble Annotations
In this paper, we propose a weakly-supervised salient object detection model to learn saliency from such annotations.
Transferring Cross-domain Knowledge for Video Sign Language Recognition
To this end, we extract news signs using a base WSLR model, and then design a classifier jointly trained on news and isolated signs to coarsely align these two domain features.
Copy and Paste GAN: Face Hallucination from Shaded Thumbnails
This paper proposes a Copy and Paste Generative Adversarial Network (CPGAN) to recover authentic high-resolution (HR) face images while compensating for low and non-uniform illumination.
6DoF Object Pose Estimation via Differentiable Proxy Voting Loss
In this paper, we aim to reduce such errors by incorporating the distances between pixels and keypoints into our objective.
Face Hallucination with Finishing Touches
The coarse-level FHnet generates a frontal coarse HR face and then the fine-level FHnet makes use of the facial component appearance prior, i. e., fine-grained facial components, to attain a frontal HR face image with authentic details.
Spatial-Aware Feature Aggregation for Image based Cross-View Geo-Localization
The first step is to apply a regular polar transform to warp an aerial image such that its domain is closer to that of a ground-view panorama.
Ranked #4 on
Image-Based Localization
on VIGOR Cross Area
Word-level Deep Sign Language Recognition from Video: A New Large-scale Dataset and Methods Comparison
Based on this new large-scale dataset, we are able to experiment with several deep learning methods for word-level sign recognition and evaluate their performances in large scale scenarios.
Ranked #3 on
Sign Language Recognition
on WLASL100
Optimal Feature Transport for Cross-View Image Geo-Localization
This paper proposes a novel Cross-View Feature Transport (CVFT) technique to explicitly establish cross-view domain transfer that facilitates feature alignment between ground and aerial images.
Can generalised relative pose estimation solve sparse 3D registration?
In contrast to correspondence based methods, we take a different viewpoint and formulate the sparse 3D registration problem based on the constraints from the intersection of line segments from adjacent scans.
SOSNet: Second Order Similarity Regularization for Local Descriptor Learning
Despite the fact that Second Order Similarity (SOS) has been used with significant success in tasks such as graph matching and clustering, it has not been exploited for learning local descriptors.
Identity-preserving Face Recovery from Stylized Portraits
We develop an Identity-preserving Face Recovery from Portraits (IFRP) method that utilizes a Style Removal network (SRN) and a Discriminative Network (DN).
Recovering Faces from Portraits with Auxiliary Facial Attributes
%Our method can recover high-quality photorealistic faces from unaligned portraits while preserving the identity of the face images as well as it can reconstruct a photorealistic face image with a desired set of attributes.
High Frame Rate Video Reconstruction based on an Event Camera
Based on the abundant event data alongside a low frame rate, easily blurred images, we propose a simple yet effective approach to reconstruct high-quality and high frame rate sharp videos.
Bringing a Blurry Frame Alive at High Frame-Rate with an Event Camera
In this paper, we propose a simple and effective approach, the \textbf{Event-based Double Integral (EDI)} model, to reconstruct a high frame-rate, sharp video from a single blurry frame and its event data.
Face Super-resolution Guided by Facial Component Heatmaps
State-of-the-art face super-resolution methods use deep convolutional neural networks to learn a mapping between low-resolution (LR) facial patterns and their corresponding high-resolution (HR) counterparts by exploring local information.
VLASE: Vehicle Localization by Aggregating Semantic Edges
In this paper, we propose VLASE, a framework to use semantic edge features from images to achieve on-road localization.
Super-Resolving Very Low-Resolution Face Images With Supplementary Attributes
An LR input contains low-frequency facial components of its HR version while its residual face image defined as the difference between the HR ground-truth and interpolated LR images contains the missing high-frequency facial details.
Learning Strict Identity Mappings in Deep Residual Networks
A family of super deep networks, referred to as residual networks or ResNet, achieved record-beating performance in various visual tasks such as image recognition, object detection, and semantic segmentation.
Face Destylization
To enforce the destylized faces to be similar to authentic face images, we employ a discriminative network, which consists of convolutional and fully connected layers.
Identity-preserving Face Recovery from Portraits
In this paper, we present a new Identity-preserving Face Recovery from Portraits (IFRP) to recover latent photorealistic faces from unaligned stylized portraits.
Hallucinating Very Low-Resolution Unaligned and Noisy Face Images by Transformative Discriminative Autoencoders
Then we use a transformative encoder network to project the intermediate HR faces to aligned and noise-free LR faces.
Ranked #7 on
Image Super-Resolution
on VggFace2 - 8x upscaling
