Search Results for author: Chi-Wing Fu

Found 81 papers, 48 papers with code

A Non-Local Low-Rank Framework for Ultrasound Speckle Reduction

no code implementations CVPR 2017 Lei Zhu, Chi-Wing Fu, Michael S. Brown, Pheng-Ann Heng

`Speckle' refers to the granular patterns that occur in ultrasound images due to wave interference.

H-DenseUNet: Hybrid Densely Connected UNet for Liver and Tumor Segmentation from CT Volumes

2 code implementations21 Sep 2017 Xiaomeng Li, Hao Chen, Xiaojuan Qi, Qi Dou, Chi-Wing Fu, Pheng Ann Heng

Our method outperformed other state-of-the-arts on the segmentation results of tumors and achieved very competitive performance for liver segmentation even with a single model.

 Ranked #1 on Liver Segmentation on LiTS2017 (Dice metric)

Automatic Liver And Tumor Segmentation Image Segmentation +4

Joint Bi-Layer Optimization for Single-Image Rain Streak Removal

no code implementations ICCV 2017 Lei Zhu, Chi-Wing Fu, Dani Lischinski, Pheng-Ann Heng

A third prior is defined on the rain-streak layer R, based on similarity of patches to the extracted rain patches.

Rain Removal

Direction-aware Spatial Context Features for Shadow Detection

2 code implementations CVPR 2018 Xiaowei Hu, Lei Zhu, Chi-Wing Fu, Jing Qin, Pheng-Ann Heng

To achieve this, we first formulate the direction-aware attention mechanism in a spatial recurrent neural network (RNN) by introducing attention weights when aggregating spatial context features in the RNN.

Detecting Shadows Shadow Detection

Direction-aware Spatial Context Features for Shadow Detection and Removal

2 code implementations12 May 2018 Xiaowei Hu, Chi-Wing Fu, Lei Zhu, Jing Qin, Pheng-Ann Heng

This paper presents a novel deep neural network design for shadow detection and removal by analyzing the spatial image context in a direction-aware manner.

Shadow Detection And Removal Shadow Removal

Deeply Supervised Rotation Equivariant Network for Lesion Segmentation in Dermoscopy Images

1 code implementation8 Jul 2018 Xiaomeng Li, Lequan Yu, Chi-Wing Fu, Pheng-Ann Heng

Our best model achieves 77. 23\%(JA) on the test dataset, outperforming the state-of-the-art challenging methods and further demonstrating the effectiveness of our proposed deeply supervised rotation equivariant segmentation network.

Lesion Segmentation Segmentation +1

EC-Net: an Edge-aware Point set Consolidation Network

no code implementations ECCV 2018 Lequan Yu, Xianzhi Li, Chi-Wing Fu, Daniel Cohen-Or, Pheng-Ann Heng

In this paper, we present the first deep learning based edge-aware technique to facilitate the consolidation of point clouds.

Surface Reconstruction

Semi-supervised Skin Lesion Segmentation via Transformation Consistent Self-ensembling Model

no code implementations12 Aug 2018 Xiaomeng Li, Lequan Yu, Hao Chen, Chi-Wing Fu, Pheng-Ann Heng

In this paper, we present a novel semi-supervised method for skin lesion segmentation, where the network is optimized by the weighted combination of a common supervised loss for labeled inputs only and a regularization loss for both labeled and unlabeled data.

Lesion Segmentation Segmentation +1

Bidirectional Feature Pyramid Network with Recurrent Attention Residual Modules for Shadow Detection

1 code implementation ECCV 2018 Lei Zhu, Zijun Deng, Xiao-Wei Hu, Chi-Wing Fu, Xuemiao Xu, Jing Qin, Pheng-Ann Heng

Second, we develop a bidirectional feature pyramid network (BFPN) to aggregate shadow contexts spanned across different CNN layers by deploying two series of RAR modules in the network to iteratively combine and refine context features: one series to refine context features from deep to shallow layers, and another series from shallow to deep layers.

Shadow Detection

The Liver Tumor Segmentation Benchmark (LiTS)

6 code implementations13 Jan 2019 Patrick Bilic, Patrick Christ, Hongwei Bran Li, Eugene Vorontsov, Avi Ben-Cohen, Georgios Kaissis, Adi Szeskin, Colin Jacobs, Gabriel Efrain Humpire Mamani, Gabriel Chartrand, Fabian Lohöfer, Julian Walter Holch, Wieland Sommer, Felix Hofmann, Alexandre Hostettler, Naama Lev-Cohain, Michal Drozdzal, Michal Marianne Amitai, Refael Vivantik, Jacob Sosna, Ivan Ezhov, Anjany Sekuboyina, Fernando Navarro, Florian Kofler, Johannes C. Paetzold, Suprosanna Shit, Xiaobin Hu, Jana Lipková, Markus Rempfler, Marie Piraud, Jan Kirschke, Benedikt Wiestler, Zhiheng Zhang, Christian Hülsemeyer, Marcel Beetz, Florian Ettlinger, Michela Antonelli, Woong Bae, Míriam Bellver, Lei Bi, Hao Chen, Grzegorz Chlebus, Erik B. Dam, Qi Dou, Chi-Wing Fu, Bogdan Georgescu, Xavier Giró-i-Nieto, Felix Gruen, Xu Han, Pheng-Ann Heng, Jürgen Hesser, Jan Hendrik Moltz, Christian Igel, Fabian Isensee, Paul Jäger, Fucang Jia, Krishna Chaitanya Kaluva, Mahendra Khened, Ildoo Kim, Jae-Hun Kim, Sungwoong Kim, Simon Kohl, Tomasz Konopczynski, Avinash Kori, Ganapathy Krishnamurthi, Fan Li, Hongchao Li, Junbo Li, Xiaomeng Li, John Lowengrub, Jun Ma, Klaus Maier-Hein, Kevis-Kokitsi Maninis, Hans Meine, Dorit Merhof, Akshay Pai, Mathias Perslev, Jens Petersen, Jordi Pont-Tuset, Jin Qi, Xiaojuan Qi, Oliver Rippel, Karsten Roth, Ignacio Sarasua, Andrea Schenk, Zengming Shen, Jordi Torres, Christian Wachinger, Chunliang Wang, Leon Weninger, Jianrong Wu, Daguang Xu, Xiaoping Yang, Simon Chun-Ho Yu, Yading Yuan, Miao Yu, Liping Zhang, Jorge Cardoso, Spyridon Bakas, Rickmer Braren, Volker Heinemann, Christopher Pal, An Tang, Samuel Kadoury, Luc Soler, Bram van Ginneken, Hayit Greenspan, Leo Joskowicz, Bjoern Menze

In this work, we report the set-up and results of the Liver Tumor Segmentation Benchmark (LiTS), which was organized in conjunction with the IEEE International Symposium on Biomedical Imaging (ISBI) 2017 and the International Conferences on Medical Image Computing and Computer-Assisted Intervention (MICCAI) 2017 and 2018.

Benchmarking Computed Tomography (CT) +3

Patch-based Output Space Adversarial Learning for Joint Optic Disc and Cup Segmentation

no code implementations20 Feb 2019 Shujun Wang, Lequan Yu, Xin Yang, Chi-Wing Fu, Pheng-Ann Heng

In this paper, we present a novel patchbased Output Space Adversarial Learning framework (pOSAL) to jointly and robustly segment the OD and OC from different fundus image datasets.

Segmentation Unsupervised Domain Adaptation

Transformation Consistent Self-ensembling Model for Semi-supervised Medical Image Segmentation

no code implementations28 Feb 2019 Xiaomeng Li, Lequan Yu, Hao Chen, Chi-Wing Fu, Lei Xing, Pheng-Ann Heng

In this paper, we present a novel semi-supervised method for medical image segmentation, where the network is optimized by the weighted combination of a common supervised loss for labeled inputs only and a regularization loss for both labeled and unlabeled data.

Image Segmentation Lesion Segmentation +6

SAC-Net: Spatial Attenuation Context for Salient Object Detection

no code implementations25 Mar 2019 Xiaowei Hu, Chi-Wing Fu, Lei Zhu, Tianyu Wang, Pheng-Ann Heng

This paper presents a new deep neural network design for salient object detection by maximizing the integration of local and global image context within, around, and beyond the salient objects.

Object object-detection +2

Mask-ShadowGAN: Learning to Remove Shadows from Unpaired Data

5 code implementations ICCV 2019 Xiaowei Hu, Yitong Jiang, Chi-Wing Fu, Pheng-Ann Heng

This paper presents a new method for shadow removal using unpaired data, enabling us to avoid tedious annotations and obtain more diverse training samples.

Shadow Removal

Boundary and Entropy-driven Adversarial Learning for Fundus Image Segmentation

1 code implementation26 Jun 2019 Shujun Wang, Lequan Yu, Kang Li, Xin Yang, Chi-Wing Fu, Pheng-Ann Heng

The cross-domain discrepancy (domain shift) hinders the generalization of deep neural networks to work on different domain datasets. In this work, we present an unsupervised domain adaptation framework, called Boundary and Entropy-driven Adversarial Learning (BEAL), to improve the OD and OC segmentation performance, especially on the ambiguous boundary regions.

Image Segmentation Segmentation +2

Difficulty-aware Meta-learning for Rare Disease Diagnosis

no code implementations30 Jun 2019 Xiaomeng Li, Lequan Yu, Yueming Jin, Chi-Wing Fu, Lei Xing, Pheng-Ann Heng

Rare diseases have extremely low-data regimes, unlike common diseases with large amount of available labeled data.

General Classification Lesion Classification +2

Revisiting Metric Learning for Few-Shot Image Classification

no code implementations6 Jul 2019 Xiaomeng Li, Lequan Yu, Chi-Wing Fu, Meng Fang, Pheng-Ann Heng

However, the importance of feature embedding, i. e., exploring the relationship among training samples, is neglected.

Classification Few-Shot Image Classification +4

Multi-Task Recurrent Convolutional Network with Correlation Loss for Surgical Video Analysis

1 code implementation13 Jul 2019 Yueming Jin, Huaxia Li, Qi Dou, Hao Chen, Jing Qin, Chi-Wing Fu, Pheng-Ann Heng

Mutually leveraging both low-level feature sharing and high-level prediction correlating, our MTRCNet-CL method can encourage the interactions between the two tasks to a large extent, and hence can bring about benefits to each other.

Surgical phase recognition Surgical tool detection

Uncertainty-aware Self-ensembling Model for Semi-supervised 3D Left Atrium Segmentation

8 code implementations16 Jul 2019 Lequan Yu, Shujun Wang, Xiaomeng Li, Chi-Wing Fu, Pheng-Ann Heng

We design a novel uncertainty-aware scheme to enable the student model to gradually learn from the meaningful and reliable targets by exploiting the uncertainty information.

Image Segmentation Left Atrium Segmentation +3

LassoNet: Deep Lasso-Selection of 3D Point Clouds

no code implementations31 Jul 2019 Zhutian Chen, Wei Zeng, Zhiguang Yang, Lingyun Yu, Chi-Wing Fu, Huamin Qu

A hierarchical network is trained using a dataset with over 30K lasso-selection records on two different point cloud data.

Human-Computer Interaction Graphics

Deep Floor Plan Recognition Using a Multi-Task Network with Room-Boundary-Guided Attention

3 code implementations ICCV 2019 Zhiliang Zeng, Xianzhi Li, Ying Kin Yu, Chi-Wing Fu

Besides walls and rooms, we aim to recognize diverse floor plan elements, such as doors, windows and different types of rooms, in the floor layouts.

Hierarchical Point-Edge Interaction Network for Point Cloud Semantic Segmentation

no code implementations ICCV 2019 Li Jiang, Hengshuang Zhao, Shu Liu, Xiaoyong Shen, Chi-Wing Fu, Jiaya Jia

To incorporate point features in the edge branch, we establish a hierarchical graph framework, where the graph is initialized from a coarse layer and gradually enriched along the point decoding process.

Scene Labeling Semantic Segmentation

CANet: Cross-disease Attention Network for Joint Diabetic Retinopathy and Diabetic Macular Edema Grading

1 code implementation4 Nov 2019 Xiaomeng Li, Xiao-Wei Hu, Lequan Yu, Lei Zhu, Chi-Wing Fu, Pheng-Ann Heng

In this paper, we present a novel cross-disease attention network (CANet) to jointly grade DR and DME by exploring the internal relationship between the diseases with only image-level supervision.

Instance Shadow Detection

3 code implementations CVPR 2020 Tianyu Wang, Xiao-Wei Hu, Qiong Wang, Pheng-Ann Heng, Chi-Wing Fu

Then, we pair up the predicted shadow and object instances, and match them with the predicted shadow-object associations to generate the final results.

Instance Shadow Detection Object +1

Revisiting Shadow Detection: A New Benchmark Dataset for Complex World

2 code implementations16 Nov 2019 Xiaowei Hu, Tianyu Wang, Chi-Wing Fu, Yitong Jiang, Qiong Wang, Pheng-Ann Heng

Shadow detection in general photos is a nontrivial problem, due to the complexity of the real world.

Shadow Detection

PointAugment: an Auto-Augmentation Framework for Point Cloud Classification

1 code implementation CVPR 2020 Ruihui Li, Xianzhi Li, Pheng-Ann Heng, Chi-Wing Fu

We present PointAugment, a new auto-augmentation framework that automatically optimizes and augments point cloud samples to enrich the data diversity when we train a classification network.

3D Point Cloud Data Augmentation Classification +3

Non-Local Part-Aware Point Cloud Denoising

no code implementations14 Mar 2020 Chao Huang, Ruihui Li, Xianzhi Li, Chi-Wing Fu

This paper presents a novel non-local part-aware deep neural network to denoise point clouds by exploring the inherent non-local self-similarity in 3D objects and scenes.

Denoising Graph Attention +1

A Rotation-Invariant Framework for Deep Point Cloud Analysis

1 code implementation16 Mar 2020 Xianzhi Li, Ruihui Li, Guangyong Chen, Chi-Wing Fu, Daniel Cohen-Or, Pheng-Ann Heng

Recently, many deep neural networks were designed to process 3D point clouds, but a common drawback is that rotation invariance is not ensured, leading to poor generalization to arbitrary orientations.

Point Cloud Generation Retrieval

TilinGNN: Learning to Tile with Self-Supervised Graph Neural Network

1 code implementation5 Jul 2020 Hao Xu, Ka Hei Hui, Chi-Wing Fu, Hao Zhang

To start, we reformulate tiling as a graph problem by modeling candidate tile locations in the target shape as graph nodes and connectivity between tile locations as edges.

Learning from Extrinsic and Intrinsic Supervisions for Domain Generalization

no code implementations ECCV 2020 Shujun Wang, Lequan Yu, Caizi Li, Chi-Wing Fu, Pheng-Ann Heng

To this end, we present a new domain generalization framework that learns how to generalize across domains simultaneously from extrinsic relationship supervision and intrinsic self-supervision for images from multi-source domains.

Anomaly Detection Domain Generalization +3

Mononizing Binocular Videos

1 code implementation3 Sep 2020 Wenbo Hu, Menghan Xia, Chi-Wing Fu, Tien-Tsin Wong

This paper presents the idea ofmono-nizingbinocular videos and a frame-work to effectively realize it.

Image and Video Processing Graphics

DoFE: Domain-oriented Feature Embedding for Generalizable Fundus Image Segmentation on Unseen Datasets

1 code implementation13 Oct 2020 Shujun Wang, Lequan Yu, Kang Li, Xin Yang, Chi-Wing Fu, Pheng-Ann Heng

Our DoFE framework dynamically enriches the image features with additional domain prior knowledge learned from multi-source domains to make the semantic features more discriminative.

Domain Generalization Image Segmentation +2

CIA-SSD: Confident IoU-Aware Single-Stage Object Detector From Point Cloud

1 code implementation5 Dec 2020 Wu Zheng, Weiliang Tang, Sijin Chen, Li Jiang, Chi-Wing Fu

Existing single-stage detectors for locating objects in point clouds often treat object localization and category classification as separate tasks, so the localization accuracy and classification confidence may not well align.

3D Object Detection Birds Eye View Object Detection +3

On Learning the Right Attention Point for Feature Enhancement

no code implementations11 Dec 2020 Liqiang Lin, Pengdi Huang, Chi-Wing Fu, Kai Xu, Hao Zhang, Hui Huang

We present a novel attention-based mechanism to learn enhanced point features for point cloud processing tasks, e. g., classification and segmentation.

Classification Point Cloud Classification +1

3D-to-2D Distillation for Indoor Scene Parsing

1 code implementation CVPR 2021 Zhengzhe Liu, Xiaojuan Qi, Chi-Wing Fu

First, we distill 3D knowledge from a pretrained 3D network to supervise a 2D network to learn simulated 3D features from 2D features during the training, so the 2D network can infer without requiring 3D data.

Scene Parsing Semantic Parsing +1

One Thing One Click: A Self-Training Approach for Weakly Supervised 3D Semantic Segmentation

2 code implementations CVPR 2021 Zhengzhe Liu, Xiaojuan Qi, Chi-Wing Fu

Point cloud semantic segmentation often requires largescale annotated training data, but clearly, point-wise labels are too tedious to prepare.

3D Semantic Segmentation Relation Network +1

SE-SSD: Self-Ensembling Single-Stage Object Detector From Point Cloud

1 code implementation CVPR 2021 Wu Zheng, Weiliang Tang, Li Jiang, Chi-Wing Fu

Lastly, to better exploit hard targets, we design an ODIoU loss to supervise the student with constraints on the predicted box centers and orientations.

3D Object Detection Birds Eye View Object Detection +2

FloorLevel-Net: Recognizing Floor-Level Lines with Height-Attention-Guided Multi-task Learning

no code implementations6 Jul 2021 Mengyang Wu, Wei Zeng, Chi-Wing Fu

The ability to recognize the position and order of the floor-level lines that divide adjacent building floors can benefit many applications, for example, urban augmented reality (AR).

Data Augmentation Multi-Task Learning

Accurate Grid Keypoint Learning for Efficient Video Prediction

1 code implementation28 Jul 2021 Xiaojie Gao, Yueming Jin, Qi Dou, Chi-Wing Fu, Pheng-Ann Heng

Video prediction methods generally consume substantial computing resources in training and deployment, among which keypoint-based approaches show promising improvement in efficiency by simplifying dense image prediction to light keypoint prediction.

Video Prediction

SP-GAN: Sphere-Guided 3D Shape Generation and Manipulation

1 code implementation10 Aug 2021 Ruihui Li, Xianzhi Li, Ka-Hei Hui, Chi-Wing Fu

We present SP-GAN, a new unsupervised sphere-guided generative model for direct synthesis of 3D shapes in the form of point clouds.

3D Shape Generation

Towards Accurate Alignment in Real-time 3D Hand-Mesh Reconstruction

no code implementations ICCV 2021 Xiao Tang, Tianyu Wang, Chi-Wing Fu

3D hand-mesh reconstruction from RGB images facilitates many applications, including augmented reality (AR).

Guided Point Contrastive Learning for Semi-supervised Point Cloud Semantic Segmentation

1 code implementation ICCV 2021 Li Jiang, Shaoshuai Shi, Zhuotao Tian, Xin Lai, Shu Liu, Chi-Wing Fu, Jiaya Jia

To address the high cost and challenges of 3D point-level labeling, we present a method for semi-supervised point cloud semantic segmentation to adopt unlabeled point clouds in training to boost the model performance.

3D Semantic Segmentation Contrastive Learning +1

SNR-Aware Low-Light Image Enhancement

1 code implementation CVPR 2022 Xiaogang Xu, RuiXing Wang, Chi-Wing Fu, Jiaya Jia

They are long-range operations for image regions of extremely low Signal-to-Noise-Ratio (SNR) and short-range operations for other regions.

Low-Light Image Enhancement

Point Set Self-Embedding

1 code implementation28 Feb 2022 Ruihui Li, Xianzhi Li, Tien-Tsin Wong, Chi-Wing Fu

To achieve a learnable self-embedding scheme, we design a novel framework with two jointly-trained networks: one to encode the input point set into its self-embedded sparse point set and the other to leverage the embedded information for inverting the original point set back.

Neural Template: Topology-aware Reconstruction and Disentangled Generation of 3D Meshes

1 code implementation CVPR 2022 Ka-Hei Hui, Ruihui Li, Jingyu Hu, Chi-Wing Fu

This paper introduces a novel framework called DTNet for 3D mesh reconstruction and generation via Disentangled Topology.

Semi-signed prioritized neural fitting for surface reconstruction from unoriented point clouds

no code implementations14 Jun 2022 Runsong Zhu, Di Kang, Ka-Hei Hui, Yue Qian, Xuefei Zhe, Zhen Dong, Linchao Bao, Pheng-Ann Heng, Chi-Wing Fu

To guide the network quickly fit the coarse shape, we propose to utilize the signed supervision in regions that are obviously outside the object and can be easily determined, resulting in our semi-signed supervision.

Surface Reconstruction

Boosting 3D Object Detection by Simulating Multimodality on Point Clouds

no code implementations CVPR 2022 Wu Zheng, Mingxuan Hong, Li Jiang, Chi-Wing Fu

This paper presents a new approach to boost a single-modality (LiDAR) 3D object detector by teaching it to simulate features and responses that follow a multi-modality (LiDAR-image) detector.

3D Object Detection object-detection

Boosting Single-Frame 3D Object Detection by Simulating Multi-Frame Point Clouds

no code implementations3 Jul 2022 Wu Zheng, Li Jiang, Fanbin Lu, Yangyang Ye, Chi-Wing Fu

To boost a detector for single-frame 3D object detection, we present a new approach to train it to simulate features and responses following a detector trained on multi-frame point clouds.

3D Object Detection Object +2

Deep Parametric 3D Filters for Joint Video Denoising and Illumination Enhancement in Video Super Resolution

1 code implementation5 Jul 2022 Xiaogang Xu, RuiXing Wang, Chi-Wing Fu, Jiaya Jia

Despite the quality improvement brought by the recent methods, video super-resolution (SR) is still very challenging, especially for videos that are low-light and noisy.

Denoising Video Denoising +1

Instance Shadow Detection with A Single-Stage Detector

2 code implementations11 Jul 2022 Tianyu Wang, Xiaowei Hu, Pheng-Ann Heng, Chi-Wing Fu

This paper formulates a new problem, instance shadow detection, which aims to detect shadow instance and the associated object instance that cast each shadow in the input image.

Instance Shadow Detection Object +2

ISS: Image as Stepping Stone for Text-Guided 3D Shape Generation

2 code implementations9 Sep 2022 Zhengzhe Liu, Peng Dai, Ruihui Li, Xiaojuan Qi, Chi-Wing Fu

Text-guided 3D shape generation remains challenging due to the absence of large paired text-shape data, the substantial semantic gap between these two modalities, and the structural complexity of 3D shapes.

3D Shape Generation

Neural Wavelet-domain Diffusion for 3D Shape Generation

1 code implementation19 Sep 2022 Ka-Hei Hui, Ruihui Li, Jingyu Hu, Chi-Wing Fu

This paper presents a new approach for 3D shape generation, enabling direct generative modeling on a continuous implicit representation in wavelet domain.

3D Generation 3D Shape Generation

Learning Reconstructability for Drone Aerial Path Planning

no code implementations21 Sep 2022 Yilin Liu, Liqiang Lin, Yue Hu, Ke Xie, Chi-Wing Fu, Hao Zhang, Hui Huang

To reconstruct a new urban scene, we first build the 3D scene proxy, then rely on the predicted reconstruction quality and uncertainty measures by our network, based off of the proxy geometry, to guide the drone path planning.

3D Scene Reconstruction

Sparse2Dense: Learning to Densify 3D Features for 3D Object Detection

1 code implementation23 Nov 2022 Tianyu Wang, Xiaowei Hu, Zhengzhe Liu, Chi-Wing Fu

Importantly, we formulate the lightweight plug-in S2D module and the point cloud reconstruction module in SDet to densify 3D features and train SDet to produce 3D features, following the dense 3D features in DDet.

3D Object Detection Domain Adaptation +2

Video Instance Shadow Detection

no code implementations23 Nov 2022 Zhenghao Xing, Tianyu Wang, Xiaowei Hu, Haoran Wu, Chi-Wing Fu, Pheng-Ann Heng

First, we design SSIS-Track, a new framework to extract shadow-object associations in videos with paired tracking and without category specification; especially, we strive to maintain paired tracking even the objects/shadows are temporarily occluded for several frames.

Instance Shadow Detection Shadow Detection

Removing Anomalies as Noises for Industrial Defect Localization

no code implementations ICCV 2023 Fanbin Lu, Xufeng Yao, Chi-Wing Fu, Jiaya Jia

Our denoising model outperforms the state-of-the-art reconstruction-based anomaly detection methods for precise anomaly localization and high-quality normal image reconstruction on the MVTec-AD benchmark.

Denoising Image Reconstruction +1

H2ONet: Hand-Occlusion-and-Orientation-Aware Network for Real-Time 3D Hand Mesh Reconstruction

no code implementations CVPR 2023 Hao Xu, Tianyu Wang, Xiao Tang, Chi-Wing Fu

First, we decouple hand mesh reconstruction into two branches, one to exploit finger-level non-occluded information and the other to exploit global hand orientation, with lightweight structures to promote real-time inference.

3D Hand Pose Estimation

Command-Driven Articulated Object Understanding and Manipulation

no code implementations CVPR 2023 Ruihang Chu, Zhengzhe Liu, Xiaoqing Ye, Xiao Tan, Xiaojuan Qi, Chi-Wing Fu, Jiaya Jia

The key of Cart is to utilize the prediction of object structures to connect visual observations with user commands for effective manipulations.

motion prediction Object +1

Neural Wavelet-domain Diffusion for 3D Shape Generation, Inversion, and Manipulation

no code implementations1 Feb 2023 Jingyu Hu, Ka-Hei Hui, Zhengzhe Liu, Ruihui Li, Chi-Wing Fu

This paper presents a new approach for 3D shape generation, inversion, and manipulation, through a direct generative modeling on a continuous implicit representation in wavelet domain.

3D Shape Generation

DreamStone: Image as Stepping Stone for Text-Guided 3D Shape Generation

2 code implementations24 Mar 2023 Zhengzhe Liu, Peng Dai, Ruihui Li, Xiaojuan Qi, Chi-Wing Fu

The core of our approach is a two-stage feature-space alignment strategy that leverages a pre-trained single-view reconstruction (SVR) model to map CLIP features to shapes: to begin with, map the CLIP image feature to the detail-rich 3D shape space of the SVR model, then map the CLIP text feature to the 3D shape space through encouraging the CLIP-consistency between rendered images and the input text.

3D Shape Generation

You Only Need One Thing One Click: Self-Training for Weakly Supervised 3D Scene Understanding

1 code implementation26 Mar 2023 Zhengzhe Liu, Xiaojuan Qi, Chi-Wing Fu

3D scene understanding, e. g., point cloud semantic and instance segmentation, often requires large-scale annotated training data, but clearly, point-wise labels are too tedious to prepare.

3D Instance Segmentation Pseudo Label +4

CLIPXPlore: Coupled CLIP and Shape Spaces for 3D Shape Exploration

no code implementations14 Jun 2023 Jingyu Hu, Ka-Hei Hui, Zhengzhe Liu, Hao Zhang, Chi-Wing Fu

This paper presents CLIPXPlore, a new framework that leverages a vision-language model to guide the exploration of the 3D shape space.

Attribute Language Modelling

SILT: Shadow-aware Iterative Label Tuning for Learning to Detect Shadows from Noisy Labels

1 code implementation ICCV 2023 Han Yang, Tianyu Wang, Xiaowei Hu, Chi-Wing Fu

Existing shadow detection datasets often contain missing or mislabeled shadows, which can hinder the performance of deep learning models trained directly on such data.

Shadow Detection

Make-A-Shape: a Ten-Million-scale 3D Shape Model

no code implementations20 Jan 2024 Ka-Hei Hui, Aditya Sanghi, Arianna Rampini, Kamal Rahimi Malekshan, Zhengzhe Liu, Hooman Shayani, Chi-Wing Fu

We then make the representation generatable by a diffusion model by devising the subband coefficients packing scheme to layout the representation in a low-resolution grid.

SiMA-Hand: Boosting 3D Hand-Mesh Reconstruction by Single-to-Multi-View Adaptation

1 code implementation2 Feb 2024 Yinqiao Wang, Hao Xu, Pheng-Ann Heng, Chi-Wing Fu

Estimating 3D hand mesh from RGB images is a longstanding track, in which occlusion is one of the most challenging problems.

CNS-Edit: 3D Shape Editing via Coupled Neural Shape Optimization

no code implementations4 Feb 2024 Jingyu Hu, Ka-Hei Hui, Zhengzhe Liu, Hao Zhang, Chi-Wing Fu

First, we design the coupled neural shape (CNS) representation for supporting 3D shape editing.

HandBooster: Boosting 3D Hand-Mesh Reconstruction by Conditional Synthesis and Sampling of Hand-Object Interactions

1 code implementation27 Mar 2024 Hao Xu, Haipeng Li, Yinqiao Wang, Shuaicheng Liu, Chi-Wing Fu

Reconstructing 3D hand mesh robustly from a single image is very challenging, due to the lack of diversity in existing real-world datasets.

Cannot find the paper you are looking for? You can Submit a new open access paper.