Search Results for author: Hongbo Fu

Found 41 papers, 16 papers with code

Sketch2Human: Deep Human Generation with Disentangled Geometry and Appearance Control

no code implementations24 Apr 2024 Linzi Qu, Jiaxiang Shang, Hui Ye, Xiaoguang Han, Hongbo Fu

This work presents Sketch2Human, the first system for controllable full-body human image generation guided by a semantic sketch (for geometry control) and a reference image (for appearance control).

Face Generation

CustomSketching: Sketch Concept Extraction for Sketch-based Image Synthesis and Editing

no code implementations27 Feb 2024 Chufeng Xiao, Hongbo Fu

Considering that an object can often be depicted by a contour for general shapes and additional strokes for internal details, we introduce a dual-sketch representation to reduce the inherent ambiguity in sketch depiction.

Image Generation

Mesh-based Gaussian Splatting for Real-time Large-scale Deformation

no code implementations7 Feb 2024 Lin Gao, Jie Yang, Bo-Tao Zhang, Jia-Mu Sun, Yu-Jie Yuan, Hongbo Fu, Yu-Kun Lai

Based on this representation, we further introduce a large-scale Gaussian deformation technique to enable deformable GS, which alters the parameters of 3D Gaussians according to the manipulation of the associated mesh.

StyleRetoucher: Generalized Portrait Image Retouching with GAN Priors

no code implementations22 Dec 2023 Wanchao Su, Can Wang, Chen Liu, Hangzhou Han, Hongbo Fu, Jing Liao

To address such issues, we present StyleRetoucher, a novel automatic portrait image retouching framework, leveraging StyleGAN's generation and generalization ability to improve an input portrait image's skin condition while preserving its facial details.

feature selection Image Retouching

3DPortraitGAN: Learning One-Quarter Headshot 3D GANs from a Single-View Portrait Dataset with Diverse Body Poses

no code implementations27 Jul 2023 Yiqian Wu, Hao Xu, Xiangjun Tang, Hongbo Fu, Xiaogang Jin

We then propose 3DPortraitGAN, the first 3D-aware one-quarter headshot portrait generator that learns a canonical 3D avatar distribution from the 360{\deg}PHQ dataset with body pose self-learning.

Self-Learning

SketchMetaFace: A Learning-based Sketching Interface for High-fidelity 3D Character Face Modeling

no code implementations3 Jul 2023 Zhongjin Luo, Dong Du, Heming Zhu, Yizhou Yu, Hongbo Fu, Xiaoguang Han

User studies demonstrate the superiority of our system over existing modeling tools in terms of the ease to use and visual quality of results.

Sketch2Stress: Sketching with Structural Stress Awareness

no code implementations9 Jun 2023 Deng Yu, Chufeng Xiao, Manfred Lau, Hongbo Fu

However, such a step is usually invisible or inaccessible to designers at the early sketching phase.

Sketch Beautification: Learning Part Beautification and Structure Refinement for Sketches of Man-made Objects

no code implementations9 Jun 2023 Deng Yu, Manfred Lau, Lin Gao, Hongbo Fu

With this strategy, our method can go beyond the training samples and handle novel freehand sketches.

LPFF: A Portrait Dataset for Face Generators Across Large Poses

no code implementations ICCV 2023 Yiqian Wu, Jing Zhang, Hongbo Fu, Xiaogang Jin

To better validate our pose-conditional 3D-aware generators, we develop a new FID measure to evaluate the 3D-level performance.

3D Reconstruction

LiDAL: Inter-frame Uncertainty Based Active Learning for 3D LiDAR Semantic Segmentation

1 code implementation11 Nov 2022 Zeyu Hu, Xuyang Bai, Runze Zhang, Xin Wang, Guangyuan Sun, Hongbo Fu, Chiew-Lan Tai

We propose LiDAL, a novel active learning method for 3D LiDAR semantic segmentation by exploiting inter-frame uncertainty among LiDAR frames.

Active Learning LIDAR Semantic Segmentation +1

MonoNeuralFusion: Online Monocular Neural 3D Reconstruction with Geometric Priors

no code implementations30 Sep 2022 Zi-Xin Zou, Shi-Sheng Huang, Yan-Pei Cao, Tai-Jiang Mu, Ying Shan, Hongbo Fu

This paper introduces a novel neural implicit scene representation with volume rendering for high-fidelity online 3D scene reconstruction from monocular videos.

3D Reconstruction 3D Scene Reconstruction

DifferSketching: How Differently Do People Sketch 3D Objects?

1 code implementation19 Sep 2022 Chufeng Xiao, Wanchao Su, Jing Liao, Zhouhui Lian, Yi-Zhe Song, Hongbo Fu

We invited 70 novice users and 38 expert users to sketch 136 3D objects, which were presented as 362 images rendered from multiple views.

3D Reconstruction

NeuralHDHair: Automatic High-fidelity Hair Modeling from a Single Image Using Implicit Neural Representations

no code implementations CVPR 2022 Keyu Wu, Yifan Ye, Lingchen Yang, Hongbo Fu, Kun Zhou, Youyi Zheng

To improve the efficiency of a traditional hair growth algorithm, we adopt a local neural implicit function to grow strands based on the estimated 3D hair geometric features.

DeepPortraitDrawing: Generating Human Body Images from Freehand Sketches

no code implementations4 May 2022 Xian Wu, Chen Wang, Hongbo Fu, Ariel Shamir, Song-Hai Zhang, Shi-Min Hu

Researchers have explored various ways to generate realistic images from freehand sketches, e. g., for objects and human faces.

Image Generation Sketch-to-Image Translation

TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformers

1 code implementation CVPR 2022 Xuyang Bai, Zeyu Hu, Xinge Zhu, Qingqiu Huang, Yilun Chen, Hongbo Fu, Chiew-Lan Tai

The attention mechanism of the transformer enables our model to adaptively determine where and what information should be taken from the image, leading to a robust and effective fusion strategy.

3D Object Detection Autonomous Driving +3

NeuralReshaper: Single-image Human-body Retouching with Deep Neural Networks

no code implementations20 Mar 2022 Beijia Chen, Yuefan Shen, Hongbo Fu, Xiang Chen, Kun Zhou, Youyi Zheng

In this paper, we present NeuralReshaper, a novel method for semantic reshaping of human bodies in single images using deep generative networks.

DrawingInStyles: Portrait Image Generation and Editing with Spatially Conditioned StyleGAN

no code implementations5 Mar 2022 Wanchao Su, Hui Ye, Shu-Yu Chen, Lin Gao, Hongbo Fu

The research topic of sketch-to-portrait generation has witnessed a boost of progress with deep learning techniques.

Image Generation

SketchHairSalon: Deep Sketch-based Hair Image Synthesis

no code implementations16 Sep 2021 Chufeng Xiao, Deng Yu, Xiaoguang Han, Youyi Zheng, Hongbo Fu

At the second stage, another network is trained to synthesize the structure and appearance of hair images from the input sketch and the generated matte.

Image Generation

SimpModeling: Sketching Implicit Field to Guide Mesh Modeling for 3D Animalmorphic Head Design

1 code implementation5 Aug 2021 Zhongjin Luo, Jie zhou, Heming Zhu, Dong Du, Xiaoguang Han, Hongbo Fu

In this work, we propose SimpModeling, a novel sketch-based system for helping users, especially amateur users, easily model 3D animalmorphic heads - a prevalent kind of heads in character design.

WSDesc: Weakly Supervised 3D Local Descriptor Learning for Point Cloud Registration

1 code implementation5 Aug 2021 Lei LI, Hongbo Fu, Maks Ovsjanikov

Instead of using a predefined fixed-size local support in voxelization, we propose to learn the optimal support in a data-driven manner.

Metric Learning Point Cloud Registration

VMNet: Voxel-Mesh Network for Geodesic-Aware 3D Semantic Segmentation

1 code implementation ICCV 2021 Zeyu Hu, Xuyang Bai, Jiaxiang Shang, Runze Zhang, Jiayu Dong, Xin Wang, Guangyuan Sun, Hongbo Fu, Chiew-Lan Tai

Experimental results validate the effectiveness of VMNet: specifically, on the challenging ScanNet dataset for large-scale segmentation of indoor scenes, it outperforms the state-of-the-art SparseConvNet and MinkowskiNet (74. 6% vs 72. 5% and 73. 6% in mIoU) with a simpler network structure (17M vs 30M and 38M parameters).

3D Semantic Segmentation

Autoregressive Stylized Motion Synthesis With Generative Flow

no code implementations CVPR 2021 Yu-Hui Wen, Zhipeng Yang, Hongbo Fu, Lin Gao, Yanan sun, Yong-Jin Liu

Motion style transfer is an important problem in many computer graphics and computer vision applications, including human animation, games, and robotics.

Motion Style Transfer Style Transfer

Scale-aware Insertion of Virtual Objects in Monocular Videos

no code implementations4 Dec 2020 SongHai Zhang, Xiangli Li, Yingtian Liu, Hongbo Fu

To handle the incompleteness of objects recovered from videos, we propose a novel scale estimation method that extracts plausible dimensions of objects for scale optimization.

Object

Deep Generation of Face Images from Sketches

1 code implementation1 Jun 2020 Shu-Yu Chen, Wanchao Su, Lin Gao, Shihong Xia, Hongbo Fu

Our method essentially uses input sketches as soft constraints and is thus able to produce high-quality face images even from rough and/or incomplete sketches.

Image-to-Image Translation Translation

D3Feat: Joint Learning of Dense Detection and Description of 3D Local Features

2 code implementations CVPR 2020 Xuyang Bai, Zixin Luo, Lei Zhou, Hongbo Fu, Long Quan, Chiew-Lan Tai

In this paper, we leverage a 3D fully convolutional network for 3D point clouds, and propose a novel and practical learning mechanism that densely predicts both a detection score and a description feature for each 3D point.

Point Cloud Registration

SketchGNN: Semantic Sketch Segmentation with Graph Neural Networks

1 code implementation2 Mar 2020 Lumin Yang, Jiajie Zhuang, Hongbo Fu, Xiangzhi Wei, Kun Zhou, Youyi Zheng

We introduce SketchGNN, a convolutional graph neural network for semantic segmentation and labeling of freehand vector sketches.

Segmentation Semantic Segmentation

SketchDesc: Learning Local Sketch Descriptors for Multi-view Correspondence

no code implementations16 Jan 2020 Deng Yu, Lei LI, Youyi Zheng, Manfred Lau, Yi-Zhe Song, Chiew-Lan Tai, Hongbo Fu

In this paper, we study the problem of multi-view sketch correspondence, where we take as input multiple freehand sketches with different views of the same object and predict as output the semantic correspondence among the sketches.

Semantic correspondence

Language-based Colorization of Scene Sketches

1 code implementation Transactions on Graphics 2019 Changqing Zou, Haoran Mo, Chengying Gao, Ruofei Du, Hongbo Fu

Being natural, touchless, and fun-embracing, language-based inputs have been demonstrated effective for various tasks from image generation to literacy education for children.

Colorization Image Generation +2

DeepSketchHair: Deep Sketch-based 3D Hair Modeling

1 code implementation20 Aug 2019 Yuefan Shen, Changgeng Zhang, Hongbo Fu, Kun Zhou, Youyi Zheng

The key enablers of our system are two carefully designed neural networks, namely, S2ONet, which converts an input sketch to a dense 2D hair orientation field; and O2VNet, which maps the 2D orientation field to a 3D vector field.

Graphics

SDM-NET: Deep Generative Network for Structured Deformable Mesh

no code implementations13 Aug 2019 Lin Gao, Jie Yang, Tong Wu, Yu-Jie Yuan, Hongbo Fu, Yu-Kun Lai, Hao Zhang

At the structural level, we train a Structured Parts VAE (SP-VAE), which jointly learns the part structure of a shape collection and the part geometries, ensuring a coherence between global shape structure and surface details.

Mesh Variational Autoencoders with Edge Contraction Pooling

1 code implementation7 Aug 2019 Yu-Jie Yuan, Yu-Kun Lai, Jie Yang, Hongbo Fu, Lin Gao

3D shape analysis is an important research topic in computer vision and graphics.

Sketch-R2CNN: An Attentive Network for Vector Sketch Recognition

no code implementations20 Nov 2018 Lei Li, Changqing Zou, Youyi Zheng, Qingkun Su, Hongbo Fu, Chiew-Lan Tai

To bridge the gap between these two spaces in neural networks, we propose a neural line rasterization module to convert the vector sketch along with the attention estimated by RNN into a bitmap image, which is subsequently consumed by CNN.

Sketch Recognition

LUCSS: Language-based User-customized Colourization of Scene Sketches

no code implementations30 Aug 2018 Changqing Zou, Haoran Mo, Ruofei Du, Xing Wu, Chengying Gao, Hongbo Fu

We introduce LUCSS, a language-based system for interactive col- orization of scene sketches, based on their semantic understanding.

Colorization

Active Object Reconstruction Using a Guided View Planner

no code implementations8 May 2018 Xin Yang, Yuanbo Wang, Yaru Wang, Bao-Cai Yin, Qiang Zhang, Xiaopeng Wei, Hongbo Fu

Inspired by the recent advance of image-based object reconstruction using deep learning, we present an active reconstruction model using a guided view planner.

Object Object Reconstruction

Color Orchestra: Ordering Color Palettes for Interpolation and Prediction

no code implementations17 Mar 2017 Huy Q. Phan, Hongbo Fu, Antoni B. Chan

As artists often use their personal color themes in their paintings, making these palettes appear frequently in the dataset, we employed density estimation to capture the characteristics of palette data.

Density Estimation

Cannot find the paper you are looking for? You can Submit a new open access paper.