Search Results for author: Yu-Kun Lai

Found 54 papers, 20 papers with code

NeRF-Editing: Geometry Editing of Neural Radiance Fields

no code implementations10 May 2022 Yu-Jie Yuan, Yang-tian Sun, Yu-Kun Lai, Yuewen Ma, Rongfei Jia, Lin Gao

In this paper, we propose a method that allows users to perform controllable shape deformation on the implicit representation of the scene, and synthesizes the novel view images of the edited scene without re-training the network.

Neural Rendering Novel View Synthesis

Playing Lottery Tickets in Style Transfer Models

no code implementations25 Mar 2022 Meihao Kong, Jing Huo, Wenbin Li, Jing Wu, Yu-Kun Lai, Yang Gao

(2) Using iterative magnitude pruning, we find the matching subnetworks at 89. 2% sparsity in AdaIN and 73. 7% sparsity in SANet, which demonstrates that style transfer models can play lottery tickets too.

Style Transfer

Quality Metric Guided Portrait Line Drawing Generation from Unpaired Training Data

1 code implementation8 Feb 2022 Ran Yi, Yong-Jin Liu, Yu-Kun Lai, Paul L. Rosin

In this paper, we propose a novel method to automatically transform face photos to portrait drawings using unpaired training data with two new features; i. e., our method can (1) learn to generate high quality portrait drawings in multiple styles using a single network and (2) generate portrait drawings in a "new style" unseen in the training data.

MuSCLe: A Multi-Strategy Contrastive Learning Framework for Weakly Supervised Semantic Segmentation

no code implementations18 Jan 2022 Kunhao Yuan, Gerald Schaefer, Yu-Kun Lai, Yifan Wang, Xiyao Liu, Lin Guan, Hui Fang

Weakly supervised semantic segmentation (WSSS) has gained significant popularity since it relies only on weak labels such as image level annotations rather than pixel level annotations required by supervised semantic segmentation (SSS) methods.

Contrastive Learning Weakly-Supervised Semantic Segmentation

E-ffective: A Visual Analytic System for Exploring the Emotion and Effectiveness of Inspirational Speeches

no code implementations28 Oct 2021 Kevin Maher, Zeyuan Huang, Jiancheng Song, Xiaoming Deng, Yu-Kun Lai, Cuixia Ma, Hao Wang, Yong-Jin Liu, Hongan Wang

We further studied the usability of the system by speaking novices and experts on assisting analysis of inspirational speech effectiveness.

Robust Pose Transfer with Dynamic Details using Neural Video Rendering

no code implementations27 Jun 2021 Yang-tian Sun, Hao-Zhi Huang, Xuan Wang, Yu-Kun Lai, Wei Liu, Lin Gao

Moreover, we introduce a concise temporal loss in the training stage to suppress the detail flickering that is made more visible due to high-quality dynamic details generated by our method.

Neural Rendering Pose Transfer +1

Hierarchical Layout-Aware Graph Convolutional Network for Unified Aesthetics Assessment

1 code implementation CVPR 2021 Dongyu She, Yu-Kun Lai, Gaoxiong Yi, Kun Xu

The first LA-GCN module constructs an aesthetics-related graph in the coordinate space and performs reasoning over spatial nodes.

TransLoc3D : Point Cloud based Large-scale Place Recognition using Adaptive Receptive Fields

1 code implementation25 May 2021 Tian-Xing Xu, Yuan-Chen Guo, Yu-Kun Lai, Song-Hai Zhang

We argue that fixed receptive fields are not well suited for place recognition, and propose a novel Adaptive Receptive Field Module (ARFM), which can adaptively adjust the size of the receptive field based on the input point cloud.

Autonomous Driving Point Cloud Retrieval +1

An Open-Source Multi-Goal Reinforcement Learning Environment for Robotic Manipulation with Pybullet

2 code implementations12 May 2021 Xintong Yang, Ze Ji, Jing Wu, Yu-Kun Lai

This work re-implements the OpenAI Gym multi-goal robotic manipulation environment, originally based on the commercial Mujoco engine, onto the open-source Pybullet engine.

Multi-Goal Reinforcement Learning OpenAI Gym +1

PISE: Person Image Synthesis and Editing with Decoupled GAN

1 code implementation CVPR 2021 Jinsong Zhang, Kun Li, Yu-Kun Lai, Jingyu Yang

The results of qualitative and quantitative experiments demonstrate the superiority of our model on human pose transfer.

Human Parsing Pose Transfer

Deep Deformation Detail Synthesis for Thin Shell Models

no code implementations23 Feb 2021 Lan Chen, Lin Gao, Jie Yang, Shibiao Xu, Juntao Ye, Xiaopeng Zhang, Yu-Kun Lai

Moreover, as such methods only add details, they require coarse meshes to be close to fine meshes, which can be either impossible, or require unrealistic constraints when generating fine meshes.


VENet: Voting Enhancement Network for 3D Object Detection

no code implementations ICCV 2021 Qian Xie, Yu-Kun Lai, Jing Wu, Zhoutao Wang, Dening Lu, Mingqiang Wei, Jun Wang

Hough voting, as has been demonstrated in VoteNet, is effective for 3D object detection, where voting is a key step.

3D Object Detection

MLVSNet: Multi-Level Voting Siamese Network for 3D Visual Tracking

1 code implementation ICCV 2021 Zhoutao Wang, Qian Xie, Yu-Kun Lai, Jing Wu, Kun Long, Jun Wang

To deal with sparsity in outdoor 3D point clouds, we propose to perform Hough voting on multi-level features to get more vote centers and retain more useful information, instead of voting only on the final level feature as in previous methods.

3D Object Detection Visual Tracking

Single Image 3D Shape Retrieval via Cross-Modal Instance and Category Contrastive Learning

no code implementations ICCV 2021 Ming-Xian Lin, Jie Yang, He Wang, Yu-Kun Lai, Rongfei Jia, Binqiang Zhao, Lin Gao

Inspired by the great success in recent contrastive learning works on self-supervised representation learning, we propose a novel IBSR pipeline leveraging contrastive learning.

3D Shape Retrieval Contrastive Learning +3

PoNA: Pose-guided Non-local Attention for Human Pose Transfer

1 code implementation13 Dec 2020 Kun Li, Jinsong Zhang, Yebin Liu, Yu-Kun Lai, Qionghai Dai

In each block, we propose a pose-guided non-local attention (PoNA) mechanism with a long-range dependency scheme to select more important regions of image features to transfer.

Person Re-Identification Pose Transfer

Multiscale Mesh Deformation Component Analysis with Attention-based Autoencoders

no code implementations4 Dec 2020 Jie Yang, Lin Gao, Qingyang Tan, Yihua Huang, Shihong Xia, Yu-Kun Lai

The attention mechanism is designed to learn to softly weight multi-scale deformation components in active deformation regions, and the stacked attention-based autoencoder is learned to represent the deformation components at different scales.

TM-NET: Deep Generative Networks for Textured Meshes

no code implementations13 Oct 2020 Lin Gao, Tong Wu, Yu-Jie Yuan, Ming-Xian Lin, Yu-Kun Lai, Hao Zhang

We introduce a conditional autoregressive model for texture generation, which can be conditioned on both part geometry and textures already generated for other parts to achieve texture compatibility.


RISA-Net: Rotation-Invariant Structure-Aware Network for Fine-Grained 3D Shape Retrieval

1 code implementation2 Oct 2020 Rao Fu, Jie Yang, Jiawei Sun, Fang-Lue Zhang, Yu-Kun Lai, Lin Gao

Fine-grained 3D shape retrieval aims to retrieve 3D shapes similar to a query shape in a repository with models belonging to the same class, which requires shape descriptors to be capable of representing detailed geometric information to discriminate shapes with globally similar structures.

3D Object Retrieval 3D Shape Retrieval

NPRportrait 1.0: A Three-Level Benchmark for Non-Photorealistic Rendering of Portraits

no code implementations1 Sep 2020 Paul L. Rosin, Yu-Kun Lai, David Mould, Ran Yi, Itamar Berger, Lars Doyle, Seungyong Lee, Chuan Li, Yong-Jin Liu, Amir Semmo, Ariel Shamir, Minjung Son, Holger Winnemoller

Despite the recent upsurge of activity in image-based non-photorealistic rendering (NPR), and in particular portrait image stylisation, due to the advent of neural style transfer, the state of performance evaluation in this field is limited, especially compared to the norms in the computer vision and machine learning communities.

Style Transfer

DSG-Net: Learning Disentangled Structure and Geometry for 3D Shape Generation

1 code implementation12 Aug 2020 Jie Yang, Kaichun Mo, Yu-Kun Lai, Leonidas J. Guibas, Lin Gao

While significant progress has been made, especially with recent deep generative models, it remains a challenge to synthesize high-quality shapes with rich geometric details and complex structure, in a controllable manner.

3D Shape Generation

Image-based Portrait Engraving

1 code implementation12 Aug 2020 Paul L. Rosin, Yu-Kun Lai

This paper describes a simple image-based method that applies engraving stylisation to portraits using ordered dithering.

Face Detection

Adaptive 3D Face Reconstruction from a Single Image

no code implementations8 Jul 2020 Kun Li, Jing Yang, Nianhong Jiao, Jinsong Zhang, Yu-Kun Lai

3D face reconstruction from a single image is a challenging problem, especially under partial occlusions and extreme poses.

3D Face Reconstruction Pose Estimation

CP-VTON+: Clothing Shape and Texture Preserving Image-Based Virtual Try-On

1 code implementation CVPRW 2020 Matiur Rahman Minar, Thai Thanh Tuan, Heejune Ahn, Paul Rosin, Yu-Kun Lai

Recently proposed Image-based virtual try-on (VTON) approaches have several challenges regarding diverse human poses and cloth styles.

Virtual Try-on

3D Reconstruction of Clothes using a Human Body Model and its Application to Image-based Virtual Try-On

no code implementations CVPRW 2020 Matiur Rahman Minar, Thai Thanh Tuan, Heejune Ahn, Paul Rosin, Yu-Kun Lai

Due to the correspondence, resulting 3D clothing models can be easily transferred to the target human models with different poses and shapes estimated from 2D images.

3D Reconstruction Virtual Try-on

Manifold Alignment for Semantically Aligned Style Transfer

1 code implementation ICCV 2021 Jing Huo, Shiyin Jin, Wenbin Li, Jing Wu, Yu-Kun Lai, Yinghuan Shi, Yang Gao

In this paper, we make a new assumption that image features from the same semantic region form a manifold and an image with multiple semantic regions follows a multi-manifold distribution.

Semantic Segmentation Style Transfer

Deep Line Art Video Colorization with a Few References

no code implementations24 Mar 2020 Min Shi, Jia-Qi Zhang, Shu-Yu Chen, Lin Gao, Yu-Kun Lai, Fang-Lue Zhang

The color transform network takes the target line art images as well as the line art and color images of one or more reference images as input, and generates corresponding target color images.


3D-CariGAN: An End-to-End Solution to 3D Caricature Generation from Face Photos

1 code implementation15 Mar 2020 Zipeng Ye, Mengfei Xia, Yanan sun, Ran Yi, MinJing Yu, Juyong Zhang, Yu-Kun Lai, Yong-Jin Liu

The most challenging issue for our system is that the source domain of face photos (characterized by normal 2D faces) is significantly different from the target domain of 3D caricatures (characterized by 3D exaggerated face shapes and textures).


A Survey on Deep Geometry Learning: From a Representation Perspective

no code implementations19 Feb 2020 Yun-Peng Xiao, Yu-Kun Lai, Fang-Lue Zhang, Chunpeng Li, Lin Gao

However, the performance for different applications largely depends on the representation used, and there is no unique representation that works well for all applications.


MW-GAN: Multi-Warping GAN for Caricature Generation with Multi-Style Geometric Exaggeration

no code implementations7 Jan 2020 Haodi Hou, Jing Huo, Jing Wu, Yu-Kun Lai, Yang Gao

Given an input face photo, the goal of caricature generation is to produce stylized, exaggerated caricatures that share the same identity as the photo.

Caricature Style Transfer

Learning-based Real-time Detection of Intrinsic Reflectional Symmetry

no code implementations1 Nov 2019 Yi-Ling Qiao, Lin Gao, Shu-Zhi Liu, Ligang Liu, Yu-Kun Lai, Xilin Chen

In this paper, we propose \YL{a} learning-based approach to intrinsic reflectional symmetry detection.

Symmetry Detection

PRS-Net: Planar Reflective Symmetry Detection Net for 3D Models

1 code implementation15 Oct 2019 Lin Gao, Ling-Xiao Zhang, Hsien-Yu Meng, Yi-Hui Ren, Yu-Kun Lai, Leif Kobbelt

In this paper, we present a novel learning framework to automatically discover global planar reflective symmetry of a 3D shape.

Symmetry Detection

SDM-NET: Deep Generative Network for Structured Deformable Mesh

no code implementations13 Aug 2019 Lin Gao, Jie Yang, Tong Wu, Yu-Jie Yuan, Hongbo Fu, Yu-Kun Lai, Hao Zhang

At the structural level, we train a Structured Parts VAE (SP-VAE), which jointly learns the part structure of a shape collection and the part geometries, ensuring a coherence between global shape structure and surface details.

Mesh Variational Autoencoders with Edge Contraction Pooling

1 code implementation7 Aug 2019 Yu-Jie Yuan, Yu-Kun Lai, Jie Yang, Hongbo Fu, Lin Gao

3D shape analysis is an important research topic in computer vision and graphics.

Learning from Web Data: the Benefit of Unsupervised Object Localization

no code implementations21 Dec 2018 Xiaoxiao Sun, Liang Zheng, Yu-Kun Lai, Jufeng Yang

In this work, we first systematically study the built-in gap between the web and standard datasets, i. e. different data distributions between the two kinds of data.

Fine-Grained Image Classification General Classification +2

VV-Net: Voxel VAE Net with Group Convolutions for Point Cloud Segmentation

no code implementations ICCV 2019 Hsien-Yu Meng, Lin Gao, Yu-Kun Lai, Dinesh Manocha

Our approach results in a good volumetric representation that effectively tackles noisy point cloud datasets and is more robust for learning.


Learning Bidirectional LSTM Networks for Synthesizing 3D Mesh Animation Sequences

no code implementations4 Oct 2018 Yi-Ling Qiao, Lin Gao, Yu-Kun Lai, Shihong Xia

In this paper, we present a novel method for learning to synthesize 3D mesh animation sequences with long short-term memory (LSTM) blocks and mesh-based convolutional neural networks (CNNs).


A Deep Learning Driven Active Framework for Segmentation of Large 3D Shape Collections

no code implementations17 Jul 2018 David George, Xianguha Xie, Yu-Kun Lai, Gary KL Tam

First, we a propose a fast and relatively accurate feature-based deep learning model to provide dataset-wide segmentation predictions.

Active Learning Semantic Segmentation

HDFD --- A High Deformation Facial Dynamics Benchmark for Evaluation of Non-Rigid Surface Registration and Classification

no code implementations9 Jul 2018 Gareth Andrews, Sam Endean, Roberto Dyke, Yu-Kun Lai, Gwenno Ffrancon, Gary KL Tam

In this paper, we present a novel facial dynamic dataset HDFD which addresses the gap of existing datasets, including 4D funny faces with substantial non-isometric deformation, and 4D visual-audio faces of spoken phrases in a minority language (Welsh).

General Classification

Weakly Supervised Coupled Networks for Visual Sentiment Analysis

1 code implementation CVPR 2018 Jufeng Yang, Dongyu She, Yu-Kun Lai, Paul L. Rosin, Ming-Hsuan Yang

The second branch utilizes both the holistic and localized information by coupling the sentiment map with deep features for robust classification.

General Classification Robust classification +1

CartoonGAN: Generative Adversarial Networks for Photo Cartoonization

7 code implementations CVPR 2018 Yang Chen, Yu-Kun Lai, Yong-Jin Liu

Two novel losses suitable for cartoonization are proposed: (1) a semantic content loss, which is formulated as a sparse regularization in the high-level feature maps of the VGG network to cope with substantial style variation between photos and cartoons, and (2) an edge-promoting adversarial loss for preserving clear edges.

Real-to-Cartoon translation

Content-Sensitive Supervoxels via Uniform Tessellations on Video Manifolds

no code implementations CVPR 2018 Ran Yi, Yong-Jin Liu, Yu-Kun Lai

We propose an efficient Lloyd-like method with a splitting-merging scheme to compute a uniform tessellation on M, which induces the CSS in X. Theoretically our method has a good competitive ratio O(1).

Alive Caricature from 2D to 3D

1 code implementation CVPR 2018 Qianyi Wu, Juyong Zhang, Yu-Kun Lai, Jianmin Zheng, Jianfei Cai

Caricature is an art form that expresses subjects in abstract, simple and exaggerated view.


Mesh-based Autoencoders for Localized Deformation Component Analysis

no code implementations13 Sep 2017 Qingyang Tan, Lin Gao, Yu-Kun Lai, Jie Yang, Shihong Xia

Spatially localized deformation components are very useful for shape analysis and synthesis in 3D geometry processing.


Sparse Data Driven Mesh Deformation

no code implementations5 Sep 2017 Lin Gao, Yu-Kun Lai, Jie Yang, Ling-Xiao Zhang, Leif Kobbelt, Shihong Xia

This along with a suitably chosen deformation basis including spatially localized deformation modes leads to significant advantages, including more meaningful, reliable, and efficient deformations because fewer and localized deformation modes are applied.


Automatic Semantic Style Transfer using Deep Convolutional Neural Networks and Soft Masks

1 code implementation31 Aug 2017 Huihuang Zhao, Paul L. Rosin, Yu-Kun Lai

This paper presents an automatic image synthesis method to transfer the style of an example image to a content image.

Image Generation Style Transfer

Learning to Rank Retargeted Images

no code implementations CVPR 2017 Yang Chen, Yong-Jin Liu, Yu-Kun Lai

Observing that it is challenging even for human subjects to give consistent scores for retargeting results of different source images, in this paper we propose a learning-based OQA method that predicts the ranking of a set of retargeted images with the same source image.


Robust Non-Rigid Registration with Reweighted Position and Transformation Sparsity

no code implementations15 Mar 2017 Kun Li, Jingyu Yang, Yu-Kun Lai, Daoliang Guo

Non-rigid registration is challenging because it is ill-posed with high degrees of freedom and is thus sensitive to noise and outliers.

Cannot find the paper you are looking for? You can Submit a new open access paper.