Search Results for author: Hwann-Tzong Chen

Found 33 papers, 19 papers with code

DiffusionAtlas: High-Fidelity Consistent Diffusion Video Editing

no code implementations5 Dec 2023 Shao-Yu Chang, Hwann-Tzong Chen, Tyng-Luh Liu

Despite the success in image editing, diffusion models still encounter significant hindrances when it comes to video editing due to the challenge of maintaining spatiotemporal consistency in the object's appearance across frames.

Object Video Editing

Hashing Neural Video Decomposition with Multiplicative Residuals in Space-Time

no code implementations ICCV 2023 Cheng-Hung Chan, Cheng-Yang Yuan, Cheng Sun, Hwann-Tzong Chen

We present a video decomposition method that facilitates layer-based editing of videos with spatiotemporally varying lighting and motion effects.

Video Editing

Multiview Regenerative Morphing with Dual Flows

1 code implementation2 Aug 2022 Chih-Jung Tsai, Cheng Sun, Hwann-Tzong Chen

This paper aims to address a new task of image morphing under a multiview setting, which takes two sets of multiview images as the input and generates intermediate renderings that not only exhibit smooth transitions between the two input sets but also ensure visual consistency across different views at any transition state.

Image Morphing

Mask2Hand: Learning to Predict the 3D Hand Pose and Shape from Shadow

1 code implementation31 May 2022 Li-Jen Chang, Yu-Cheng Liao, Chia-Hui Lin, Hwann-Tzong Chen

We present a self-trainable method, Mask2Hand, which learns to solve the challenging task of predicting 3D hand pose and shape from a 2D binary mask of hand silhouette/shadow without additional manually-annotated data.

Hand Pose Estimation

Self-supervised 360$^{\circ}$ Room Layout Estimation

no code implementations30 Mar 2022 Hao-Wen Ting, Cheng Sun, Hwann-Tzong Chen

We present the first self-supervised method to train panoramic room layout estimation models without any labeled data.

Active Learning Room Layout Estimation

Pose Adaptive Dual Mixup for Few-Shot Single-View 3D Reconstruction

no code implementations23 Dec 2021 Ta-Ying Cheng, Hsuan-ru Yang, Niki Trigoni, Hwann-Tzong Chen, Tyng-Luh Liu

We present a pose adaptive few-shot learning procedure and a two-stage data interpolation regularization, termed Pose Adaptive Dual Mixup (PADMix), for single-image 3D reconstruction.

3D Reconstruction Few-Shot Learning +1

Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstruction

2 code implementations CVPR 2022 Cheng Sun, Min Sun, Hwann-Tzong Chen

Finally, evaluation on five inward-facing benchmarks shows that our method matches, if not surpasses, NeRF's quality, yet it only takes about 15 minutes to train from scratch for a new scene.

Novel View Synthesis

Specialize and Fuse: Pyramidal Output Representation for Semantic Segmentation

no code implementations ICCV 2021 Chi-Wei Hsiao, Cheng Sun, Hwann-Tzong Chen, Min Sun

We present a novel pyramidal output representation to ensure parsimony with our "specialize and fuse" process for semantic segmentation.

Segmentation Semantic Segmentation +1

Moving in a 360 World: Synthesizing Panoramic Parallaxes from a Single Panorama

1 code implementation21 Jun 2021 Ching-Yu Hsu, Cheng Sun, Hwann-Tzong Chen

We present Omnidirectional Neural Radiance Fields (OmniNeRF), the first method to the application of parallax-enabled novel panoramic view synthesis.

Novel View Synthesis

DropLoss for Long-Tail Instance Segmentation

1 code implementation13 Apr 2021 Ting-I Hsieh, Esther Robb, Hwann-Tzong Chen, Jia-Bin Huang

Based on this insight, we develop DropLoss -- a novel adaptive loss to compensate for this imbalance without a trade-off between rare and frequent categories.

Instance Segmentation object-detection +3

Learning Camera-Aware Noise Models

1 code implementation ECCV 2020 Ke-Chi Chang, Ren Wang, Hung-Jin Lin, Yu-Lun Liu, Chia-Ping Chen, Yu-Lin Chang, Hwann-Tzong Chen

Modeling imaging sensor noise is a fundamental problem for image processing and computer vision applications.

Noise Estimation

Silhouette-Net: 3D Hand Pose Estimation from Silhouettes

no code implementations28 Dec 2019 Kuo-Wei Lee, Shih-Hung Liu, Hwann-Tzong Chen, Koichi Ito

3D hand pose estimation has received a lot of attention for its wide range of applications and has made great progress owing to the development of deep learning.

3D Hand Pose Estimation

Flat2Layout: Flat Representation for Estimating Layout of General Room Types

no code implementations29 May 2019 Chi-Wei Hsiao, Cheng Sun, Min Sun, Hwann-Tzong Chen

This paper also constructs a benchmark for validating the performance on general layout topologies, where Flat2Layout achieves good performance on general room types.

COCO-GAN: Conditional Coordinate Generative Adversarial Network

no code implementations ICLR 2019 Chieh Hubert Lin, Chia-Che Chang, Yu-Sheng Chen, Da-Cheng Juan, Wei Wei, Hwann-Tzong Chen

The fact that the patch generation process is independent to each other inspires a wide range of new applications: firstly, "Patch-Inspired Image Generation" enables us to generate the entire image based on a single patch.

Generative Adversarial Network Image Generation +1

Instance-Level Meta Normalization

1 code implementation CVPR 2019 Songhao Jia, Ding-Jie Chen, Hwann-Tzong Chen

This paper presents a normalization mechanism called Instance-Level Meta Normalization (ILM~Norm) to address a learning-to-normalize problem.

Point-to-Point Video Generation

3 code implementations ICCV 2019 Tsun-Hsuan Wang, Yen-Chi Cheng, Chieh Hubert Lin, Hwann-Tzong Chen, Min Sun

We introduce point-to-point video generation that controls the generation process with two control points: the targeted start- and end-frames.

Image Manipulation Video Editing +1

COCO-GAN: Generation by Parts via Conditional Coordinating

1 code implementation ICCV 2019 Chieh Hubert Lin, Chia-Che Chang, Yu-Sheng Chen, Da-Cheng Juan, Wei Wei, Hwann-Tzong Chen

On the computation side, COCO-GAN has a built-in divide-and-conquer paradigm that reduces memory requisition during training and inference, provides high-parallelism, and can generate parts of images on-demand.

Face Generation

SwipeCut: Interactive Segmentation with Diversified Seed Proposals

no code implementations18 Dec 2018 Ding-Jie Chen, Hwann-Tzong Chen, Long-Wen Chang

At each round of interaction the user is only presented with a small number of informative query seeds that are far apart from each other.

Image Segmentation Interactive Segmentation +2

Non-local RoI for Cross-Object Perception

no code implementations25 Nov 2018 Shou-Yao Roy Tseng, Hwann-Tzong Chen, Shao-Heng Tai, Tyng-Luh Liu

We present a generic and flexible module that encodes region proposals by both their intrinsic features and the extrinsic correlations to the others.

Instance Segmentation Object +5

Non-local RoIs for Instance Segmentation

no code implementations14 Jul 2018 Shou-Yao Roy Tseng, Hwann-Tzong Chen, Shao-Heng Tai, Tyng-Luh Liu

We introduce the concept of Non-Local RoI (NL-RoI) Block as a generic and flexible module that can be seamlessly adapted into different Mask R-CNN heads for various tasks.

Instance Segmentation Segmentation +1

Self Adversarial Training for Human Pose Estimation

1 code implementation8 Jul 2017 Chia-Jung Chou, Jui-Ting Chien, Hwann-Tzong Chen

This paper presents a deep learning based approach to the problem of human pose estimation.

Pose Estimation

Quantitative Analysis of Automatic Image Cropping Algorithms: A Dataset and Comparative Study

1 code implementation5 Jan 2017 Yi-Ling Chen, Tzu-Wei Huang, Kai-Han Chang, Yu-Chen Tsai, Hwann-Tzong Chen, Bing-Yu Chen

Automatic photo cropping is an important tool for improving visual quality of digital photos without resorting to tedious manual selection.

Image Cropping Learning-To-Rank +1

Cannot find the paper you are looking for? You can Submit a new open access paper.