Search Results for author: Rynson W. H. Lau

Found 49 papers, 21 papers with code

Inverse Rendering of Glossy Objects via the Neural Plenoptic Function and Radiance Fields

no code implementations24 Mar 2024 Haoyuan Wang, WenBo Hu, Lei Zhu, Rynson W. H. Lau

Our method has two stages: the geometry of the target object and the pre-filtered environmental radiance fields are reconstructed in the first stage, and materials of the target object are estimated in the second stage with the proposed NeP and material-aware cone sampling strategy.

Inverse Rendering Object

ThemeStation: Generating Theme-Aware 3D Assets from Few Exemplars

1 code implementation22 Mar 2024 Zhenwei Wang, Tengfei Wang, Gerhard Hancke, Ziwei Liu, Rynson W. H. Lau

To this end, we design a two-stage framework that draws a concept image first, followed by a reference-informed 3D modeling stage.

3D Generation Unity

Diff-Plugin: Revitalizing Details for Diffusion-based Low-level Tasks

no code implementations1 Mar 2024 Yuhao Liu, Zhanghan Ke, Fang Liu, Nanxuan Zhao, Rynson W. H. Lau

Diffusion models trained on large-scale datasets have achieved remarkable progress in image synthesis.

Image Generation

RelayAttention for Efficient Large Language Model Serving with Long System Prompts

1 code implementation22 Feb 2024 Lei Zhu, Xinjiang Wang, Wayne Zhang, Rynson W. H. Lau

Practical large language model (LLM) services may involve a long system prompt, which specifies the instructions, examples, and knowledge documents of the task and is reused across numerous requests.

Language Modelling Large Language Model

Delving into Dark Regions for Robust Shadow Detection

1 code implementation21 Feb 2024 Huankang Guan, Ke Xu, Rynson W. H. Lau

Our key insight to this problem is that existing methods typically learn discriminative shadow features from the whole image globally, covering the full range of intensity values, and may not learn the subtle differences between shadow and non-shadow pixels in dark regions.

Shadow Detection

Recasting Regional Lighting for Shadow Removal

no code implementations1 Feb 2024 Yuhao Liu, Zhanghan Ke, Ke Xu, Fang Liu, Zhenwei Wang, Rynson W. H. Lau

Based on this observation, we propose to condition the restoration of attenuated textures on the corrected local lighting in the shadow region.

Object Shadow Removal

DreamControl: Control-Based Text-to-3D Generation with 3D Self-Prior

1 code implementation11 Dec 2023 Tianyu Huang, Yihan Zeng, Zhilu Zhang, Wan Xu, Hang Xu, Songcen Xu, Rynson W. H. Lau, WangMeng Zuo

The priors are then regarded as input conditions to maintain reasonable geometries, in which conditional LoRA and weighted score are further proposed to optimize detailed textures.

3D Generation Text to 3D

Language-based Photo Color Adjustment for Graphic Designs

no code implementations6 Aug 2023 Zhenwei Wang, Nanxuan Zhao, Gerhard Hancke, Rynson W. H. Lau

We also introduce an approach for generating a synthetic graphic design dataset with instructions to enable model training.

Neural Preset for Color Style Transfer

1 code implementation CVPR 2023 Zhanghan Ke, Yuhao Liu, Lei Zhu, Nanxuan Zhao, Rynson W. H. Lau

In this paper, we present a Neural Preset technique to address the limitations of existing color style transfer methods, including visual artifacts, vast memory requirement, and slow style switching speed.

4k Color Normalization +4

Structure-Informed Shadow Removal Networks

no code implementations9 Jan 2023 Yuhao Liu, Qing Guo, Lan Fu, Zhanghan Ke, Ke Xu, Wei Feng, Ivor W. Tsang, Rynson W. H. Lau

Hence, in this paper, we propose to remove shadows at the image structure level.

Shadow Removal

Efficient Mirror Detection via Multi-level Heterogeneous Learning

1 code implementation28 Nov 2022 Ruozhen He, Jiaying Lin, Rynson W. H. Lau

We present HetNet (Multi-level \textbf{Het}erogeneous \textbf{Net}work), a highly efficient mirror detection network.

CLIP2Point: Transfer CLIP to Point Cloud Classification with Image-Depth Pre-training

1 code implementation ICCV 2023 Tianyu Huang, Bowen Dong, Yunhan Yang, Xiaoshui Huang, Rynson W. H. Lau, Wanli Ouyang, WangMeng Zuo

To address this issue, we propose CLIP2Point, an image-depth pre-training method by contrastive learning to transfer CLIP to the 3D domain, and adapt it to point cloud classification.

Contrastive Learning Few-Shot Learning +4

Rain Removal from Light Field Images with 4D Convolution and Multi-scale Gaussian Process

1 code implementation16 Aug 2022 Tao Yan, Mingyue Li, Bin Li, Yang Yang, Rynson W. H. Lau

However, making full use of the abundant information available from LFIs, such as 2D array of sub-views and the disparity map of each sub-view, for effective rain removal is still a challenging problem.

Depth Estimation Rain Removal

Weakly-Supervised Camouflaged Object Detection with Scribble Annotations

1 code implementation28 Jul 2022 Ruozhen He, Qihua Dong, Jiaying Lin, Rynson W. H. Lau

To achieve this, we first relabel 4, 040 images in existing camouflaged object datasets with scribbles, which takes ~10s to label one image.

Object object-detection +1

Symmetry-Aware Transformer-based Mirror Detection

1 code implementation13 Jul 2022 Tianyu Huang, Bowen Dong, Jiaying Lin, Xiaohui Liu, Rynson W. H. Lau, WangMeng Zuo

Mirror detection aims to identify the mirror regions in the given input image.


Harmonizer: Learning to Perform White-Box Image and Video Harmonization

1 code implementation4 Jul 2022 Zhanghan Ke, Chunyi Sun, Lei Zhu, Ke Xu, Rynson W. H. Lau

Unlike prior methods that are based on black-box autoencoders, Harmonizer contains a neural network for filter argument prediction and several white-box filters (based on the predicted arguments) for image harmonization.

Image Harmonization Video Harmonization

Depth-aware Glass Surface Detection with Cross-modal Context Mining

no code implementations22 Jun 2022 Jiaying Lin, Yuen Hei Yeung, Rynson W. H. Lau

This however poses substantial challenges on the operations of autonomous systems such as robots, self-driving cars and drones, as the glass panels can become transparent obstacles to the navigation. Existing works attempt to exploit various cues, including glass boundary context or reflections, as a prior.

Self-Driving Cars

Rethinking Video Salient Object Ranking

no code implementations31 Mar 2022 Jiaying Lin, Huankang Guan, Rynson W. H. Lau

Salient Object Ranking (SOR) involves ranking the degree of saliency of multiple salient objects in an input image.

Object Relation +1

Bi-directional Object-context Prioritization Learning for Saliency Ranking

1 code implementation CVPR 2022 Xin Tian, Ke Xu, Xin Yang, Lin Du, BaoCai Yin, Rynson W. H. Lau

We observe that spatial attention works concurrently with object-based attention in the human visual recognition system.

Object Saliency Ranking

Geometry-aware Two-scale PIFu Representation for Human Reconstruction

no code implementations3 Dec 2021 Zheng Dong, Ke Xu, Ziheng Duan, Hujun Bao, Weiwei Xu, Rynson W. H. Lau

Our key idea is to exploit the complementary properties of depth denoising and 3D reconstruction, for learning a two-scale PIFu representation to reconstruct high-frequency facial details and consistent bodies separately.

3D Human Reconstruction 3D Reconstruction +3

Learning to Detect Instance-level Salient Objects Using Complementary Image Labels

no code implementations19 Nov 2021 Xin Tian, Ke Xu, Xin Yang, BaoCai Yin, Rynson W. H. Lau

However, it is non-trivial to use only class labels to learn instance-aware saliency information, as salient instances with high semantic affinities may not be easily separated by the labels.

Boundary Detection Object Localization +1

MODNet-V: Improving Portrait Video Matting via Background Restoration

1 code implementation24 Sep 2021 Jiayu Sun, Zhanghan Ke, Lihe Zhang, Huchuan Lu, Rynson W. H. Lau

In this work, we observe that instead of asking the user to explicitly provide a background image, we may recover it from the input video itself.

Image Matting Video Matting

Smart Scribbles for Image Mating

no code implementations31 Mar 2021 Xin Yang, Yu Qiao, Shaozhe Chen, Shengfeng He, BaoCai Yin, Qiang Zhang, Xiaopeng Wei, Rynson W. H. Lau

Image matting is an ill-posed problem that usually requires additional user input, such as trimaps or scribbles.

Image Matting

Automatic Comic Generation with Stylistic Multi-page Layouts and Emotion-driven Text Balloon Generation

no code implementations26 Jan 2021 Xin Yang, Zongliang Ma, Letian Yu, Ying Cao, BaoCai Yin, Xiaopeng Wei, Qiang Zhang, Rynson W. H. Lau

Finally, as opposed to using the same type of balloon as in previous works, we propose an emotion-aware balloon generation method to create different types of word balloons by analyzing the emotion of subtitles and audios.

Weakly-Supervised Saliency Detection via Salient Object Subitizing

no code implementations4 Jan 2021 Xiaoyang Zheng, Xin Tan, Jie zhou, Lizhuang Ma, Rynson W. H. Lau

This allows the supervision to be aligned with the property of saliency detection, where the salient objects of an image could be from more than one class.

Object object-detection +4

Location-aware Single Image Reflection Removal

1 code implementation ICCV 2021 Zheng Dong, Ke Xu, Yin Yang, Hujun Bao, Weiwei Xu, Rynson W. H. Lau

It is beneficial to strong reflection detection and substantially improves the quality of reflection removal results.

Reflection Removal

Weakly-supervised Salient Instance Detection

no code implementations29 Sep 2020 Xin Tian, Ke Xu, Xin Yang, Bao-Cai Yin, Rynson W. H. Lau

Inspired by this insight, we propose to use class and subitizing labels as weak supervision for the SID problem.

Boundary Detection Object Localization +1

Guided Collaborative Training for Pixel-wise Semi-Supervised Learning

1 code implementation ECCV 2020 Zhanghan Ke, Di Qiu, Kaican Li, Qiong Yan, Rynson W. H. Lau

Although SSL methods have achieved impressive results in image classification, the performances of applying them to pixel-wise tasks are unsatisfactory due to their need for dense outputs.

Image Denoising Image Enhancement +2

HDR-GAN: HDR Image Reconstruction from Multi-Exposed LDR Images with Large Motions

1 code implementation3 Jul 2020 Yuzhen Niu, Jianbin Wu, Wenxi Liu, Wenzhong Guo, Rynson W. H. Lau

To address these two problems, we propose in this paper a novel GAN-based model, HDR-GAN, for synthesizing HDR images from multi-exposed LDR images.

HDR Reconstruction Image Reconstruction

Night-time Scene Parsing with a Large Real Dataset

no code implementations15 Mar 2020 Xin Tan, Ke Xu, Ying Cao, Yiheng Zhang, Lizhuang Ma, Rynson W. H. Lau

Although huge progress has been made on scene analysis in recent years, most existing works assume the input images to be in day-time with good lighting conditions.

Scene Parsing Semantic Segmentation

Where Is My Mirror?

1 code implementation ICCV 2019 Xin Yang, Haiyang Mei, Ke Xu, Xiaopeng Wei, Bao-Cai Yin, Rynson W. H. Lau

To the best of our knowledge, this is the first work to address the mirror segmentation problem with a computational approach.


Deformable Object Tracking with Gated Fusion

no code implementations27 Sep 2018 Wenxi Liu, Yibing Song, Dengsheng Chen, Shengfeng He, Yuanlong Yu, Tao Yan, Gerhard P. Hancke, Rynson W. H. Lau

In addition, we also propose a gated fusion scheme to control how the variations captured by the deformable convolution affect the original appearance.

Object Object Tracking

Task-driven Webpage Saliency

no code implementations ECCV 2018 Quanlong Zheng, Jianbo Jiao, Ying Cao, Rynson W. H. Lau

Inspired by the observation that given a specific task, human attention is strongly correlated with certain semantic components on a webpage (e. g., images, buttons and input boxes), our network explicitly disentangles saliency prediction into two independent sub-tasks: task-specific attention shift prediction and task-free saliency prediction.

Saliency Prediction

Dynamic Scene Deblurring Using Spatially Variant Recurrent Neural Networks

1 code implementation CVPR 2018 Jiawei Zhang, Jinshan Pan, Jimmy Ren, Yibing Song, Linchao Bao, Rynson W. H. Lau, Ming-Hsuan Yang

The proposed network is composed of three deep convolutional neural networks (CNNs) and a recurrent neural network (RNN).

Ranked #10 on Deblurring on RealBlur-R (trained on GoPro) (SSIM (sRGB) metric)


Egocentric Hand Detection Via Dynamic Region Growing

no code implementations10 Nov 2017 Shao Huang, Weiqiang Wang, Shengfeng He, Rynson W. H. Lau

Egocentric videos, which mainly record the activities carried out by the users of the wearable cameras, have drawn much research attentions in recent years.

Action Recognition Gesture Recognition +3

Delving Into Salient Object Subitizing and Detection

no code implementations ICCV 2017 Shengfeng He, Jianbo Jiao, Xiaodan Zhang, Guoqiang Han, Rynson W. H. Lau

Experiments show that the proposed multi-task network outperforms existing multi-task architectures, and the auxiliary subitizing network provides strong guidance to salient object detection by reducing false positives and producing coherent saliency maps.

Object object-detection +2

Exemplar-Driven Top-Down Saliency Detection via Deep Association

no code implementations CVPR 2016 Shengfeng He, Rynson W. H. Lau, Qingxiong Yang

To address it, we design a two-stage deep model to learn the intra-class association between the exemplars and query objects.

Object Saliency Detection

Exemplar-AMMs: Recognizing Crowd Movements from Pedestrian Trajectories

no code implementations31 Mar 2016 Wenxi Liu, Rynson W. H. Lau, Xiaogang Wang, Dinesh Manocha

Specifically, we propose an optimization framework that filters out the unknown noise in the crowd trajectories and measures their similarity to the exemplar-AMMs to produce a crowd motion feature.

Multi-Label Classification

Oriented Object Proposals

no code implementations ICCV 2015 Shengfeng He, Rynson W. H. Lau

In this paper, we propose a new approach to generate oriented object proposals (OOPs) to reduce the detection error caused by various orientations of the object.


Leveraging Long-Term Predictions and Online-Learning in Agent-based Multiple Person Tracking

no code implementations10 Feb 2014 Wenxi Liu, Antoni B. Chan, Rynson W. H. Lau, Dinesh Manocha

We present a multiple-person tracking algorithm, based on combining particle filters and RVO, an agent-based crowd model that infers collision-free velocities so as to predict pedestrian's motion.


A Robust Panel Extraction Method for Manga

no code implementations Video, Image, and Sound Analysis Lab (VISAL) at the City University of Hong Kong! 2014 Xufang Pang, Ying Cao, Rynson W. H. Lau, and Antoni B. Chan

Automatically extracting frames/panels from digital comic pages is crucial for techniques that facilitate comic reading on mobile devices with limited display areas.

Layout Design

Visual Tracking via Locality Sensitive Histograms

no code implementations CVPR 2013 Shengfeng He, Qingxiong Yang, Rynson W. H. Lau, Jiang Wang, Ming-Hsuan Yang

A robust tracking framework based on the locality sensitive histograms is proposed, which consists of two main components: a new feature for tracking that is robust to illumination changes and a novel multi-region tracking algorithm that runs in realtime even with hundreds of regions.

Visual Tracking

Cannot find the paper you are looking for? You can Submit a new open access paper.