no code implementations • 26 Apr 2022 • Junghun Oh, Heewon Kim, Seungjun Nah, Cheeun Hong, Jonghyun Choi, Kyoung Mu Lee
Image restoration tasks have witnessed great performance improvement in recent years by developing large deep models.
no code implementations • 30 Mar 2022 • JoonKyu Park, Seungjun Nah, Kyoung Mu Lee
When motion blur is strong, however, hidden states are hard to deliver proper information due to the displacement between different frames.
no code implementations • 28 Mar 2022 • JoonKyu Park, Yeonguk Oh, Gyeongsik Moon, Hongsuk Choi, Kyoung Mu Lee
However, we argue that occluded regions have strong correlations with hands so that they can provide highly beneficial information for complete 3D hand mesh estimation.
1 code implementation • 24 Mar 2022 • Reyhaneh Neshatavar, Mohsen Yavartanoo, Sanghyun Son, Kyoung Mu Lee
The CVF module can output multiple decomposed variables of the input and take a combination of the outputs back as an input in a cyclic manner.
1 code implementation • 22 Mar 2022 • Wooseok Lee, Sanghyun Son, Kyoung Mu Lee
Extensive studies demonstrate that our method outperforms the other self-supervised and even unpaired denoising methods by a large margin, without using any additional knowledge, e. g., noise level, regarding the underlying unknown noise.
no code implementations • 12 Mar 2022 • JoonKyu Park, Seungjun Nah, Kyoung Mu Lee
State-of-the-art video deblurring methods often adopt recurrent neural networks to model the temporal dependency between the frames.
1 code implementation • ICCV 2021 • Geonwoon Jang, Wooseok Lee, Sanghyun Son, Kyoung Mu Lee
In a practical scenario, a noise generator should learn to simulate the general and complex noise distribution without using paired noisy and clean images.
no code implementations • 2 Dec 2021 • Junghun Oh, Heewon Kim, Sungyong Baik, Cheeun Hong, Kyoung Mu Lee
The goal of filter pruning is to search for unimportant filters to remove in order to make convolutional neural networks (CNNs) efficient without sacrificing the performance in the process.
no code implementations • 25 Oct 2021 • Euyoung Kim, Soochahn Lee, Kyoung Mu Lee
Accurate identification and localization of abnormalities from radiology images serve as a critical role in computer-aided diagnosis (CAD) systems.
1 code implementation • 15 Oct 2021 • Mohsen Yavartanoo, Shih-Hsuan Hung, Reyhaneh Neshatavar, Yue Zhang, Kyoung Mu Lee
3D shape representation and its processing have substantial effects on 3D shape recognition.
Ranked #1 on
3D Object Classification
on ModelNet10
1 code implementation • ICCV 2021 • Sungyong Baik, Janghoon Choi, Heewon Kim, Dohee Cho, Jaesik Min, Kyoung Mu Lee
The problem lies in that each application and task may require different auxiliary loss function, especially when tasks are diverse and distinct.
no code implementations • 8 Sep 2021 • Sanghyun Son, Jaeha Kim, Wei-Sheng Lai, Ming-Husan Yang, Kyoung Mu Lee
Most image super-resolution (SR) methods are developed on synthetic low-resolution (LR) and high-resolution (HR) image pairs that are constructed by a predetermined operation, e. g., bicubic downsampling.
1 code implementation • ICCV 2021 • Mohsen Yavartanoo, JaeYoung Chung, Reyhaneh Neshatavar, Kyoung Mu Lee
Our experiments demonstrate the superiorities of our method in terms of representation power compared to the state-of-the-art methods in single RGB image 3D shape reconstruction.
no code implementations • 17 May 2021 • Andrey Ignatov, Andres Romero, Heewon Kim, Radu Timofte, Chiu Man Ho, Zibo Meng, Kyoung Mu Lee, Yuxiang Chen, Yutong Wang, Zeyu Long, Chenhao Wang, Yifei Chen, Boshen Xu, Shuhang Gu, Lixin Duan, Wen Li, Wang Bofei, Zhang Diankai, Zheng Chengjian, Liu Shaoli, Gao Si, Zhang Xiaofeng, Lu Kaidi, Xu Tianyu, Zheng Hui, Xinbo Gao, Xiumei Wang, Jiaming Guo, Xueyi Zhou, Hao Jia, Youliang Yan
Video super-resolution has recently become one of the most important mobile-related problems due to the rise of video communication and streaming services.
no code implementations • 30 Apr 2021 • Seungjun Nah, Sanghyun Son, Suyoung Lee, Radu Timofte, Kyoung Mu Lee
In this challenge report, we describe the challenge specifics and the evaluation results from the 2 competition tracks with the proposed solutions.
no code implementations • 30 Apr 2021 • Sanghyun Son, Suyoung Lee, Seungjun Nah, Radu Timofte, Kyoung Mu Lee
Super-Resolution (SR) is a fundamental computer vision task that aims to obtain a high-resolution clean image from the given low-resolution counterpart.
no code implementations • ICLR 2022 • Seungjun Nah, Sanghyun Son, Jaerin Lee, Kyoung Mu Lee
The supervised reblurring loss at training stage compares the amplified blur between the deblurred and the sharp images.
1 code implementation • CVPR 2021 • Sanghyun Son, Kyoung Mu Lee
Deep CNNs have achieved significant successes in image processing and its applications, including single image super-resolution (SR).
1 code implementation • 15 Apr 2021 • Hongsuk Choi, Gyeongsik Moon, JoonKyu Park, Kyoung Mu Lee
Second, we propose a joint-based regressor that distinguishes a target person's feature from others.
no code implementations • 1 Jan 2021 • Jaerin Lee, Kyoung Mu Lee
Mini-batch SGD is a predominant optimization method in deep learning.
no code implementations • ICCV 2021 • Myungsub Choi, Suyoung Lee, Heewon Kim, Kyoung Mu Lee
Video frame interpolation aims to synthesize accurate intermediate frames given a low-frame-rate video.
1 code implementation • 21 Dec 2020 • Cheeun Hong, Heewon Kim, Sungyong Baik, Junghun Oh, Kyoung Mu Lee
Quantizing deep convolutional neural networks for image super-resolution substantially reduces their computational costs.
no code implementations • ICCV 2021 • Heewon Kim, Sungyong Baik, Myungsub Choi, Janghoon Choi, Kyoung Mu Lee
Diverse user preferences over images have recently led to a great amount of interest in controlling the imagery effects for image restoration tasks.
3 code implementations • 23 Nov 2020 • Gyeongsik Moon, Hongsuk Choi, Kyoung Mu Lee
Assuming no 3D pseudo-GTs are available, NeuralAnnot is weakly supervised with GT 2D/3D joint coordinates of training sets.
1 code implementation • 23 Nov 2020 • Gyeongsik Moon, Hongsuk Choi, Kyoung Mu Lee
Using Pose2Pose, Hand4Whole utilizes hand MCP joint features to predict 3D wrists as MCP joints largely contribute to 3D wrist rotations in the human kinematic chain.
1 code implementation • CVPR 2021 • Hongsuk Choi, Gyeongsik Moon, Ju Yong Chang, Kyoung Mu Lee
Our TCMR significantly outperforms previous video-based methods in temporal consistency with better per-frame 3D pose and shape accuracy.
Ranked #13 on
3D Human Pose Estimation
on 3DPW
(using extra training data)
1 code implementation • 9 Nov 2020 • Suyoung Lee, Myungsub Choi, Kyoung Mu Lee
Most conventional supervised super-resolution (SR) algorithms assume that low-resolution (LR) data is obtained by downscaling high-resolution (HR) data with a fixed known kernel, but such an assumption often does not hold in real scenarios.
2 code implementations • NeurIPS 2020 • Sungyong Baik, Myungsub Choi, Janghoon Choi, Heewon Kim, Kyoung Mu Lee
Despite its popularity, several recent works question the effectiveness of MAML when test tasks are different from training tasks, thus suggesting various task-conditioned methodology to improve the initialization.
no code implementations • 28 Sep 2020 • Sanghyun Son, Jaerin Lee, Seungjun Nah, Radu Timofte, Kyoung Mu Lee
Videos in the real-world contain various dynamics and motions that may look unnaturally discontinuous in time when the recordedframe rate is low.
no code implementations • 21 Aug 2020 • Sungyong Baik, Hyo Jin Kim, Tianwei Shen, Eddy Ilg, Kyoung Mu Lee, Chris Sweeney
We tackle the problem of visual localization under changing conditions, such as time of day, weather, and seasons.
2 code implementations • ECCV 2020 • Gyeongsik Moon, Shoou-I Yu, He Wen, Takaaki Shiratori, Kyoung Mu Lee
Therefore, we firstly propose (1) a large-scale dataset, InterHand2. 6M, and (2) a baseline network, InterNet, for 3D interacting hand pose estimation from a single RGB image.
2 code implementations • ECCV 2020 • Hongsuk Choi, Gyeongsik Moon, Kyoung Mu Lee
Most of the recent deep learning-based 3D human pose and mesh estimation methods regress the pose and shape parameters of human mesh models, such as SMPL and MANO, from an input image.
Ranked #4 on
3D Hand Pose Estimation
on FreiHAND
1 code implementation • ECCV 2020 • Gyeongsik Moon, Takaaki Shiratori, Kyoung Mu Lee
We design our system to be trained in an end-to-end and weakly-supervised manner; therefore, it does not require groundtruth meshes.
1 code implementation • ECCV 2020 • Gyeongsik Moon, Kyoung Mu Lee
Most of the previous image-based 3D human pose and mesh estimation methods estimate parameters of the human mesh model from an input image.
Ranked #4 on
3D Hand Pose Estimation
on FreiHAND
1 code implementation • 14 Jul 2020 • Janghoon Choi, Junseok Kwon, Kyoung Mu Lee
However, extensive scale variations of the target object and distractor objects with similar categories have consistently posed challenges in visual tracking.
2 code implementations • 13 Jul 2020 • Gyeongsik Moon, Heeseung Kwon, Kyoung Mu Lee, Minsu Cho
Most current action recognition methods heavily rely on appearance information by taking an RGB sequence of entire image regions as input.
no code implementations • 4 May 2020 • Seungjun Nah, Sanghyun Son, Radu Timofte, Kyoung Mu Lee
Videos contain various types and strengths of motions that may look unnaturally discontinuous in time when the recorded frame rate is low.
no code implementations • 4 May 2020 • Seungjun Nah, Sanghyun Son, Radu Timofte, Kyoung Mu Lee
This paper reviews the NTIRE 2020 Challenge on Image and Video Deblurring.
1 code implementation • CVPR 2020 • Myungsub Choi, Janghoon Choi, Sungyong Baik, Tae Hyun Kim, Kyoung Mu Lee
Finally, we show that our meta-learning framework can be easily employed to any video frame interpolation network and can consistently improve its performance on multiple benchmark datasets.
no code implementations • 18 Nov 2019 • Heewon Kim, Seokil Hong, Bohyung Han, Heesoo Myeong, Kyoung Mu Lee
We present an elegant framework of fine-grained neural architecture search (FGNAS), which allows to employ multiple heterogeneous operations within a single layer and can even generate compositional feature maps using several different base operations.
1 code implementation • 26 Oct 2019 • Ju Yong Chang, Gyeongsik Moon, Kyoung Mu Lee
This study presents a new network (i. e., PoseLifter) that can lift a 2D human pose to an absolute 3D pose in a camera coordinate system.
no code implementations • ICCV 2019 • Dongmin Park, Seokil Hong, Bohyung Han, Kyoung Mu Lee
Catastrophic forgetting is a critical challenge in training deep neural networks.
4 code implementations • ICCV 2019 • Gyeongsik Moon, Ju Yong Chang, Kyoung Mu Lee
Although significant improvement has been achieved recently in 3D human pose estimation, most of the previous methods only treat a single-person case.
Ranked #2 on
Root Joint Localization
on Human3.6M
1 code implementation • CVPR 2020 • Sungyong Baik, Seokil Hong, Kyoung Mu Lee
Model-agnostic meta-learning (MAML) tackles the problem by formulating prior knowledge as a common initialization across tasks, which is then used to quickly adapt to unseen tasks.
no code implementations • 10 May 2019 • Gyeongsik Moon, Ju Yong Chang, Kyoung Mu Lee
Multi-person pose estimation from a 2D image is challenging because it requires not only keypoint localization but also human detection.
1 code implementation • CVPR 2019 • Gyeongsik Moon, Ju Yong Chang, Kyoung Mu Lee
In this paper, we propose a human pose refinement network that estimates a refined pose from a tuple of an input image and input pose.
Ranked #2 on
Multi-Person Pose Estimation
on COCO
(Test AP metric)
no code implementations • 5 Nov 2018 • Mohsen Yavartanoo, Eu Young Kim, Kyoung Mu Lee
We propose an efficient Stereographic Projection Neural Network (SPNet) for learning representations of 3D objects.
1 code implementation • ECCV 2018 • Sanghyun Son, Seungjun Nah, Kyoung Mu Lee
In this paper, we propose a novel method to compress CNNs by reconstructing the network from a small set of spatial convolution kernels.
no code implementations • ECCV 2018 • Heewon Kim, Myungsub Choi, Bee Lim, Kyoung Mu Lee
Our framework is efficient, and it can be generalized to handle an arbitrary image resizing operation.
1 code implementation • 6 Jun 2018 • Seung Yeon Shin, Soochahn Lee, Il Dong Yun, Kyoung Mu Lee
We propose a novel deep-learning-based system for vessel segmentation.
Ranked #1 on
Retinal Vessel Segmentation
on HRF
no code implementations • CVPR 2018 • Gwangmo Song, Heesoo Myeong, Kyoung Mu Lee
In this paper, we propose an automatic seed generation technique with deep reinforcement learning to solve the interactive segmentation problem.
no code implementations • ECCV 2018 • Yumin Suh, Jingdong Wang, Siyu Tang, Tao Mei, Kyoung Mu Lee
We propose a novel network that learns a part-aligned representation for person re-identification.
Ranked #4 on
Person Re-Identification
on UAV-Human
no code implementations • ICCV 2019 • Janghoon Choi, Junseok Kwon, Kyoung Mu Lee
In this paper, we propose a novel on-line visual tracking framework based on the Siamese matching network and meta-learner network, which run at real-time speeds.
2 code implementations • CVPR 2018 • Shanxin Yuan, Guillermo Garcia-Hernando, Bjorn Stenger, Gyeongsik Moon, Ju Yong Chang, Kyoung Mu Lee, Pavlo Molchanov, Jan Kautz, Sina Honari, Liuhao Ge, Junsong Yuan, Xinghao Chen, Guijin Wang, Fan Yang, Kai Akiyama, Yang Wu, Qingfu Wan, Meysam Madadi, Sergio Escalera, Shile Li, Dongheui Lee, Iason Oikonomidis, Antonis Argyros, Tae-Kyun Kim
Official Torch7 implementation of "V2V-PoseNet: Voxel-to-Voxel Prediction Network for Accurate 3D Hand and Human Pose Estimation from a Single Depth Map", CVPR 2018
Ranked #4 on
Hand Pose Estimation
on HANDS 2017
no code implementations • ECCV 2018 • Dongwoo Lee, Haesol Park, In Kyu Park, Kyoung Mu Lee
Removing camera motion blur from a single light field is a challenging task since it is highly ill-posed inverse problem.
7 code implementations • CVPR 2018 • Gyeongsik Moon, Ju Yong Chang, Kyoung Mu Lee
To overcome these weaknesses, we firstly cast the 3D hand and human pose estimation problem from a single depth map into a voxel-to-voxel prediction that uses a 3D voxelized grid and estimates the per-voxel likelihood for each keypoint.
Ranked #2 on
Hand Pose Estimation
on NYU Hands
1 code implementation • 10 Oct 2017 • Seung Yeon Shin, Soochahn Lee, Il Dong Yun, Sun Mi Kim, Kyoung Mu Lee
The results trained with only 10 strongly annotated images along with weakly annotated images were comparable to results trained from 800 strongly annotated images, with the 95% confidence interval of difference -3. 00%--5. 00%, in terms of the correct localization (CorLoc) measure, which is the ratio of images with intersection over union with ground truth higher than 0. 5.
no code implementations • 19 Sep 2017 • Haesol Park, Kyoung Mu Lee
When a human matches two images, the viewer has a natural tendency to view the wide area around the target pixel to obtain clues of right correspondence.
no code implementations • ICCV 2017 • Haesol Park, Kyoung Mu Lee
The conventional methods for estimating camera poses and scene structures from severely blurry or low resolution images often result in failure.
1 code implementation • The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops 2017 • Junho Cho, Sangdoo Yun, Kyoung Mu Lee, Jin Young Choi
PaletteNet is then designed to change the color concept of a source image so that the palette of the output image is close to the target palette.
37 code implementations • 10 Jul 2017 • Bee Lim, Sanghyun Son, Heewon Kim, Seungjun Nah, Kyoung Mu Lee
Recent research on super-resolution has progressed with the development of deep convolutional neural networks (DCNN).
no code implementations • 15 Jun 2017 • Gyeongsik Moon, Ju Yong Chang, Yumin Suh, Kyoung Mu Lee
We propose a novel approach to 3D human pose estimation from a single depth map.
no code implementations • 13 Apr 2017 • Ju Yong Chang, Kyoung Mu Lee
The unary term of the proposed CRF model is defined based on a powerful heat-map regression network, which has been proposed for 2D human pose estimation.
no code implementations • ICCV 2017 • Tae Hyun Kim, Kyoung Mu Lee, Bernhard Schölkopf, Michael Hirsch
We show the superiority of the proposed method in an extensive experimental evaluation.
1 code implementation • 21 Feb 2017 • Janghoon Choi, Junseok Kwon, Kyoung Mu Lee
In this paper, we introduce a novel real-time visual tracking algorithm based on a template selection strategy constructed by deep reinforcement learning methods.
1 code implementation • CVPR 2017 • Seungjun Nah, Tae Hyun Kim, Kyoung Mu Lee
To remove these complicated motion blurs, conventional energy optimization based methods rely on simple assumptions such that blur kernel is partially uniform or locally linear.
Ranked #13 on
Deblurring
on HIDE (trained on GOPRO)
no code implementations • 29 Nov 2016 • Byeongjoo Ahn, Tae Hyun Kim, Wonsik Kim, Kyoung Mu Lee
We also provide a novel analysis on the blur kernel at object boundaries, which shows the distinctive characteristics of the blur kernel that cannot be captured by conventional blur models.
no code implementations • 14 Mar 2016 • Tae Hyun Kim, Seungjun Nah, Kyoung Mu Lee
We infer bidirectional optical flows to handle motion blurs, and also estimate Gaussian blur maps to remove optical blur from defocus in our new blur model.
no code implementations • ICCV 2015 • Kamil Adamczewski, Yumin Suh, Kyoung Mu Lee
Graph matching is a fundamental problem in computer vision.
8 code implementations • CVPR 2016 • Jiwon Kim, Jung Kwon Lee, Kyoung Mu Lee
We present a highly accurate single-image super-resolution (SR) method.
Ranked #4 on
Image Super-Resolution
on WebFace - 8x upscaling
1 code implementation • CVPR 2016 • Jiwon Kim, Jung Kwon Lee, Kyoung Mu Lee
We propose an image super-resolution method (SR) using a deeply-recursive convolutional network (DRCN).
Ranked #15 on
Image Super-Resolution
on Urban100 - 2x upscaling
no code implementations • CVPR 2015 • Tae Hyun Kim, Kyoung Mu Lee
We propose a video deblurring method to deal with general blurs inherent in dynamic scenes, contrary to other methods.
no code implementations • CVPR 2015 • Yumin Suh, Kamil Adamczewski, Kyoung Mu Lee
By constructing Markov chain on the restricted search space instead of the original solution space, our method approximates the solution effectively.
no code implementations • CVPR 2015 • Wonsik Kim, Kyoung Mu Lee
However, not much research efforts has been done on the generation of "good" proposals, especially for non-metric energy functions.
no code implementations • CVPR 2014 • Junseok Kwon, Kyoung Mu Lee
By minimizing the interval of the posterior, our method can reduce the modeling uncertainty in the posterior.
no code implementations • CVPR 2014 • Tae Hyun Kim, Kyoung Mu Lee
Thus, we propose a new energy model simultaneously estimating motion flow and the latent image based on robust total variation (TV)-L1 model.
no code implementations • CVPR 2014 • Wonsik Kim, Kyoung Mu Lee
To come up with faster sampling method, we investigate two ideas: breaking detailed balance and updating multiple nodes at a time.
no code implementations • CVPR 2013 • Junseok Kwon, Kyoung Mu Lee
The uncertainty of the likelihood is estimated by obtaining the gap between the lower and upper bounds of the likelihood.
no code implementations • CVPR 2013 • Heesoo Myeong, Kyoung Mu Lee
In this paper, we propose semantic relation transfer, a method to transfer high-order semantic relations of objects from annotated images to unlabeled images analogous to label transfer techniques where label information are transferred.