1 code implementation • 1 Sep 2024 • Zhuofeng Wu, Doehyung Lee, Zihua Liu, Kazunori Yoshizaki, Yusuke Monno, Masatoshi Okutomi
Similar to a dual-pixel (DP) sensor, the phase shifting can be regarded as stereo disparity and utilized for depth estimation.
no code implementations • 29 May 2024 • Zijie Jiang, Yusuke Monno, Masatoshi Okutomi, Sho Suzuki, Kenji Miki
Enabling the synthesis of arbitrarily novel viewpoint images within a patient's stomach from pre-captured monocular gastroscopic images is a promising topic in stomach diagnosis.
1 code implementation • 28 Feb 2024 • Wenjiao Bian, Yusuke Monno, Masatoshi Okutomi
This paper addresses reflection removal, which is the task of separating reflection components from a captured image and deriving the image with only transmission components.
no code implementations • 28 Feb 2024 • Zhuofeng Wu, Yusuke Monno, Masatoshi Okutomi
In this paper, we address the task of aberration-aware depth-from-defocus (DfD), which takes account of spatially variant point spread functions (PSFs) of a real camera.
no code implementations • 11 Nov 2023 • Jinyu Zhao, Jumpei Oishi, Yusuke Monno, Masatoshi Okutomi
PatchMatch Multi-View Stereo (PatchMatch MVS) is one of the popular MVS approaches, owing to its balanced accuracy and efficiency.
no code implementations • 24 Dec 2022 • Jinyu Zhao, Yusuke Monno, Masatoshi Okutomi
We then refine the initial model by optimizing photometric rendering errors and polarimetric errors using multi-view RGB, AoP, and DoP images, where we propose a novel polarimetric cost function that enables an effective constraint on the estimated surface normal of each vertex, while considering four possible ambiguous azimuth angles revealed from the AoP measurement.
no code implementations • 24 Oct 2022 • Yizhou Li, Yusuke Monno, Masatoshi Okutomi
In this paper, we propose the first method using a Dual-Pixel (DP) sensor to better address the raindrop removal.
no code implementations • 13 Sep 2022 • Vy Nguyen, Masayuki Tanaka, Yusuke Monno, Masatoshi Okutomi
Polarization information of light in a scene is valuable for various image processing and computer vision tasks.
no code implementations • CVPR 2022 • Chunyu Li, Yusuke Monno, Masatoshi Okutomi
To jointly reconstruct the depth and the hyperspectral reflectance from a single color-dot image, we propose a novel end-to-end network architecture that effectively incorporates a geometric color-dot pattern loss and a photometric hyperspectral reflectance loss.
1 code implementation • 5 Nov 2021 • Yizhou Li, Yusuke Monno, Masatoshi Okutomi
For this purpose, an encoder-decoder network draws wide attention, where the encoder is required to encode a high-quality rain embedding which determines the performance of the subsequent decoding stage to reconstruct the rain layer.
no code implementations • 28 Jul 2021 • Aji Resindra Widya, Yusuke Monno, Masatoshi Okutomi, Sho Suzuki, Takuji Gotoda, Kenji Miki
In addition, we propose a novel generalized photometric loss function to avoid the complicated process of finding proper weights for balancing the depth and the pose loss terms, which is required for existing direct depth and pose supervision approaches.
no code implementations • 15 Apr 2021 • Chunyu Li, Yusuke Monno, Masatoshi Okutomi
Reconstructing an object's high-quality 3D shape with inherent spectral reflectance property, beyond typical device-dependent RGB albedos, opens the door to applications requiring a high-fidelity 3D model in terms of both geometry and photometry.
no code implementations • 18 Dec 2020 • Hironori Hidaka, Yusuke Monno, Masatoshi Okutomi
A lighting-based multispectral imaging system using an RGB camera and a projector is one of the most practical and low-cost systems to acquire multispectral observations for estimating the scene's spectral reflectance information.
no code implementations • 20 Nov 2020 • Takeru Suda, Masayuki Tanaka, Yusuke Monno, Masatoshi Okutomi
In this paper, we propose a deep snapshot high dynamic range (HDR) imaging framework that can effectively reconstruct an HDR image from the RAW data captured using a multi-exposure color filter array (ME-CFA), which consists of a mosaic pattern of RGB filters with different exposure levels.
no code implementations • 28 Jul 2020 • Miki Morimatsu, Yusuke Monno, Masayuki Tanaka, Masatoshi Okutomi
Since the polarimeter consists of an image sensor equipped with a monochrome or color polarization filter array (MPFA or CPFA), the demosaicking process to interpolate missing pixel values plays a crucial role in obtaining high-quality polarization images.
no code implementations • ECCV 2020 • Jinyu Zhao, Yusuke Monno, Masatoshi Okutomi
A polarization camera has great potential for 3D reconstruction since the angle of polarization (AoP) of reflected light is related to an object's surface normal.
no code implementations • 26 Apr 2020 • Aji Resindra Widya, Yusuke Monno, Masatoshi Okutomi, Sho Suzuki, Takuji Gotoda, Kenji Miki
Gastric endoscopy is a standard clinical process that enables medical practitioners to diagnose various lesions inside a patient's stomach.
no code implementations • ICCV 2019 • Chunyu Li, Yusuke Monno, Hironori Hidaka, Masatoshi Okutomi
In this paper, we propose a novel projector-camera system for practical and low-cost acquisition of a dense object 3D model with the spectral reflectance property.
no code implementations • 30 May 2019 • Aji Resindra Widya, Yusuke Monno, Kosuke Imahori, Masatoshi Okutomi, Sho Suzuki, Takuji Gotoda, Kenji Miki
In this work, we investigated how to enable structure-from-motion (SfM) to reconstruct the whole shape of a stomach from a standard endoscope video.