no code implementations • 27 Jun 2023 • Jiaye Wu, Sanjoy Chowdhury, Hariharmano Shanmugaraja, David Jacobs, Soumyadip Sengupta
We then finetune different algorithms on our MAW dataset to significantly improve the quality of the reconstructed albedo both quantitatively and qualitatively.
1 code implementation • ICCV 2023 • Dongxu Zhao, Daniel Lichy, Pierre-Nicolas Perrin, Jan-Michael Frahm, Soumyadip Sengupta
We propose a fast and generalizable solution to Multi-view Photometric Stereo (MVPS), called MVPSNet.
no code implementations • 3 Apr 2023 • Shengze Wang, Ziheng Wang, Ryan Schmelzle, Liujie Zheng, Youngjoong Kwon, Soumyadip Sengupta, Henry Fuchs
In this paper, we work to bring telepresence to every desktop.
1 code implementation • 21 Mar 2023 • Akshay Paruchuri, Xin Liu, Yulu Pan, Shwetak Patel, Daniel McDuff, Soumyadip Sengupta
Our findings illustrate the usefulness of motion transfer as a data augmentation technique for improving the generalization of models for camera-based physiological sensing.
no code implementations • 13 Mar 2023 • Shuxian Wang, Yubo Zhang, Sarah K. McGill, Julian G. Rosenman, Jan-Michael Frahm, Soumyadip Sengupta, Stephen M. Pizer
Reconstructing a 3D surface from colonoscopy video is challenging due to illumination and reflectivity variation in the video frame that can cause defective shape predictions.
1 code implementation • 14 Feb 2023 • Arpit Bansal, Hong-Min Chu, Avi Schwarzschild, Soumyadip Sengupta, Micah Goldblum, Jonas Geiping, Tom Goldstein
Typical diffusion models are trained to accept a particular form of conditioning, most commonly text, and cannot be conditioned on other modalities without retraining.
1 code implementation • NeurIPS 2023 • Xin Liu, Girish Narayanswamy, Akshay Paruchuri, XiaoYu Zhang, Jiankai Tang, Yuzhe Zhang, Soumyadip Sengupta, Shwetak Patel, Yuntao Wang, Daniel McDuff
Camera-based physiological measurement is a fast growing field of computer vision.
1 code implementation • 19 May 2022 • Patrick Esser, Peter Michael, Soumyadip Sengupta
We evaluate our two-stream approach for inpainting tasks, where experiments show that it improves both the propagation of features within a single frame as required for image inpainting, as well as their propagation from keyframes to target frames.
no code implementations • CVPR 2022 • Daniel Lichy, Soumyadip Sengupta, David W. Jacobs
Existing approaches rely on optimization coupled with a far-field PS network operating on pixels or small patches.
1 code implementation • 25 Aug 2021 • Shanchuan Lin, Linjie Yang, Imran Saleemi, Soumyadip Sengupta
We introduce a robust, real-time, high-resolution human video matting method that achieves new state-of-the-art performance.
no code implementations • ICCV 2021 • Soumyadip Sengupta, Brian Curless, Ira Kemelmacher-Shlizerman, Steve Seitz
Whereas existing light stages require expensive, room-scale spherical capture gantries and exist in only a few labs in the world, we demonstrate how to acquire useful data from a normal TV or desktop monitor.
1 code implementation • CVPR 2021 • Daniel Lichy, Jiaye Wu, Soumyadip Sengupta, David W. Jacobs
In this paper, we present a technique for estimating the geometry and reflectance of objects using only a camera, flashlight, and optionally a tripod.
2 code implementations • CVPR 2021 • Shanchuan Lin, Andrey Ryabtsev, Soumyadip Sengupta, Brian Curless, Steve Seitz, Ira Kemelmacher-Shlizerman
We introduce a real-time, high-resolution background replacement technique which operates at 30fps in 4K resolution, and 60fps for HD on a modern GPU.
1 code implementation • CVPR 2020 • Soumyadip Sengupta, Vivek Jayaram, Brian Curless, Steve Seitz, Ira Kemelmacher-Shlizerman
To bridge the domain gap to real imagery with no labeling, we train another matting network guided by the first network and by a discriminator that judges the quality of composites.
Ranked #1 on
Image Matting
on Adobe Matting
2 code implementations • ECCV 2020 • Roy Or-El, Soumyadip Sengupta, Ohad Fried, Eli Shechtman, Ira Kemelmacher-Shlizerman
Most existing aging methods are limited to changing the texture, overlooking transformations in head shape that occur during the human aging and growth process.
no code implementations • ICCV 2019 • Soumyadip Sengupta, Jinwei Gu, Kihwan Kim, Guilin Liu, David W. Jacobs, Jan Kautz
Inverse rendering aims to estimate physical attributes of a scene, e. g., reflectance, geometry, and lighting, from image(s).
no code implementations • CVPR 2018 • Soumyadip Sengupta, Angjoo Kanazawa, Carlos D. Castillo, David W. Jacobs
SfSNet learns from a mixture of labeled synthetic and unlabeled real world images.
1 code implementation • CVPR 2018 • Soumyadip Sengupta, Angjoo Kanazawa, Carlos D. Castillo, David Jacobs
SfSNet learns from a mixture of labeled synthetic and unlabeled real world images.
no code implementations • CVPR 2017 • Soumyadip Sengupta, Tal Amir, Meirav Galun, Tom Goldstein, David W. Jacobs, Amit Singer, Ronen Basri
We show that in general, with the selection of proper scale factors, a matrix formed by stacking fundamental matrices between pairs of images has rank 6.
no code implementations • 2 Feb 2017 • Soumyadip Sengupta, Hao Zhou, Walter Forkel, Ronen Basri, Tom Goldstein, David W. Jacobs
We introduce a new, integrated approach to uncalibrated photometric stereo.