Search Results for author:
Found 28 papers, 5 papers with code
Panoptic Studio: A Massively Multiview System for Social Interaction Capture
The core challenges in capturing social interactions are: (1) occlusion is functional and frequent; (2) subtle motion needs to be measured over a space large enough to host a social group; (3) human appearance and configuration variation is immense; and (4) attaching markers to the body may prime the nature of interactions.
Multimodal Material Segmentation
We use semantic segmentation, as a prior to "guide" this filter selection.
Ranked #7 on
Semantic Segmentation
on UPLight
Dynamic 3D Gaze From Afar: Deep Gaze Estimation From Temporal Eye-Head-Body Coordination
We introduce a novel method and dataset for 3D gaze estimation of a freely moving person from a distance, typically in surveillance views.
Invertible Neural BRDF for Object Inverse Rendering
We introduce a novel neural network-based BRDF model and a Bayesian framework for object inverse rendering, i. e., joint estimation of reflectance and natural illumination from a single image of an object of known geometry.
NeRFrac: Neural Radiance Fields through Refractive Surface
We introduce NeRFrac to realize neural novel view synthesis of scenes captured through refractive surfaces, typically water surfaces.
A Linear Extrinsic Calibration of Kaleidoscopic Imaging System from Single 3D Point
This paper proposes a new extrinsic calibration of kaleidoscopic imaging system by estimating normals and distances of the mirrors.
Deep Photovoltaic Nowcasting
Our experiments reveal that the MLP network, already used similarly in previous work, achieves an RMSE skill score of 7% over the commonly-used persistence baseline on the 1-minute future photovoltaic power prediction task.
A Linear Generalized Camera Calibration From Three Intersecting Reference Planes
This paper presents a new generalized (or ray-pixel, raxel) camera calibration algorithm for camera systems involving distortions by unknown refraction and reflection processes.
Panoptic Studio: A Massively Multiview System for Social Motion Capture
We present an approach to capture the 3D structure and motion of a group of people engaged in a social interaction.
Appearance and Shape from Water Reflection
In other words, for the first time, we show that capturing a direct and water-reflected scene in a single exposure forms a self-calibrating HDR catadioptric stereo camera.
3D-GMNet: Single-View 3D Shape Recovery as A Gaussian Mixture
In this paper, we introduce 3D-GMNet, a deep neural network for 3D object shape reconstruction from a single image.
SOIC: Semantic Online Initialization and Calibration for LiDAR and Camera
This paper presents a novel semantic-based online extrinsic calibration approach, SOIC (so, I see), for Light Detection and Ranging (LiDAR) and camera sensors.
Video Region Annotation with Sparse Bounding Boxes
Video analysis has been moving towards more detailed interpretation (e. g. segmentation) with encouraging progresses.
Structure of Multiple Mirror System from Kaleidoscopic Projections of Single 3D Point
The kaleidoscopic imaging system can be recognized as the virtual multi-camera system and has strong advantages in that the virtual cameras are strictly synchronized and have the same intrinsic parameters.
Polarimetric Normal Stereo
Our key idea is to introduce a polarimetric cost volume of distance defined on the polarimetric observations and the polarization state computed from the surface normal.
Shape From Sky: Polarimetric Normal Recovery Under the Sky
That is, we show that the unique polarization pattern encoded in the polarimetric appearance of an object captured under the sky can be decoded to reveal the surface normal at each pixel.
View Birdification in the Crowd: Ground-Plane Localization from Perceived Movements
We introduce view birdification, the problem of recovering ground-plane movements of people in a crowd from an ego-centric video captured from an observer (e. g., a person or a vehicle) also moving in the crowd.
BlindSpotNet: Seeing Where We Cannot See
Next, we introduce BlindSpotNet (BSN), a simple network that fully leverages this dataset for fully automatic estimation of frame-wise blind spot probability maps for arbitrary driving videos.
nLMVS-Net: Deep Non-Lambertian Multi-View Stereo
Our key idea is to formulate MVS as an end-to-end learnable network, which we refer to as nLMVS-Net, that seamlessly integrates radiometric cues to leverage surface normals as view-independent surface features for learned cost volume construction and filtering.
ViewBirdiformer: Learning to recover ground-plane crowd trajectories and ego-motion from a single ego-centric view
We introduce a novel learning-based method for view birdification, the task of recovering ground-plane trajectories of pedestrians of a crowd and their observer in the same crowd just from the observed ego-centric video.
Fresnel Microfacet BRDF: Unification of Polari-Radiometric Surface-Body Reflection
Our key idea is to model the Fresnel reflection and transmission of the surface microgeometry with a collection of oriented mirror facets, both for body and surface reflections.
InCrowdFormer: On-Ground Pedestrian World Model From Egocentric Views
We introduce an on-ground Pedestrian World Model, a computational model that can predict how pedestrians move around an observer in the crowd on the ground plane, but from just the egocentric-views of the observer.
TransPoser: Transformer as an Optimizer for Joint Object Shape and Pose Estimation
We propose a novel method for joint estimation of shape and pose of rigid objects from their sequentially observed RGB-D images.
Fooling Polarization-based Vision using Locally Controllable Polarizing Projection
If so, is that possible to realize these adversarial attacks in the physical world, without being perceived by human eyes?
DeePoint: Visual Pointing Recognition and Direction Estimation
The first is the introduction of a first-of-its-kind large-scale dataset for pointing recognition and direction estimation, which we refer to as the DP Dataset.
Teleidoscopic Imaging System for Microscale 3D Shape Reconstruction
The planar mirrors virtually define multiple viewpoints by multiple reflections, and the monocentric lens realizes a high magnification with less blurry and surround view even in closeup imaging.
DeepShaRM: Multi-View Shape and Reflectance Map Recovery Under Unknown Lighting
We introduce a novel deep reflectance map estimation network that recovers the camera-view reflectance maps from the surface normals of the current geometry estimate and the input multi-view images.
SPIDeRS: Structured Polarization for Invisible Depth and Reflectance Sensing
We introduce structured polarization for invisible depth and reflectance sensing (SPIDeRS), the first depth and reflectance sensing method using patterns of polarized light.
