Search Results for author: Sean Banerjee

Found 9 papers, 5 papers with code

Using Motion Forecasting for Behavior-Based Virtual Reality (VR) Authentication

1 code implementation30 Jan 2024 Mingjun Li, Natasha Kholgade Banerjee, Sean Banerjee

In this work, we present the first approach that predicts future user behavior using Transformer-based forecasting and using the forecasted trajectory to perform user authentication.

Motion Forecasting

Evaluating Deep Networks for Detecting User Familiarity with VR from Hand Interactions

no code implementations27 Jan 2024 Mingjun Li, Numan Zafar, Natasha Kholgade Banerjee, Sean Banerjee

As VR devices become more prevalent in the consumer space, VR applications are likely to be increasingly used by users unfamiliar with VR.

HOH: Markerless Multimodal Human-Object-Human Handover Dataset with Large Object Count

no code implementations NeurIPS 2023 Noah Wiederhold, Ava Megyeri, DiMaggio Paris, Sean Banerjee, Natasha Kholgade Banerjee

We present the HOH (Human-Object-Human) Handover Dataset, a large object count dataset with 136 objects, to accelerate data-driven research on handover studies, human-robot handover implementation, and artificial intelligence (AI) on handover parameter estimation from 2D and 3D data of person interactions.

Object Trajectory Prediction

Pix2Repair: Implicit Shape Restoration from Images

no code implementations29 May 2023 Xinchao Song, Nikolas Lamb, Sean Banerjee, Natasha Kholgade Banerjee

We also introduce Fantastic Breaks Imaged, the first large-scale dataset of 11, 653 real-world images of fractured objects for training and evaluating image-based shape repair approaches.

Object

Simultaneous prediction of hand gestures, handedness, and hand keypoints using thermal images

1 code implementation2 Mar 2023 Sichao Li, Sean Banerjee, Natasha Kholgade Banerjee, Soumyabrata Dey

In this work, we propose a technique for simultaneous hand gesture classification, handedness detection, and hand keypoints localization using thermal data captured by an infrared camera.

Multi-Task Learning

DeepJoin: Learning a Joint Occupancy, Signed Distance, and Normal Field Function for Shape Repair

1 code implementation22 Nov 2022 Nikolas Lamb, Sean Banerjee, Natasha Kholgade Banerjee

We generate a high-resolution restoration shape by inferring a corresponding complete shape and a break surface from an input fractured shape.

DeepMend: Learning Occupancy Functions to Represent Shape for Repair

1 code implementation11 Oct 2022 Nikolas Lamb, Sean Banerjee, Natasha Kholgade Banerjee

We represent the occupancy of a fractured shape as the conjunction of the occupancy of an underlying complete shape and the fracture surface, which we model as functions of latent codes using neural networks.

Panoptic Studio: A Massively Multiview System for Social Interaction Capture

1 code implementation9 Dec 2016 Hanbyul Joo, Tomas Simon, Xulong Li, Hao liu, Lei Tan, Lin Gui, Sean Banerjee, Timothy Godisart, Bart Nabbe, Iain Matthews, Takeo Kanade, Shohei Nobuhara, Yaser Sheikh

The core challenges in capturing social interactions are: (1) occlusion is functional and frequent; (2) subtle motion needs to be measured over a space large enough to host a social group; (3) human appearance and configuration variation is immense; and (4) attaching markers to the body may prime the nature of interactions.

Cannot find the paper you are looking for? You can Submit a new open access paper.