Search Results for author: Mohit Gupta

Found 35 papers, 5 papers with code

Inertial Safety from Structured Light

no code implementations ECCV 2020 Sizhuo Ma, Mohit Gupta

We present inertial safety maps (ISM), a novel scene representation designed for fast detection of obstacles in scenarios involving camera or scene motion, such as robot navigation and human-robot interaction.

Robot Navigation

Towards 3D Vision with Low-Cost Single-Photon Cameras

no code implementations26 Mar 2024 Fangzhou Mu, Carter Sifferman, Sacha Jungerman, Yiquan Li, Mark Han, Michael Gleicher, Mohit Gupta, Yin Li

We present a method for reconstructing 3D shape of arbitrary Lambertian objects based on measurements by miniature, energy-efficient, low-cost single-photon cameras.

3D Object Reconstruction Neural Rendering

Panoramas from Photons

no code implementations ICCV 2023 Sacha Jungerman, Atul Ingle, Mohit Gupta

Here we present a method capable of estimating extreme scene motion under challenging conditions, such as low light or high dynamic range, from a sequence of high-speed image frames such as those captured by a single-photon camera.

Drone navigation Motion Estimation +1

SoDaCam: Software-defined Cameras via Single-Photon Imaging

no code implementations ICCV 2023 Varun Sundar, Andrei Ardelean, Tristan Swedish, Claudio Bruschini, Edoardo Charbon, Mohit Gupta

As an added benefit, our projections provide camera-dependent compression of photon-cubes, which we demonstrate using an implementation of our projections on a novel compute architecture that is designed for single-photon imaging.

Unlocking the Performance of Proximity Sensors by Utilizing Transient Histograms

no code implementations25 Aug 2023 Carter Sifferman, Yeping Wang, Mohit Gupta, Michael Gleicher

To validate our methods, we capture 3, 800 measurements of eight planar surfaces from a wide range of viewpoints, and show that our method outperforms the proprietary-distance-estimate baseline by an order of magnitude in most scenarios.

Eventful Transformers: Leveraging Temporal Redundancy in Vision Transformers

1 code implementation ICCV 2023 Matthew Dutson, Yin Li, Mohit Gupta

In this work, we exploit temporal redundancy between subsequent inputs to reduce the cost of Transformers for video processing.

Action Recognition Video Object Detection +1

Image Manipulation via Multi-Hop Instructions -- A New Dataset and Weakly-Supervised Neuro-Symbolic Approach

no code implementations23 May 2023 Harman Singh, Poorva Garg, Mohit Gupta, Kevin Shah, Ashish Goswami, Satyam Modi, Arnab Kumar Mondal, Dinesh Khandelwal, Dinesh Garg, Parag Singla

We are interested in image manipulation via natural language text -- a task that is useful for multiple AI applications but requires complex reasoning over multi-modal spaces.

Image Manipulation Question Answering +1

Computational 3D Imaging with Position Sensors

no code implementations ICCV 2023 Jeremy Klotz, Mohit Gupta, Aswin C. Sankaranarayanan

We present a structured light system based on position sensing diodes (PSDs), an unconventional sensing modality that directly measures the centroid of the spatial distribution of incident light, thus enabling high-resolution 3D laser scanning with a minimal amount of sensor data.

Position

Eulerian Single-Photon Vision

no code implementations ICCV 2023 Shantanu Gupta, Mohit Gupta

Previous work has largely focused on solving the image reconstruction problem first and then using off-the-shelf methods for downstream tasks, but the most general solutions that account for motion are costly and not scalable to large data volumes produced by single-photon sensors.

Edge Detection Image Reconstruction +1

3D Scene Inference from Transient Histograms

no code implementations9 Nov 2022 Sacha Jungerman, Atul Ingle, Yin Li, Mohit Gupta

Time-resolved image sensors that capture light at pico-to-nanosecond timescales were once limited to niche applications but are now rapidly becoming mainstream in consumer devices.

PICO

Robust Scene Inference under Noise-Blur Dual Corruptions

no code implementations24 Jul 2022 Bhavya Goyal, Jean-François Lalonde, Yin Li, Mohit Gupta

This creates a trade-off between these two kinds of image degradations: motion blur (due to long exposure) vs. noise (due to short exposure), also referred as a dual image corruption pair in this paper.

Image Classification object-detection +1

Single-Photon Structured Light

no code implementations CVPR 2022 Varun Sundar, Sizhuo Ma, Aswin C. Sankaranarayanan, Mohit Gupta

We present a novel structured light technique that uses Single Photon Avalanche Diode (SPAD) arrays to enable 3D scanning at high-frame rates and low-light levels.

Temporal Sequences

Banana Sub-Family Classification and Quality Prediction using Computer Vision

no code implementations6 Apr 2022 Narayana Darapaneni, Arjun Tanndalam, Mohit Gupta, Neeta Taneja, Prabu Purushothaman, Swati Eswar, Anwesh Reddy Paduri, Thangaselvi Arichandrapandian

India is the second largest producer of fruits and vegetables in the world, and one of the largest consumers of fruits like Banana, Papaya and Mangoes through retail and ecommerce giants like BigBasket, Grofers and Amazon Fresh.

Classification Data Augmentation +3

Compressive Single-Photon 3D Cameras

no code implementations CVPR 2022 Felipe Gutierrez-Barragan, Atul Ingle, Trevor Seets, Mohit Gupta, Andreas Velten

CSPHs are a per-pixel compressive representation of the high-resolution histogram, that is built on-the-fly, as each photon is detected.

Event Neural Networks

2 code implementations2 Dec 2021 Matthew Dutson, Yin Li, Mohit Gupta

Video data is often repetitive; for example, the contents of adjacent frames are usually strongly correlated.

2D Human Pose Estimation Image Enhancement +2

Photon-Starved Scene Inference using Single Photon Cameras

1 code implementation ICCV 2021 Bhavya Goyal, Mohit Gupta

The key idea is that having a spectrum of different brightness levels during training enables effective guidance, and increases robustness to shot noise even in extreme noise cases.

Image Classification Monocular Depth Estimation +1

Blocks-World Cameras

no code implementations CVPR 2021 Jongho Lee, Mohit Gupta

For several vision and robotics applications, 3D geometry of man-made environments such as indoor scenes can be represented with a small number of dominant planes.

Music Generation using Three-layered LSTM

no code implementations19 May 2021 Vaishali Ingale, Anush Mohan, Divit Adlakha, Krishan Kumar, Mohit Gupta

This paper explores the idea of utilising Long Short-Term Memory neural networks (LSTMNN) for the generation of musical sequences in ABC notation.

Music Generation

Passive Inter-Photon Imaging

no code implementations CVPR 2021 Atul Ingle, Trevor Seets, Mauro Buttafava, Shantanu Gupta, Alberto Tosi, Mohit Gupta, Andreas Velten

Digital camera pixels measure image intensities by converting incident light energy into an analog electrical current, and then digitizing it into a fixed-width binary representation.

Astronomy

iToF2dToF: A Robust and Flexible Representation for Data-Driven Time-of-Flight Imaging

no code implementations12 Mar 2021 Felipe Gutierrez-Barragan, Huaijin Chen, Mohit Gupta, Andreas Velten, Jinwei Gu

Recently, data-driven methods that jointly denoise and mitigate MPI have become state-of-the-art without using the intermediate transient representation.

Denoising

Invisible Perturbations: Physical Adversarial Examples Exploiting the Rolling Shutter Effect

2 code implementations CVPR 2021 Athena Sayles, Ashish Hooda, Mohit Gupta, Rahul Chatterjee, Earlence Fernandes

By contrast, we contribute a procedure to generate, for the first time, physical adversarial examples that are invisible to human eyes.

Object

Quanta Burst Photography

no code implementations21 Jun 2020 Sizhuo Ma, Shantanu Gupta, Arin C. Ulku, Claudio Bruschini, Edoardo Charbon, Mohit Gupta

These single-photon cameras (SPCs) are capable of capturing high-speed sequences of binary single-photon images with no read noise.

Asynchronous Single-Photon 3D Imaging

no code implementations ICCV 2019 Anant Gupta, Atul Ingle, Mohit Gupta

Single-photon avalanche diodes (SPADs) are becoming popular in time-of-flight depth-ranging due to their unique ability to capture individual photons with picosecond timing resolution.

Differential Scene Flow from Light Field Gradients

no code implementations26 Jul 2019 Sizhuo Ma, Brandon M. Smith, Mohit Gupta

The key enabling result is a per-ray linear equation, called the ray flow equation, that relates 3D scene flow to 4D light field gradients.

Optical Flow Estimation

Photon-Flooded Single-Photon 3D Cameras

no code implementations CVPR 2019 Anant Gupta, Atul Ingle, Andreas Velten, Mohit Gupta

Single photon avalanche diodes (SPADs) are starting to play a pivotal role in the development of photon-efficient, long-range LiDAR systems.

High Flux Passive Imaging with Single-Photon Sensors

no code implementations CVPR 2019 Atul Ingle, Andreas Velten, Mohit Gupta

Our key observation is that the precise inter-photon timing measured by a SPAD can be used for estimating scene brightness under ambient lighting conditions, even for very bright scenes.

Vocal Bursts Intensity Prediction

A Geometric Perspective on Structured Light Coding

no code implementations ECCV 2018 Mohit Gupta, Nikhil Nakhate

We present a mathematical framework for analysis and design of high performance structured light (SL) coding schemes.

3D Scene Flow from 4D Light Field Gradients

no code implementations ECCV 2018 Sizhuo Ma, Brandon M. Smith, Mohit Gupta

The key enabling result is a per-ray linear equation, called the ray flow equation, that relates 3D scene flow to 4D light field gradients.

Optical Flow Estimation

Trapping Light for Time of Flight

no code implementations CVPR 2018 Ruilin Xu, Mohit Gupta, Shree K. Nayar

We propose a novel imaging method for near-complete, surround, 3D reconstruction of geometrically complex objects, in a single shot.

3D Reconstruction

Tracking Multiple Objects Outside the Line of Sight Using Speckle Imaging

no code implementations CVPR 2018 Brandon M. Smith, Matthew O'Toole, Mohit Gupta

However, when imaging multiple NLOS objects, the speckle components due to different objects are superimposed on the virtual bare sensor image, and cannot be analyzed separately for recovering the motion of individual objects.

Clustering Motion Estimation

SpeDo: 6 DOF Ego-Motion Sensor Using Speckle Defocus Imaging

no code implementations ICCV 2015 Kensei Jo, Mohit Gupta, Shree K. Nayar

We develop a theoretical model for speckle flow (motion of speckle as a function of sensor motion), and show that it is quasi-invariant to surrounding scene's properties.

Motion Estimation Optical Flow Estimation +1

LiSens --- A Scalable Architecture for Video Compressive Sensing

1 code implementation14 Mar 2015 Jian Wang, Mohit Gupta, Aswin C. Sankaranarayanan

The measurement rate of cameras that take spatially multiplexed measurements by using spatial light modulators (SLM) is often limited by the switching speed of the SLMs.

Compressive Sensing Video Compressive Sensing

Cannot find the paper you are looking for? You can Submit a new open access paper.