Search Results for author: Rahul Sukthankar

Found 45 papers, 14 papers with code

HSPACE: Synthetic Parametric Humans Animated in Complex Environments

no code implementations23 Dec 2021 Eduard Gabriel Bazavan, Andrei Zanfir, Mihai Zanfir, William T. Freeman, Rahul Sukthankar, Cristian Sminchisescu

We combine a hundred diverse individuals of varying ages, gender, proportions, and ethnicity, with hundreds of motions and scenes, as well as parametric variations in body shape (for a total of 1, 600 different humans), in order to generate an initial dataset of over 1 million frames.

3D Human Pose Estimation Scene Understanding

Semi-Supervised Learning for Multi-Task Scene Understanding by Neural Graph Consensus

3 code implementations2 Oct 2020 Marius Leordeanu, Mihai Pirvu, Dragos Costea, Alina Marcu, Emil Slusanschi, Rahul Sukthankar

The unsupervised learning process is repeated over several generations, in which each edge becomes a "student" and also part of different ensemble "teachers" for training other students.

Scene Understanding Semantic Segmentation

Speech2Action: Cross-modal Supervision for Action Recognition

no code implementations CVPR 2020 Arsha Nagrani, Chen Sun, David Ross, Rahul Sukthankar, Cordelia Schmid, Andrew Zisserman

We train a BERT-based Speech2Action classifier on over a thousand movie screenplays, to predict action labels from transcribed speech segments.

Action Recognition

Weakly Supervised 3D Human Pose and Shape Reconstruction with Normalizing Flows

no code implementations ECCV 2020 Andrei Zanfir, Eduard Gabriel Bazavan, Hongyi Xu, Bill Freeman, Rahul Sukthankar, Cristian Sminchisescu

Monocular 3D human pose and shape estimation is challenging due to the many degrees of freedom of the human body and thedifficulty to acquire training data for large-scale supervised learning in complex visual scenes.

Ranked #61 on 3D Human Pose Estimation on 3DPW (PA-MPJPE metric)

3D human pose and shape estimation Self-Supervised Learning

Selfie Drone Stick: A Natural Interface for Quadcopter Photography

no code implementations14 Sep 2019 Saif Alabachi, Gita Sukthankar, Rahul Sukthankar

This paper describes two key innovations required to deploy deep reinforcement learning models on a real robot: 1) an abstract state representation for transferring learning from simulation to the hardware platform, and 2) reward shaping and staging paradigms for training the controller.

D3D: Distilled 3D Networks for Video Action Recognition

1 code implementation19 Dec 2018 Jonathan C. Stroud, David A. Ross, Chen Sun, Jia Deng, Rahul Sukthankar

State-of-the-art methods for video action recognition commonly use an ensemble of two networks: the spatial stream, which takes RGB frames as input, and the temporal stream, which takes optical flow as input.

Action Classification Action Recognition +2

Modulated Policy Hierarchies

no code implementations30 Nov 2018 Alexander Pashevich, Danijar Hafner, James Davidson, Rahul Sukthankar, Cordelia Schmid

To achieve this, we study different modulation signals and exploration for hierarchical controllers.

Reinforcement Learning (RL)

Actor-Centric Relation Network

1 code implementation ECCV 2018 Chen Sun, Abhinav Shrivastava, Carl Vondrick, Kevin Murphy, Rahul Sukthankar, Cordelia Schmid

A visualization of the learned relation features confirms that our approach is able to attend to the relevant relations for each action.

Action Classification Action Detection +5

Object category learning and retrieval with weak supervision

1 code implementation26 Jan 2018 Steven Hickson, Anelia Angelova, Irfan Essa, Rahul Sukthankar

We consider the problem of retrieving objects from image data and learning to classify them into meaningful semantic categories with minimal supervision.

Clustering Deep Clustering +2

AVA: A Video Dataset of Spatio-temporally Localized Atomic Visual Actions

8 code implementations CVPR 2018 Chunhui Gu, Chen Sun, David A. Ross, Carl Vondrick, Caroline Pantofaru, Yeqing Li, Sudheendra Vijayanarasimhan, George Toderici, Susanna Ricco, Rahul Sukthankar, Cordelia Schmid, Jitendra Malik

The AVA dataset densely annotates 80 atomic visual actions in 430 15-minute video clips, where actions are localized in space and time, resulting in 1. 58M action labels with multiple labels per person occurring frequently.

Actin Detection Action Detection +3

WebVision Challenge: Visual Learning and Understanding With Web Data

no code implementations16 May 2017 Wen Li, Li-Min Wang, Wei Li, Eirikur Agustsson, Jesse Berent, Abhinav Gupta, Rahul Sukthankar, Luc van Gool

The 2017 WebVision challenge consists of two tracks, the image classification task on WebVision test set, and the transfer learning task on PASCAL VOC 2012 dataset.

Benchmarking Image Classification +1

Motion Prediction Under Multimodality with Conditional Stochastic Networks

no code implementations5 May 2017 Katerina Fragkiadaki, Jonathan Huang, Alex Alemi, Sudheendra Vijayanarasimhan, Susanna Ricco, Rahul Sukthankar

In this work, we present stochastic neural network architectures that handle such multimodality through stochasticity: future trajectories of objects, body joints or frames are represented as deep, non-linear transformations of random (as opposed to deterministic) variables.

motion prediction Optical Flow Estimation +2

SfM-Net: Learning of Structure and Motion from Video

no code implementations25 Apr 2017 Sudheendra Vijayanarasimhan, Susanna Ricco, Cordelia Schmid, Rahul Sukthankar, Katerina Fragkiadaki

We propose SfM-Net, a geometry-aware neural network for motion estimation in videos that decomposes frame-to-frame pixel motion in terms of scene and object depth, camera motion and 3D object rotations and translations.

Motion Estimation Object +1

Robust Adversarial Reinforcement Learning

7 code implementations ICML 2017 Lerrel Pinto, James Davidson, Rahul Sukthankar, Abhinav Gupta

Deep neural networks coupled with fast simulation and improved computation have led to recent successes in the field of reinforcement learning (RL).

Friction reinforcement-learning +1

Traffic Lights with Auction-Based Controllers: Algorithms and Real-World Data

no code implementations3 Feb 2017 Shumeet Baluja, Michele Covell, Rahul Sukthankar

Real-time optimization of traffic flow addresses important practical problems: reducing a driver's wasted time, improving city-wide efficiency, reducing gas emissions and improving air quality.

Discovering the Physical Parts of an Articulated Object Class From Multiple Videos

no code implementations CVPR 2016 Luca Del Pero, Susanna Ricco, Rahul Sukthankar, Vittorio Ferrari

We propose a motion-based method to discover the physical parts of an articulated object class (e. g. head/torso/leg of a horse) from multiple videos.

Motion Segmentation Object +1

The THUMOS Challenge on Action Recognition for Videos "in the Wild"

no code implementations21 Apr 2016 Haroon Idrees, Amir R. Zamir, Yu-Gang Jiang, Alex Gorban, Ivan Laptev, Rahul Sukthankar, Mubarak Shah

Additionally, we include a comprehensive empirical study evaluating the differences in action recognition between trimmed and untrimmed videos, and how well methods trained on trimmed videos generalize to untrimmed videos.

Action Classification Action Recognition +3

Variable Rate Image Compression with Recurrent Neural Networks

1 code implementation19 Nov 2015 George Toderici, Sean M. O'Malley, Sung Jin Hwang, Damien Vincent, David Minnen, Shumeet Baluja, Michele Covell, Rahul Sukthankar

A large fraction of Internet traffic is now driven by requests from mobile devices with relatively small screens and often stringent bandwidth requirements.

Image Compression Image Reconstruction

Coreset-Based Adaptive Tracking

no code implementations19 Nov 2015 Abhimanyu Dubey, Nikhil Naik, Dan Raviv, Rahul Sukthankar, Ramesh Raskar

We propose a method for learning from streaming visual data using a compact, constant size representation of all the data that was seen until a given moment.

Object Object Tracking

MatchNet: Unifying Feature and Metric Learning for Patch-Based Matching

2 code implementations CVPR 2015 Xufeng Han, Thomas Leung, Yangqing Jia, Rahul Sukthankar, Alexander C. Berg

We perform a comprehensive set of experiments on standard datasets to carefully study the contributions of each aspect of MatchNet, with direct comparisons to established methods.

Computational Efficiency Metric Learning +1

Temporal Localization of Fine-Grained Actions in Videos by Domain Transfer from Web Images

1 code implementation4 Apr 2015 Chen Sun, Sanketh Shetty, Rahul Sukthankar, Ram Nevatia

To solve this problem, we propose a simple yet effective method that takes weak video labels and noisy image labels as input, and generates localized action frames as output.

Action Recognition Temporal Action Localization +1

Recovering Spatiotemporal Correspondence between Deformable Objects by Exploiting Consistent Foreground Motion in Video

no code implementations1 Dec 2014 Luca Del Pero, Susanna Ricco, Rahul Sukthankar, Vittorio Ferrari

Given unstructured videos of deformable objects, we automatically recover spatiotemporal correspondences to map one object to another (such as animals in the wild).


Articulated motion discovery using pairs of trajectories

no code implementations CVPR 2015 Luca Del Pero, Susanna Ricco, Rahul Sukthankar, Vittorio Ferrari

We propose an unsupervised approach for discovering characteristic motion patterns in videos of highly articulated objects performing natural, unscripted behaviors, such as tigers in the wild.

Features in Concert: Discriminative Feature Selection meets Unsupervised Clustering

no code implementations27 Nov 2014 Marius Leordeanu, Alexandra Radu, Rahul Sukthankar

Feature selection is an essential problem in computer vision, important for category learning and recognition.

Clustering feature selection

Large-Scale Video Classification with Convolutional Neural Networks

1 code implementation 2014 IEEE Conference on Computer Vision and Pattern Recognition 2014 Andrej Karpathy, George Toderici, Sanketh Shetty, Thomas Leung, Rahul Sukthankar, Li Fei-Fei

We further study the generalization performance of our best model by retraining the top layers on the UCF-101 Action Recognition dataset and observe significant performance improvements compared to the UCF-101 baseline model (63. 3% up from 43. 9%).

Action Recognition Classification +3

Recognition of Complex Events: Exploiting Temporal Dynamics between Underlying Concepts

no code implementations CVPR 2014 Subhabrata Bhattacharya, Mahdi M. Kalayeh, Rahul Sukthankar, Mubarak Shah

While approaches based on bags of features excel at low-level action classification, they are ill-suited for recognizing complex events in video, where concept-based temporal representations currently dominate.

Action Classification Event Detection +3

Thoughts on a Recursive Classifier Graph: a Multiclass Network for Deep Object Recognition

no code implementations2 Apr 2014 Marius Leordeanu, Rahul Sukthankar

In this manner we can learn and grow both a deep, complex graph of classifiers and a rich pool of features at different levels of abstraction and interpretation.

Object Recognition

Spatiotemporal Deformable Part Models for Action Detection

no code implementations CVPR 2013 Yicong Tian, Rahul Sukthankar, Mubarak Shah

Deformable part models have achieved impressive performance for object detection, even on difficult image datasets.

Action Detection object-detection +1

Discriminative Segment Annotation in Weakly Labeled Video

no code implementations CVPR 2013 Kevin Tang, Rahul Sukthankar, Jay Yagnik, Li Fei-Fei

Second, we ensure that CRANE is robust to label noise, both in terms of tagged videos that fail to contain the concept as well as occasional negative videos that do.

An Integer Projected Fixed Point Method for Graph Matching and MAP Inference

no code implementations NeurIPS 2009 Marius Leordeanu, Martial Hebert, Rahul Sukthankar

When applied to MAP inference, the algorithm is a parallel extension of Iterated Conditional Modes (ICM) with climbing and convergence properties that make it a compelling alternative to the sequential ICM.

Graph Matching

Semi-supervised Learning with Weakly-Related Unlabeled Data : Towards Better Text Categorization

no code implementations NeurIPS 2008 Liu Yang, Rong Jin, Rahul Sukthankar

For empirical evaluation, we present a direct comparison with a number of state-of-the-art methods for inductive semi-supervised learning and text categorization; and we show that SSLW results in a significant improvement in categorization accuracy, equipped with a small training set and an unlabeled resource that is weakly related to the test beds."

General Classification Text Categorization

Cannot find the paper you are looking for? You can Submit a new open access paper.