Search Results for author: Vivek Sharma

Found 34 papers, 8 papers with code

Physically Disentangled Representations

1 code implementation11 Apr 2022 Tzofi Klinghoffer, Kushagra Tiwary, Arkadiusz Balata, Vivek Sharma, Ramesh Raskar

In this paper, we show the utility of inverse rendering in learning representations that yield improved accuracy on downstream clustering, linear classification, and segmentation tasks with the help of our novel Leave-One-Out, Cycle Contrastive loss (LOOCC), which improves disentanglement of scene parameters and robustness to out-of-distribution lighting and viewpoints.

Classification Disentanglement +1

Learning to Censor by Noisy Sampling

no code implementations23 Mar 2022 Ayush Chopra, Abhinav Java, Abhishek Singh, Vivek Sharma, Ramesh Raskar

The goal of this work is to protect sensitive information when learning from point clouds; by censoring the sensitive information before the point cloud is released for downstream tasks.

Decouple-and-Sample: Protecting sensitive information in task agnostic data release

no code implementations17 Mar 2022 Abhishek Singh, Ethan Garza, Ayush Chopra, Praneeth Vepakomma, Vivek Sharma, Ramesh Raskar

While releasing datasets continues to make a big impact in various applications of computer vision, its impact is mostly realized when data sharing is not inhibited by privacy concerns.

AdaSplit: Adaptive Trade-offs for Resource-constrained Distributed Deep Learning

no code implementations2 Dec 2021 Ayush Chopra, Surya Kant Sahu, Abhishek Singh, Abhinav Java, Praneeth Vepakomma, Vivek Sharma, Ramesh Raskar

In this work, we introduce AdaSplit which enables efficiently scaling SL to low resource scenarios by reducing bandwidth consumption and improving performance across heterogeneous clients.

Federated Learning

Sanitizer: Sanitizing data for anonymizing sensitive information

no code implementations29 Sep 2021 Abhishek Singh, Ethan Garza, Ayush Chopra, Praneeth Vepakomma, Vivek Sharma, Ramesh Raskar

This is done in a two-step process: first, we develop a method that encodes unstructured image-like modality into a structured representation bifurcated by sensitive and non-sensitive representation.

Temporally-Weighted Hierarchical Clustering for Unsupervised Action Segmentation

1 code implementation CVPR 2021 M. Saquib Sarfraz, Naila Murray, Vivek Sharma, Ali Diba, Luc van Gool, Rainer Stiefelhagen

Action segmentation refers to inferring boundaries of semantically consistent visual concepts in videos and is an important requirement for many video understanding tasks.

 Ranked #1 on Action Segmentation on Breakfast (mIoU metric)

Action Segmentation Video Understanding

Vi2CLR: Video and Image for Visual Contrastive Learning of Representation

no code implementations ICCV 2021 Ali Diba, Vivek Sharma, Reza Safdari, Dariush Lotfi, Saquib Sarfraz, Rainer Stiefelhagen, Luc van Gool

In this paper, we introduce a novel self-supervised visual representation learning method which understands both images and videos in a joint learning fashion.

Action Recognition Contrastive Learning +1

SplitNN-driven Vertical Partitioning

no code implementations7 Aug 2020 Iker Ceballos, Vivek Sharma, Eduardo Mugica, Abhishek Singh, Alberto Roman, Praneeth Vepakomma, Ramesh Raskar

In this work, we introduce SplitNN-driven Vertical Partitioning, a configuration of a distributed deep learning method called SplitNN to facilitate learning from vertically distributed features.

Deep Multimodal Feature Encoding for Video Ordering

1 code implementation5 Apr 2020 Vivek Sharma, Makarand Tapaswi, Rainer Stiefelhagen

True understanding of videos comes from a joint analysis of all its modalities: the video frames, the audio track, and any accompanying text such as closed captions.

Action Recognition

ExpertMatcher: Automating ML Model Selection for Clients using Hidden Representations

no code implementations9 Oct 2019 Vivek Sharma, Praneeth Vepakomma, Tristan Swedish, Ken Chang, Jayashree Kalpathy-Cramer, Ramesh Raskar

Recently, there has been the development of Split Learning, a framework for distributed computation where model components are split between the client and server (Vepakomma et al., 2018b).

Model Selection

DynamoNet: Dynamic Action and Motion Network

no code implementations ICCV 2019 Ali Diba, Vivek Sharma, Luc van Gool, Rainer Stiefelhagen

With these overall objectives, to this end, we introduce a novel unified spatio-temporal 3D-CNN architecture (DynamoNet) that jointly optimizes the video classification and learning motion representation by predicting future frames as a multi-task learning problem.

Action Recognition Classification +5

Large Scale Holistic Video Understanding

1 code implementation ECCV 2020 Ali Diba, Mohsen Fayyaz, Vivek Sharma, Manohar Paluri, Jurgen Gall, Rainer Stiefelhagen, Luc van Gool

HVU is organized hierarchically in a semantic taxonomy that focuses on multi-label and multi-task video understanding as a comprehensive problem that encompasses the recognition of multiple semantic aspects in the dynamic scene.

Action Classification Action Recognition +7

Efficient Parameter-free Clustering Using First Neighbor Relations

1 code implementation28 Feb 2019 M. Saquib Sarfraz, Vivek Sharma, Rainer Stiefelhagen

We present a new clustering method in the form of a single clustering equation that is able to directly discover groupings in the data.

Can Image Enhancement be Beneficial to Find Smoke Images in Laparoscopic Surgery?

no code implementations27 Dec 2018 Congcong Wang, Vivek Sharma, Yu Fan, Faouzi Alaya Cheikh, Azeddine Beghdadi, Ole Jacob Elle, Rainer Stiefelhagen

For feature extraction, we use statistical features based on bivariate histogram distribution of gradient magnitude~(GM) and Laplacian of Gaussian~(LoG).

General Classification Image Enhancement

Compression of Deep Neural Networks by combining pruning and low rank decomposition

no code implementations20 Oct 2018 Saurabh Goyal, Anamitra R Choudhury, Vivek Sharma, Yogish Sabharwal, Ashish Verma

Large number of weights in deep neural networks make the models difficult to be deployed in low memory environments such as, mobile phones, IOT edge devices as well as "inferencing as a service" environments on the cloud.

Model Compression

Spatio-Temporal Channel Correlation Networks for Action Classification

no code implementations ECCV 2018 Ali Diba, Mohsen Fayyaz, Vivek Sharma, M. Mahdi Arzani, Rahman Yousefzadeh, Juergen Gall, Luc van Gool

Our experiments show that adding STC blocks to current state-of-the-art architectures outperforms the state-of-the-art methods on the HMDB51, UCF101 and Kinetics datasets.

Action Classification Classification +1

Classification-Driven Dynamic Image Enhancement

no code implementations CVPR 2018 Vivek Sharma, Ali Diba, Davy Neven, Michael S. Brown, Luc van Gool, Rainer Stiefelhagen

In this paper, we are interested in learning CNNs that can emulate image enhancement and restoration, but with the overall goal to improve image classification and not necessarily human perception.

Classification General Classification +3

Temporal 3D ConvNets: New Architecture and Transfer Learning for Video Classification

3 code implementations22 Nov 2017 Ali Diba, Mohsen Fayyaz, Vivek Sharma, Amir Hossein Karami, Mohammad Mahdi Arzani, Rahman Yousefzadeh, Luc van Gool

Thus, by finetuning this network, we beat the performance of generic and recent methods in 3D CNNs, which were trained on large video datasets, e. g. Sports-1M, and finetuned on the target datasets, e. g. HMDB51/UCF101.

Action Recognition General Classification +3

Weakly Supervised Object Discovery by Generative Adversarial & Ranking Networks

no code implementations22 Nov 2017 Ali Diba, Vivek Sharma, Rainer Stiefelhagen, Luc van Gool

We approach GANs with a novel training method and learning objective, to discover multiple object instances for three cases: 1) synthesizing a picture of a specific object within a cluttered scene; 2) localizing different categories in images for weakly supervised object detection; and 3) improving object discov- ery in object detection pipelines.

object-detection Object Discovery +1

Classification Driven Dynamic Image Enhancement

no code implementations20 Oct 2017 Vivek Sharma, Ali Diba, Davy Neven, Michael S. Brown, Luc van Gool, Rainer Stiefelhagen

In this paper, we are interested in learning CNNs that can emulate image enhancement and restoration, but with the overall goal to improve image classification and not necessarily human perception.

Classification General Classification +3

Weakly Supervised Cascaded Convolutional Networks

no code implementations CVPR 2017 Ali Diba, Vivek Sharma, Ali Pazandeh, Hamed Pirsiavash, Luc van Gool

The final stage of both architectures is a part of a convolutional neural network that performs multiple instance learning on proposals extracted in the previous stage(s).

Multiple Instance Learning object-detection +2

Deep Temporal Linear Encoding Networks

2 code implementations CVPR 2017 Ali Diba, Vivek Sharma, Luc van Gool

Advantages of TLEs are: (a) they encode the entire video into a compact feature representation, learning the semantics and a discriminative feature space; (b) they are applicable to all kinds of networks like 2D and 3D CNNs for video classification; and (c) they model feature interactions in a more expressive way and without loss of information.

Representation Learning Video Classification

Does V-NIR based Image Enhancement Come with Better Features?

no code implementations23 Aug 2016 Vivek Sharma, Luc van Gool

Image enhancement using the visible (V) and near-infrared (NIR) usually enhances useful image details.

Image Enhancement

Low-Cost Scene Modeling using a Density Function Improves Segmentation Performance

no code implementations26 May 2016 Vivek Sharma, Sule Yildirim-Yayilgan, Luc van Gool

We propose a low cost and effective way to combine a free simulation software and free CAD models for modeling human-object interaction in order to improve human & object segmentation.

Human-Object Interaction Detection Semantic Segmentation

Cannot find the paper you are looking for? You can Submit a new open access paper.