Search Results for author: Somdeb Majumdar

Found 15 papers, 6 papers with code

Safety Aware Reinforcement Learning (SARL)

no code implementations6 Oct 2020 Santiago Miret, Somdeb Majumdar, Carroll Wainwright

Since the safe agent effectively abstracts a task-independent notion of safety via its action probabilities, it can be ported to modulate multiple policies solving different tasks within the given environment without further training.

reinforcement-learning Reinforcement Learning (RL)

Dream and Search to Control: Latent Space Planning for Continuous Control

1 code implementation19 Oct 2020 Anurag Koul, Varun V. Kumar, Alan Fern, Somdeb Majumdar

Learning and planning with latent space dynamics has been shown to be useful for sample efficiency in model-based reinforcement learning (MBRL) for discrete and continuous control tasks.

Continuous Control Model-based Reinforcement Learning +1

On Local Aggregation in Heterophilic Graphs

no code implementations6 Jun 2021 Hesham Mostafa, Marcel Nassar, Somdeb Majumdar

We also show that homophily is a poor measure of the information in a node's local neighborhood and propose the Neighborhood Information Content(NIC) metric, which is a novel information-theoretic graph metric.

Node Classification

Neuroevolution-Enhanced Multi-Objective Optimization for Mixed-Precision Quantization

no code implementations14 Jun 2021 Santiago Miret, Vui Seng Chua, Mattias Marder, Mariano Phielipp, Nilesh Jain, Somdeb Majumdar

In this work, we present a flexible and scalable framework for automated mixed-precision quantization that concurrently optimizes task performance, memory compression, and compute savings through multi-objective evolutionary computing.

Quantization

Learning Spatial-Temporal Graphs for Active Speaker Detection

no code implementations2 Dec 2021 Sourya Roy, Kyle Min, Subarna Tripathi, Tanaya Guha, Somdeb Majumdar

We address the problem of active speaker detection through a new framework, called SPELL, that learns long-range multimodal graphs to encode the inter-modal relationship between audio and visual data.

Audio-Visual Active Speaker Detection Node Classification

Exploiting Long-Term Dependencies for Generating Dynamic Scene Graphs

1 code implementation18 Dec 2021 Shengyu Feng, Subarna Tripathi, Hesham Mostafa, Marcel Nassar, Somdeb Majumdar

Dynamic scene graph generation from a video is challenging due to the temporal dynamics of the scene and the inherent temporal fluctuations of predictions.

Graph Generation Object +3

Joint Hand Motion and Interaction Hotspots Prediction from Egocentric Videos

1 code implementation CVPR 2022 Shaowei Liu, Subarna Tripathi, Somdeb Majumdar, Xiaolong Wang

To tackle this task, we first provide an automatic way to collect trajectory and hotspots labels on large-scale data.

Object

Learning Long-Term Spatial-Temporal Graphs for Active Speaker Detection

2 code implementations15 Jul 2022 Kyle Min, Sourya Roy, Subarna Tripathi, Tanaya Guha, Somdeb Majumdar

Active speaker detection (ASD) in videos with multiple speakers is a challenging task as it requires learning effective audiovisual features and spatial-temporal correlations over long temporal windows.

Audio-Visual Active Speaker Detection Graph Learning +1

Cannot find the paper you are looking for? You can Submit a new open access paper.