Search Results for author: Akshat Kumar

Found 21 papers, 9 papers with code

A Factored MDP Approach To Moving Target Defense With Dynamic Threat Modeling and Cost Efficiency

1 code implementation16 Aug 2024 Megha Bose, Praveen Paruchuri, Akshat Kumar

Moving Target Defense (MTD) has emerged as a proactive and dynamic framework to counteract evolving cyber threats.

Leveraging AI Planning For Detecting Cloud Security Vulnerabilities

no code implementations16 Feb 2024 Mikhail Kazdagli, Mohit Tiwari, Akshat Kumar

A planner can then generate attacks to identify such vulnerabilities in the cloud.

Cloud Computing

FlowPG: Action-constrained Policy Gradient with Normalizing Flows

1 code implementation NeurIPS 2023 Janaka Chathuranga Brahmanage, Jiajing Ling, Akshat Kumar

To address this, first we use a normalizing flow model to learn an invertible, differentiable mapping between the feasible action space and the support of a simple distribution on a latent variable, such as Gaussian.

Continuous Control Decision Making +1

Unified Training of Universal Time Series Forecasting Transformers

1 code implementation4 Feb 2024 Gerald Woo, Chenghao Liu, Akshat Kumar, Caiming Xiong, Silvio Savarese, Doyen Sahoo

Deep learning for time series forecasting has traditionally operated within a one-model-per-dataset framework, limiting its potential to leverage the game-changing impact of large pre-trained models.

Time Series Time Series Forecasting

Safe MDP Planning by Learning Temporal Patterns of Undesirable Trajectories and Averting Negative Side Effects

1 code implementation6 Apr 2023 Siow Meng Low, Akshat Kumar, Scott Sanner

In safe MDP planning, a cost function based on the current state and action is often used to specify safety aspects.

Shining light on data: Geometric data analysis through quantum dynamics

no code implementations1 Dec 2022 Akshat Kumar, Mohan Sarovar

Experimental sciences have come to depend heavily on our ability to organize and interpret high-dimensional datasets.

Dimensionality Reduction Quantization

Learning Deep Time-index Models for Time Series Forecasting

1 code implementation13 Jul 2022 Gerald Woo, Chenghao Liu, Doyen Sahoo, Akshat Kumar, Steven Hoi

Deep learning has been actively applied to time series forecasting, leading to a deluge of new methods, belonging to the class of historical-value models.

Inductive Bias Meta-Learning +2

Sample-efficient Iterative Lower Bound Optimization of Deep Reactive Policies for Planning in Continuous MDPs

no code implementations23 Mar 2022 Siow Meng Low, Akshat Kumar, Scott Sanner

This novel formulation of DRP learning as iterative lower bound optimization (ILBO) is particularly appealing because (i) each step is structurally easier to optimize than the overall objective, (ii) it guarantees a monotonically improving objective under certain theoretical conditions, and (iii) it reuses samples between iterations thus lowering sample complexity.

InfraredTags: Embedding Invisible AR Markers and Barcodes Using Low-Cost, Infrared-Based 3D Printing and Imaging Tools

no code implementations12 Feb 2022 Mustafa Doga Dogan, Ahmad Taka, Michael Lu, Yunyi Zhu, Akshat Kumar, Aakar Gupta, Stefanie Mueller

We present InfraredTags, which are 2D markers and barcodes imperceptible to the naked eye that can be 3D printed as part of objects, and detected rapidly by low-cost near-infrared cameras.

Object Tracking

CoST: Contrastive Learning of Disentangled Seasonal-Trend Representations for Time Series Forecasting

1 code implementation ICLR 2022 Gerald Woo, Chenghao Liu, Doyen Sahoo, Akshat Kumar, Steven Hoi

Motivated by the recent success of representation learning in computer vision and natural language processing, we argue that a more promising paradigm for time series forecasting, is to first learn disentangled feature representations, followed by a simple regression fine-tuning step -- we justify such a paradigm from a causal perspective.

Contrastive Learning Representation Learning +2

Manifold learning via quantum dynamics

no code implementations20 Dec 2021 Akshat Kumar, Mohan Sarovar

We introduce an algorithm for computing geodesics on sampled manifolds that relies on simulation of quantum dynamics on a graph embedding of the sampled data.

Clustering Dimensionality Reduction +2

Combining Propositional Logic Based Decision Diagrams with Decision Making in Urban Systems

no code implementations9 Nov 2020 Jiajing Ling, Kushagra Chandak, Akshat Kumar

Solving multiagent problems can be an uphill task due to uncertainty in the environment, partial observability, and scalability of the problem at hand.

Decision Making reinforcement-learning +1

Resource Constrained Deep Reinforcement Learning

no code implementations3 Dec 2018 Abhinav Bhatia, Pradeep Varakantham, Akshat Kumar

However, existing Deep RL methods are unable to handle combinatorial action spaces and constraints on allocation of resources.

Management reinforcement-learning +2

Credit Assignment For Collective Multiagent RL With Global Rewards

no code implementations NeurIPS 2018 Duc Thien Nguyen, Akshat Kumar, Hoong Chuin Lau

Scaling decision theoretic planning to large multiagent systems is challenging due to uncertainty and partial observability in the environment.

Robust Optimization for Tree-Structured Stochastic Network Design

no code implementations1 Dec 2016 Xiaojian Wu, Akshat Kumar, Daniel Sheldon, Shlomo Zilberstein

We therefore address the robust river network design problem where the goal is to optimize river connectivity for fish movement by removing barriers.

MAP Estimation for Graphical Models by Likelihood Maximization

no code implementations NeurIPS 2010 Akshat Kumar, Shlomo Zilberstein

We experiment on the real-world protein design dataset and show that EM's convergence rate is significantly higher than the previous LP relaxation based approach MPLP.

Protein Design

Cannot find the paper you are looking for? You can Submit a new open access paper.