Search Results for author: Melkior Ornik

Found 20 papers, 2 papers with code

Guaranteed Reachability on Riemannian Manifolds for Unknown Nonlinear Systems

no code implementations15 Apr 2024 Taha Shafa, Melkior Ornik

The results are general enough to apply on systems that operate on any complete Riemannian manifold.

Trajectory Planning

Hallucination Detection in Foundation Models for Decision-Making: A Flexible Definition and Review of the State of the Art

no code implementations25 Mar 2024 Neeloy Chakraborty, Melkior Ornik, Katherine Driggs-Campbell

The rise of foundation models trained on multiple tasks with impressively large datasets from a variety of fields has led researchers to believe that these models may provide common sense reasoning that existing planners are missing.

Common Sense Reasoning Decision Making +1

A Moral Imperative: The Need for Continual Superalignment of Large Language Models

no code implementations13 Mar 2024 Gokul Puthumanaillam, Manav Vora, Pranay Thangeda, Melkior Ornik

This paper examines the challenges associated with achieving life-long superalignment in AI systems, particularly large language models (LLMs).

Ethics

ComTraQ-MPC: Meta-Trained DQN-MPC Integration for Trajectory Tracking with Limited Active Localization Updates

no code implementations3 Mar 2024 Gokul Puthumanaillam, Manav Vora, Melkior Ornik

Optimal decision-making for trajectory tracking in partially observable, stochastic environments where the number of active localization updates -- the process by which the agent obtains its true state information from the sensors -- are limited, presents a significant challenge.

Decision Making Model Predictive Control +1

Weathering Ongoing Uncertainty: Learning and Planning in a Time-Varying Partially Observable Environment

no code implementations6 Dec 2023 Gokul Puthumanaillam, Xiangyu Liu, Negar Mehr, Melkior Ornik

Optimal decision-making presents a significant challenge for autonomous systems operating in uncertain, stochastic and time-varying environments.

Decision Making

Viability under Degraded Control Authority

no code implementations23 Oct 2023 Hamza El-Kebir, Richard Berlin, Joseph Bentsman, Melkior Ornik

In this work, we solve the problem of quantifying and mitigating control authority degradation in real time.

Identifying Single-Input Linear System Dynamics from Reachable Sets

no code implementations8 Sep 2023 Taha Shafa, Roy Dong, Melkior Ornik

This paper is concerned with identifying linear system dynamics without the knowledge of individual system trajectories, but from the knowledge of the system's reachable sets observed at different times.

Losing Control of your Network? Try Resilience Theory

1 code implementation28 Jun 2023 Jean-Baptiste Bouvier, Sai Pushpak Nandanoori, Melkior Ornik

To assess system vulnerability, we establish resilience conditions for networks with a subsystem enduring a loss of control authority over some of its actuators.

Delayed resilient trajectory tracking after partial loss of control authority over actuators

1 code implementation22 Mar 2023 Jean-Baptiste Bouvier, Himmat Panag, Robyn Woollands, Melkior Ornik

After the loss of control authority over thrusters of the Nauka module, the International Space Station lost attitude control for 45 minutes with potentially disastrous consequences.

Welfare Maximization Algorithm for Solving Budget-Constrained Multi-Component POMDPs

no code implementations18 Mar 2023 Manav Vora, Pranay Thangeda, Michael N. Grussing, Melkior Ornik

Motivated by the problem of maintenance and inspection of a group of infrastructure components with independent dynamics, this paper presents an algorithm to find the optimal policy for a multi-component budget-constrained POMDP.

Decision Making

Resilience of Linear Systems to Partial Loss of Control Authority

no code implementations16 Sep 2022 Jean-Baptiste Bouvier, Melkior Ornik

Relying on Lyapunov theory we derive analytical bounds on the reach times of the nominal and malfunctioning systems in order to quantify their resilience.

Quantitative Resilience of Linear Systems

no code implementations28 Jan 2022 Jean-Baptiste Bouvier, Melkior Ornik

Actuator malfunctions may have disastrous consequences for systems not designed to mitigate them.

Quantitative Resilience of Generalized Integrators

no code implementations7 Nov 2021 Jean-Baptiste Bouvier, Kathleen Xu, Melkior Ornik

By definition, a system is resilient if it can still reach a target after a partial loss of control authority.

Efficient Strategy Synthesis for MDPs with Resource Constraints

no code implementations5 May 2021 František Blahoudek, Petr Novotný, Melkior Ornik, Pranay Thangeda, Ufuk Topcu

We consider qualitative strategy synthesis for the formalism called consumption Markov decision processes.

Quantitative Resilience of Linear Driftless Systems

no code implementations28 Jan 2021 Jean-Baptiste Bouvier, Kathleen Xu, Melkior Ornik

By definition, a system is resilient if it can still reach a target after a loss of control authority.

Systems and Control Systems and Control 93-06

Designing Resilient Linear Driftless Systems

no code implementations24 Jun 2020 Jean-Baptiste Bouvier, Melkior Ornik

In contrast with the settings of robust control and fault-tolerant control, we consider undesirable but observable inputs of the same magnitude as controls since they are produced by a faulty actuator of the system.

Learning and Planning for Time-Varying MDPs Using Maximum Likelihood Estimation

no code implementations29 Nov 2019 Melkior Ornik, Ufuk Topcu

This paper proposes a formal approach to online learning and planning for agents operating in a priori unknown, time-varying environments.

Entropy Maximization for Markov Decision Processes Under Temporal Logic Constraints

no code implementations9 Jul 2018 Yagiz Savas, Melkior Ornik, Murat Cubuktepe, Mustafa O. Karabag, Ufuk Topcu

Such a policy minimizes the predictability of the paths it generates, or dually, maximizes the exploration of different paths in an MDP while ensuring the satisfaction of a temporal logic specification.

Motion Planning

Deception in Optimal Control

no code implementations8 May 2018 Melkior Ornik, Ufuk Topcu

In this paper, we consider an adversarial scenario where one agent seeks to achieve an objective and its adversary seeks to learn the agent's intentions and prevent the agent from achieving its objective.

Control-Oriented Learning on the Fly

no code implementations14 Sep 2017 Melkior Ornik, Arie Israel, Ufuk Topcu

This paper focuses on developing a strategy for control of systems whose dynamics are almost entirely unknown.

Cannot find the paper you are looking for? You can Submit a new open access paper.