no code implementations • 6 Nov 2024 • Chinmay Maheshwari, Maria G. Mendoza, Victoria Marie Tuck, Pan-Yang Su, Victor L. Qin, Sanjit A. Seshia, Hamsa Balakrishnan, Shankar Sastry
To ensure the cost information of AAM vehicles remains private, we introduce a novel mechanism that allocates each vehicle a budget of "air-credits" and anonymously charges prices for traversing the edges of the time-extended graph.
no code implementations • 31 Oct 2024 • Beyazit Yalcinkaya, Niklas Lauffer, Marcell Vazquez-Chanlatte, Sanjit A. Seshia
Goal-conditioned reinforcement learning is a powerful way to control an AI agent's behavior at runtime.
no code implementations • 11 Oct 2024 • Justin Wong, Yury Orlovskiy, Michael Luo, Sanjit A. Seshia, Joseph E. Gonzalez
As computing probability per response/solution for proprietary models is infeasible, we measure recall on ground truth solutions.
1 code implementation • 5 Jun 2024 • Federico Mora, Justin Wong, Haley Lepe, Sahil Bhatia, Karim Elmaaroufi, George Varghese, Joseph E. Gonzalez, Elizabeth Polgreen, Sanjit A. Seshia
Unsurprisingly, however, models struggle to compose syntactically valid programs in programming languages unrepresented in pre-training, referred to as very low-resource Programming Languages (VLPLs).
no code implementations • 3 May 2024 • Karim Elmaaroufi, Devan Shanker, Ana Cismaru, Marcell Vazquez-Chanlatte, Alberto Sangiovanni-Vincentelli, Matei Zaharia, Sanjit A. Seshia
Reports normally contain uncertainty about the exact details of the incidents which we represent through a Probabilistic Programming Language (PPL), Scenic.
no code implementations • 17 Apr 2024 • Ameesh Shah, Cameron Voloshin, Chenxi Yang, Abhinav Verma, Swarat Chaudhuri, Sanjit A. Seshia
In this work, we present Cycle Experience Replay (CyclER), a reward-shaping approach to this problem that allows continuous state and action spaces and the use of function approximations.
no code implementations • 10 Feb 2024 • Marcell Vazquez-Chanlatte, Karim Elmaaroufi, Stefan J. Witwicki, Sanjit A. Seshia
Due to the expressivity of natural language, we observe a significant improvement in the data efficiency of learning DFAs from expert demonstrations.
no code implementations • 18 Oct 2023 • Amar Shah, Federico Mora, Sanjit A. Seshia
Specifically, our solver reduces ADT queries to a simpler logical theory, uninterpreted functions (UF), and then uses an existing solver on the reduced query.
no code implementations • 19 Jul 2023 • Ameesh Shah, Marcell Vazquez-Chanlatte, Sebastian Junges, Sanjit A. Seshia
Active learning is a well-studied approach to learning formal specifications, such as automata.
no code implementations • 29 Mar 2023 • Ameesh Shah, Jonathan DeCastro, John Gideon, Beyazit Yalcinkaya, Guy Rosman, Sanjit A. Seshia
Advancements in simulation and formal methods-guided environment sampling have enabled the rigorous evaluation of machine learning models in a number of safety-critical scenarios, such as autonomous driving.
no code implementations • 27 Feb 2023 • Piergiuseppe Mallozzi, Hussein Sibai, Inigo Incer, Sanjit A. Seshia, Alberto Sangiovanni-Vincentelli
It can be thought of as a building block for any design exploration and optimization algorithm.
1 code implementation • 20 Dec 2021 • Marcell Vazquez-Chanlatte, Ameesh Shah, Gil Lederman, Sanjit A. Seshia
This paper considers the problem of learning temporal task specifications, e. g. automata and temporal logic, from expert demonstrations.
no code implementations • 28 Oct 2021 • Francis Indaheng, Edward Kim, Kesav Viswanadha, Jay Shenoy, Jinkyu Kim, Daniel J. Fremont, Sanjit A. Seshia
Hence, it is important that these prediction models are extensively tested in various test scenarios involving interactive behaviors prior to deployment.
no code implementations • 20 Aug 2021 • Kesav Viswanadha, Francis Indaheng, Justin Wong, Edward Kim, Ellen Kalvan, Yash Pant, Daniel J. Fremont, Sanjit A. Seshia
Sampling from an abstract scenario yields many different concrete scenarios which can be run as test cases for the AV.
no code implementations • 16 Aug 2021 • Hazem Torfah, Shetal Shah, Supratik Chakraborty, S. Akshay, Sanjit A. Seshia
For a given black-box, our approach yields a set of Pareto-optimal interpretations with respect to the correctness and explainability measures.
no code implementations • 28 Jul 2021 • Elizabeth Polgreen, Andrew Reynolds, Sanjit A. Seshia
As a necessary component of this framework, we also formalize the problem of satisfiability modulo theories and oracles, and present an algorithm for solving this problem.
1 code implementation • 9 Jul 2021 • Kesav Viswanadha, Edward Kim, Francis Indaheng, Daniel J. Fremont, Sanjit A. Seshia
Falsification has emerged as an important tool for simulation-based verification of autonomous systems.
no code implementations • 18 Jun 2021 • Abdus Salam Azad, Edward Kim, Qiancheng Wu, Kimin Lee, Ion Stoica, Pieter Abbeel, Sanjit A. Seshia
To showcase the benefits, we interfaced SCENIC to an existing RTS environment Google Research Football(GRF) simulator and introduced a benchmark consisting of 32 realistic scenarios, encoded in SCENIC, to train RL agents and testing their generalization capabilities.
2 code implementations • 13 Oct 2020 • Daniel J. Fremont, Edward Kim, Tommaso Dreossi, Shromona Ghosh, Xiangyu Yue, Alberto L. Sangiovanni-Vincentelli, Sanjit A. Seshia
We design a domain-specific language, Scenic, for describing scenarios that are distributions over scenes and the behaviors of their agents over time.
1 code implementation • 1 Sep 2020 • Sicheng Zhao, Xiangyu Yue, Shanghang Zhang, Bo Li, Han Zhao, Bichen Wu, Ravi Krishna, Joseph E. Gonzalez, Alberto L. Sangiovanni-Vincentelli, Sanjit A. Seshia, Kurt Keutzer
To cope with limited labeled training data, many have attempted to directly apply models trained on a large-scale labeled source domain to another sparsely labeled or unlabeled target domain.
1 code implementation • 21 Aug 2020 • Sumukh Shivakumar, Hazem Torfah, Ankush Desai, Sanjit A. Seshia
We present an implementation of SOTER, a run-time assurance framework for building safe distributed mobile robotic (DMR) systems, on top of the Robot Operating System (ROS).
no code implementations • 13 Jul 2020 • Nicolas Chan, Elizabeth Polgreen, Sanjit A. Seshia
The performance of a syntax-guided synthesis algorithm is highly dependent on the provision of a good syntactic template, or grammar.
no code implementations • 7 Jul 2020 • Pashootan Vaezipoor, Gil Lederman, Yuhuai Wu, Chris J. Maddison, Roger Grosse, Sanjit A. Seshia, Fahiem Bacchus
In addition to step count improvements, Neuro# can also achieve orders of magnitude wall-clock speedups over the vanilla solver on larger instances in some problem families, despite the runtime overhead of querying the model.
1 code implementation • 30 Jun 2020 • Sebastian Junges, Nils Jansen, Sanjit A. Seshia
Partially-Observable Markov Decision Processes (POMDPs) are a well-known stochastic model for sequential decision making under limited information.
no code implementations • 14 May 2020 • Daniel J. Fremont, Johnathan Chiu, Dragos D. Margineantu, Denis Osipychev, Sanjit A. Seshia
We demonstrate a unified approach to rigorous design of safety-critical autonomous systems using the VerifAI toolkit for formal analysis of AI-based systems.
no code implementations • 17 Mar 2020 • Daniel J. Fremont, Edward Kim, Yash Vardhan Pant, Sanjit A. Seshia, Atul Acharya, Xantha Bruso, Paul Wells, Steve Lemke, Qiang Lu, Shalin Mehta
We present a new approach to automated scenario-based testing of the safety of autonomous vehicles, especially those using advanced artificial intelligence-based components, spanning both simulation-based evaluation as well as testing in the real world.
no code implementations • 7 Nov 2019 • Benjamin Caulfield, Sanjit A. Seshia
We define and study the problem of modular concept learning, that is, learning a concept that is a cross product of component concepts.
no code implementations • 4 Nov 2019 • Shromona Ghosh, Yash Vardhan Pant, Hadi Ravanbakhsh, Sanjit A. Seshia
The framework uses a falsifier to find counterexamples, or traces of the systems that violate a safety property, to extract information that enables efficient modeling of the perception modules and errors in it.
2 code implementations • NeurIPS 2019 • Micah Carroll, Rohin Shah, Mark K. Ho, Thomas L. Griffiths, Sanjit A. Seshia, Pieter Abbeel, Anca Dragan
While we would like agents that can coordinate with humans, current algorithms such as self-play and population-based training create agents that can coordinate with themselves.
no code implementations • 26 Jul 2019 • Marcell Vazquez-Chanlatte, Sanjit A. Seshia
In many settings (e. g., robotics) demonstrations provide a natural way to specify tasks; however, most methods for learning from demonstrations either do not provide guarantees that the artifacts learned for the tasks, such as rewards or policies, can be safely composed and/or do not explicitly capture history dependencies.
no code implementations • ICLR 2019 • Gil Lederman, Markus N. Rabe, Edward A. Lee, Sanjit A. Seshia
We demonstrate how to learn efficient heuristics for automated reasoning algorithms through deep reinforcement learning.
no code implementations • 24 Mar 2019 • Tommaso Dreossi, Shromona Ghosh, Alberto Sangiovanni-Vincentelli, Sanjit A. Seshia
The process of generating the perturbations that expose the lack of robustness of neural networks is known as adversarial input generation.
no code implementations • 22 Mar 2019 • Marcell Vazquez-Chanlatte, Markus N. Rabe, Sanjit A. Seshia
In this paper, we systematize the modeling of probabilistic systems for the purpose of analyzing them with model counting techniques.
1 code implementation • 12 Feb 2019 • Tommaso Dreossi, Daniel J. Fremont, Shromona Ghosh, Edward Kim, Hadi Ravanbakhsh, Marcell Vazquez-Chanlatte, Sanjit A. Seshia
We present VERIFAI, a software toolkit for the formal design and analysis of systems that include artificial intelligence (AI) and machine learning (ML) components.
2 code implementations • 25 Sep 2018 • Daniel J. Fremont, Tommaso Dreossi, Shromona Ghosh, Xiangyu Yue, Alberto L. Sangiovanni-Vincentelli, Sanjit A. Seshia
We propose a new probabilistic programming language for the design and analysis of perception systems, especially those based on machine learning.
1 code implementation • 7 Sep 2018 • Andreea B. Alexandru, Konstantinos Gatsis, Yasser Shoukry, Sanjit A. Seshia, Paulo Tabuada, George J. Pappas
The development of large-scale distributed control systems has led to the outsourcing of costly computations to cloud-computing platforms, as well as to concerns about privacy of the collected sensitive data.
Optimization and Control Cryptography and Security Systems and Control
no code implementations • 23 Aug 2018 • Ankush Desai, Shromona Ghosh, Sanjit A. Seshia, Natarajan Shankar, Ashish Tiwari
SOTER provides language primitives to declaratively construct a RTA module consisting of an advanced, high-performance controller (uncertified), a safe, lower-performance controller (certified), and the desired safety specification.
1 code implementation • 20 Jul 2018 • Gil Lederman, Markus N. Rabe, Edward A. Lee, Sanjit A. Seshia
We demonstrate how to learn efficient heuristics for automated reasoning algorithms for quantified Boolean formulas through deep reinforcement learning.
2 code implementations • 17 May 2018 • Tommaso Dreossi, Shromona Ghosh, Xiangyu Yue, Kurt Keutzer, Alberto Sangiovanni-Vincentelli, Sanjit A. Seshia
We present a novel framework for augmenting data sets for machine learning based on counterexamples.
no code implementations • 19 Apr 2018 • Tommaso Dreossi, Somesh Jha, Sanjit A. Seshia
However, existing approaches to generating adversarial examples and devising robust ML algorithms mostly ignore the semantics and context of the overall system containing the ML component.
no code implementations • 31 Mar 2018 • Xiangyu Yue, Bichen Wu, Sanjit A. Seshia, Kurt Keutzer, Alberto L. Sangiovanni-Vincentelli
The framework supports data collection from both auto-driving scenes and user-configured scenes.
no code implementations • 24 Mar 2018 • Sicheng Zhao, Bichen Wu, Joseph Gonzalez, Sanjit A. Seshia, Kurt Keutzer
To cope with limited labeled training data, many have attempted to directly apply models trained on a large-scale labeled source domain to another sparsely labeled target domain.
no code implementations • 24 Feb 2018 • Marcell Vazquez-Chanlatte, Shromona Ghosh, Jyotirmoy V. Deshmukh, Alberto Sangiovanni-Vincentelli, Sanjit A. Seshia
Cyber-physical systems of today are generating large volumes of time-series data.
no code implementations • 14 Feb 2018 • Somil Bansal, Shromona Ghosh, Alberto Sangiovanni-Vincentelli, Sanjit A. Seshia, Claire J. Tomlin
We propose a context-specific validation framework to quantify the quality of a learned model based on a distance measure between the closed-loop actual system and the learned model.
no code implementations • NeurIPS 2018 • Marcell Vazquez-Chanlatte, Susmit Jha, Ashish Tiwari, Mark K. Ho, Sanjit A. Seshia
In this paper, we formulate the specification inference task as a maximum a posteriori (MAP) probability inference problem, apply the principle of maximum entropy to derive an analytic demonstration likelihood model and give an efficient approach to search for the most likely specification in a large candidate pool of specifications.
no code implementations • 10 Aug 2017 • Tommaso Dreossi, Shromona Ghosh, Alberto Sangiovanni-Vincentelli, Sanjit A. Seshia
We present a framework to systematically analyze convolutional neural networks (CNNs) used in classification of cars in autonomous vehicles.
no code implementations • 2 Mar 2017 • Tommaso Dreossi, Alexandre Donzé, Sanjit A. Seshia
This raises the question: can the output from learning components can lead to a failure of the entire CPS?
no code implementations • 22 Dec 2016 • Marcell Vazquez-Chanlatte, Jyotirmoy V. Deshmukh, Xiaoqing Jin, Sanjit A. Seshia
To effectively analyze and design cyberphysical systems (CPS), designers today have to combat the data deluge problem, i. e., the burden of processing intractably large amounts of data produced by complex models and experiments.
no code implementations • 27 Jun 2016 • Sanjit A. Seshia, Dorsa Sadigh, S. Shankar Sastry
Verified artificial intelligence (AI) is the goal of designing AI-based systems that that have strong, ideally provable, assurances of correctness with respect to mathematically-specified requirements.
no code implementations • 21 Dec 2015 • Kuldeep S. Meel, Moshe Vardi, Supratik Chakraborty, Daniel J. Fremont, Sanjit A. Seshia, Dror Fried, Alexander Ivrii, Sharad Malik
Constrained sampling and counting are two fundamental problems in artificial intelligence with a diverse range of applications, spanning probabilistic reasoning and planning to constrained-random verification.
no code implementations • 15 May 2015 • Susmit Jha, Sanjit A. Seshia
In this paper, we present a theoretical framework for formal inductive synthesis.
no code implementations • 21 Jul 2014 • Susmit Jha, Sanjit A. Seshia
The history bounded counterexample used in any iteration of CEGIS is bounded by the examples used in previous iterations of inductive synthesis.
no code implementations • 11 Apr 2014 • Supratik Chakraborty, Daniel J. Fremont, Kuldeep S. Meel, Sanjit A. Seshia, Moshe Y. Vardi
We present a novel approach that works with a black-box oracle for weights of assignments and requires only an {\NP}-oracle (in practice, a SAT-solver) to solve both the counting and sampling problems.
no code implementations • 7 Dec 2013 • Dorsa Sadigh, Henrik Ohlsson, S. Shankar Sastry, Sanjit A. Seshia
As in robust PCA, it can be problematic to find a suitable regularization parameter.