no code implementations • 16 Apr 2024 • Rui Yan, Gabriel Santos, Gethin Norman, David Parker, Marta Kwiatkowska
For the partially-informed agent, we propose a continual resolving approach which uses lower bounds, pre-computed offline with heuristic search value iteration (HSVI), instead of opponent counterfactual values.
no code implementations • 17 Oct 2023 • Rui Yan, Gabriel Santos, Gethin Norman, David Parker, Marta Kwiatkowska
Stochastic games are a well established model for multi-agent sequential decision making under uncertainty.
no code implementations • 30 Jun 2023 • Rui Yan, Gabriel Santos, Gethin Norman, David Parker, Marta Kwiatkowska
This requires functions over continuous-state beliefs, for which we propose a novel piecewise linear and convex representation (P-PWLC) in terms of polyhedra covering the continuous-state space and value vectors, and extend Bellman backups to this representation.
no code implementations • 13 Feb 2022 • Rui Yan, Gabriel Santos, Gethin Norman, David Parker, Marta Kwiatkowska
Second, we introduce two novel representations for the value functions and strategies, constant-piecewise-linear (CON-PWL) and constant-piecewise-constant (CON-PWC) respectively, and propose Minimax-action-free PI by extending a recent PI method based on alternating player choices for finite state spaces to Borel state spaces, which does not require normal-form games to be solved.
no code implementations • 21 Jun 2015 • Gethin Norman, David Parker, Xueyi Zou
We then propose techniques to either verify that such a property holds or to synthesise a controller for the model which makes it true.
Logic in Computer Science Systems and Control