Search Results for author: Thomas Spooner

Found 10 papers, 2 papers with code

Reductive MDPs: A Perspective Beyond Temporal Horizons

no code implementations15 May 2022 Thomas Spooner, Rui Silva, Joshua Lockhart, Jason Long, Vacslav Glukhov

Solving general Markov decision processes (MDPs) is a computationally hard problem.

Towards a fully RL-based Market Simulator

no code implementations13 Oct 2021 Leo Ardon, Nelson Vadori, Thomas Spooner, Mengda Xu, Jared Vann, Sumitra Ganesh

We present a new financial framework where two families of RL-based agents representing the Liquidity Providers and Liquidity Takers learn simultaneously to satisfy their objective.

Graph Reasoning with Context-Aware Linearization for Interpretable Fact Extraction and Verification

no code implementations EMNLP (FEVER) 2021 Neema Kotonya, Thomas Spooner, Daniele Magazzeni, Francesca Toni

This paper presents an end-to-end system for fact extraction and verification using textual and tabular evidence, the performance of which we demonstrate on the FEVEROUS dataset.

Graph Attention Multi-Task Learning

Counterfactual Explanations for Arbitrary Regression Models

no code implementations29 Jun 2021 Thomas Spooner, Danial Dervovic, Jason Long, Jon Shepard, Jiahao Chen, Daniele Magazzeni

We present a new method for counterfactual explanations (CFEs) based on Bayesian optimisation that applies to both classification and regression models.

Bayesian Optimisation counterfactual +1

Consensus Multiplicative Weights Update: Learning to Learn using Projector-based Game Signatures

no code implementations4 Jun 2021 Nelson Vadori, Rahul Savani, Thomas Spooner, Sumitra Ganesh

Cheung and Piliouras (2020) recently showed that two variants of the Multiplicative Weights Update method - OMWU and MWU - display opposite convergence properties depending on whether the game is zero-sum or cooperative.

Factored Policy Gradients: Leveraging Structure for Efficient Learning in MOMDPs

no code implementations NeurIPS 2021 Thomas Spooner, Nelson Vadori, Sumitra Ganesh

In this paper, we address this problem through a factor baseline which exploits independence structure encoded in a novel action-target influence network.

Policy Gradient Methods

A Natural Actor-Critic Algorithm with Downside Risk Constraints

no code implementations8 Jul 2020 Thomas Spooner, Rahul Savani

We prove that this proxy for the lower partial moment is a contraction, and provide intuition into the stability of the algorithm by variance decomposition.

reinforcement-learning Reinforcement Learning (RL)

Robust Market Making via Adversarial Reinforcement Learning

1 code implementation3 Mar 2020 Thomas Spooner, Rahul Savani

We show that adversarial reinforcement learning (ARL) can be used to produce market marking agents that are robust to adversarial and adaptively-chosen market conditions.

reinforcement-learning Reinforcement Learning (RL)

Market Making via Reinforcement Learning

1 code implementation11 Apr 2018 Thomas Spooner, John Fearnley, Rahul Savani, Andreas Koukorinis

Market making is a fundamental trading problem in which an agent provides liquidity by continually offering to buy and sell a security.

Position reinforcement-learning +1

Cannot find the paper you are looking for? You can Submit a new open access paper.