Search Results for author: Guiliang Liu

Found 16 papers, 5 papers with code

Offline Inverse Constrained Reinforcement Learning for Safe-Critical Decision Making in Healthcare

no code implementations10 Oct 2024 Nan Fang, Guiliang Liu, Wei Gong

Reinforcement Learning (RL) applied in healthcare can lead to unsafe medical decisions and treatment, such as excessive dosages or abrupt changes, often due to agents overlooking common-sense constraints.

Common Sense Reasoning Data Augmentation +5

Provably Efficient Exploration in Inverse Constrained Reinforcement Learning

no code implementations24 Sep 2024 Bo Yue, Jian Li, Guiliang Liu

To obtain the optimal constraints in complex environments, Inverse Constrained Reinforcement Learning (ICRL) seeks to recover these constraints from expert demonstrations in a data-driven manner.

Efficient Exploration reinforcement-learning +1

TrafficGamer: Reliable and Flexible Traffic Simulation for Safety-Critical Scenarios with Game-Theoretic Oracles

1 code implementation28 Aug 2024 Guanren Qiao, Guorui Quan, Jiawei Yu, Shujun Jia, Guiliang Liu

In evaluating the empirical performance across various real-world datasets, TrafficGamer ensures both fidelity and exploitability of the simulated scenarios, guaranteeing that they not only statically align with real-world traffic distribution but also efficiently capture equilibriums for representing safety-critical scenarios involving multiple agents.

Confidence Aware Inverse Constrained Reinforcement Learning

1 code implementation24 Jun 2024 Sriram Ganapathi Subramanian, Guiliang Liu, Mohammed Elmahgiubi, Kasra Rezaee, Pascal Poupart

This work provides a principled ICRL method that can take a confidence level with a set of expert demonstrations and outputs a constraint that is at least as constraining as the true underlying constraint with the desired level of confidence.

reinforcement-learning Reinforcement Learning +1

Unimodal Training-Multimodal Prediction: Cross-modal Federated Learning with Hierarchical Aggregation

no code implementations27 Mar 2023 Rongyu Zhang, Xiaowei Chi, Guiliang Liu, Wenyi Zhang, Yuan Du, Fangxin Wang

Multimodal learning has seen great success mining data features from multiple modalities with remarkable model performance improvement.

Decoder Federated Learning +1

Benchmarking Constraint Inference in Inverse Reinforcement Learning

2 code implementations20 Jun 2022 Guiliang Liu, Yudong Luo, Ashish Gaurav, Kasra Rezaee, Pascal Poupart

When deploying Reinforcement Learning (RL) agents into a physical system, we must ensure that these agents are well aware of the underlying constraints.

Autonomous Driving Benchmarking +3

Learning Soft Constraints From Constrained Expert Demonstrations

no code implementations2 Jun 2022 Ashish Gaurav, Kasra Rezaee, Guiliang Liu, Pascal Poupart

We consider the setting where the reward function is given, and the constraints are unknown, and propose a method that is able to recover these constraints satisfactorily from the expert data.

Learning Tree Interpretation from Object Representation for Deep Reinforcement Learning

no code implementations NeurIPS 2021 Guiliang Liu, Xiangyu Sun, Oliver Schulte, Pascal Poupart

We propose a Represent And Mimic (RAMi) framework for training 1) an identifiable latent representation to capture the independent factors of variation for the objects and 2) a mimic tree that extracts the causal impact of the latent features on DRL action values.

Deep Reinforcement Learning reinforcement-learning +1

Distributional Reinforcement Learning with Monotonic Splines

no code implementations ICLR 2022 Yudong Luo, Guiliang Liu, Haonan Duan, Oliver Schulte, Pascal Poupart

Distributional Reinforcement Learning (RL) differs from traditional RL by estimating the distribution over returns to capture the intrinsic uncertainty of MDPs.

Distributional Reinforcement Learning reinforcement-learning +2

NTS-NOTEARS: Learning Nonparametric DBNs With Prior Knowledge

1 code implementation9 Sep 2021 Xiangyu Sun, Oliver Schulte, Guiliang Liu, Pascal Poupart

We describe NTS-NOTEARS, a score-based structure learning method for time-series data to learn dynamic Bayesian networks (DBNs) that captures nonlinear, lagged (inter-slice) and instantaneous (intra-slice) relations among variables.

Time Series Time Series Analysis

Learning Agent Representations for Ice Hockey

no code implementations NeurIPS 2020 Guiliang Liu, Oliver Schulte, Pascal Poupart, Mike Rudd, Mehrsan Javan

This paper develops a new approach for agent representations, based on a Markov game model, that is tailored towards applications in professional ice hockey.

Sports Analytics

Cracking the Black Box: Distilling Deep Sports Analytics

1 code implementation4 Jun 2020 Xiangyu Sun, Jack Davis, Oliver Schulte, Guiliang Liu

This paper addresses the trade-off between Accuracy and Transparency for deep learning applied to sports analytics.

Deep Learning Sports Analytics

Toward Interpretable Deep Reinforcement Learning with Linear Model U-Trees

no code implementations16 Jul 2018 Guiliang Liu, Oliver Schulte, Wang Zhu, Qingcan Li

An LMUT is learned using a novel on-line algorithm that is well-suited for an active play setting, where the mimic learner observes an ongoing interaction between the neural net and the environment.

Deep Reinforcement Learning reinforcement-learning +1

Deep Reinforcement Learning in Ice Hockey for Context-Aware Player Evaluation

no code implementations26 May 2018 Guiliang Liu, Oliver Schulte

To assess a player's overall performance, we introduce a novel Game Impact Metric (GIM) that aggregates the values of the player's actions.

Deep Reinforcement Learning reinforcement-learning +1

Cannot find the paper you are looking for? You can Submit a new open access paper.