Search Results for author: Wee Sun Lee

Found 53 papers, 24 papers with code

Differentiable Tree Search in Latent State Space

1 code implementation22 Jan 2024 Dixant Mittal, Wee Sun Lee

In this work, we introduce Differentiable Tree Search (DTS), a novel neural network architecture that significantly strengthens the inductive bias by embedding the algorithmic structure of a best-first online search algorithm.

Decision Making Inductive Bias +1

An Unsupervised Neural Attention Model for Aspect Extraction

3 code implementations ACL 2017 Ruidan He, Wee Sun Lee, Hwee Tou Ng, Daniel Dahlmeier

Unlike topic models which typically assume independently generated words, word embedding models encourage words that appear in similar contexts to be located close to each other in the embedding space.

Aspect-Based Sentiment Analysis Aspect Extraction +3

DESPOT: Online POMDP Planning with Regularization

1 code implementation NeurIPS 2013 Nan Ye, Adhiraj Somani, David Hsu, Wee Sun Lee

We show that the best policy obtained from a DESPOT is near-optimal, with a regret bound that depends on the representation size of the optimal policy.

Autonomous Driving

Particle Filter Networks with Application to Visual Localization

2 code implementations23 May 2018 Peter Karkus, David Hsu, Wee Sun Lee

Particle filtering is a powerful approach to sequential state estimation and finds application in many domains, including robot localization, object tracking, etc.

Object Tracking Visual Localization

Particle Filter Recurrent Neural Networks

1 code implementation30 May 2019 Xiao Ma, Peter Karkus, David Hsu, Wee Sun Lee

Recurrent neural networks (RNNs) have been extraordinarily successful for prediction with sequential data.

General Classification Stock Price Prediction +2

Factor Graph Neural Network

1 code implementation3 Jun 2019 Zhen Zhang, Fan Wu, Wee Sun Lee

Most of the successful deep neural network architectures are structured, often consisting of elements like convolutional neural networks and gated recurrent neural networks.

QMDP-Net: Deep Learning for Planning under Partial Observability

2 code implementations NeurIPS 2017 Peter Karkus, David Hsu, Wee Sun Lee

It is a recurrent policy network, but it represents a policy for a parameterized set of tasks by connecting a model with a planning algorithm that solves the model, thus embedding the solution structure of planning in a network learning architecture.

Adaptive Semi-supervised Learning for Cross-domain Sentiment Classification

1 code implementation EMNLP 2018 Ruidan He, Wee Sun Lee, Hwee Tou Ng, Daniel Dahlmeier

We consider the cross-domain sentiment classification problem, where a sentiment classifier is to be learned from a source domain and to be generalized to a target domain.

Classification General Classification +2

HyP-DESPOT: A Hybrid Parallel Algorithm for Online Planning under Uncertainty

1 code implementation17 Feb 2018 Panpan Cai, Yuanfu Luo, David Hsu, Wee Sun Lee

Planning under uncertainty is critical for robust robot performance in uncertain, dynamic environments, but it incurs high computational cost.

Computational Efficiency

Understanding and Resolving Performance Degradation in Graph Convolutional Networks

2 code implementations12 Jun 2020 Kuangqi Zhou, Yanfei Dong, Kaixin Wang, Wee Sun Lee, Bryan Hooi, Huan Xu, Jiashi Feng

In this work, we study performance degradation of GCNs by experimentally examining how stacking only TRANs or PROPs works.

Efficient Offline Policy Optimization with a Learned Model

1 code implementation12 Oct 2022 Zichen Liu, Siyi Li, Wee Sun Lee, Shuicheng Yan, Zhongwen Xu

Instead of planning with the expensive MCTS, we use the learned model to construct an advantage estimation based on a one-step rollout.

Offline RL

Discriminative Particle Filter Reinforcement Learning for Complex Partial Observations

1 code implementation ICLR 2020 Xiao Ma, Peter Karkus, David Hsu, Wee Sun Lee, Nan Ye

The particle filter maintains a belief using learned discriminative update, which is trained end-to-end for decision making.

Atari Games Decision Making +3

Contrastive Variational Reinforcement Learning for Complex Observations

1 code implementation6 Aug 2020 Xiao Ma, Siwei Chen, David Hsu, Wee Sun Lee

This paper presents Contrastive Variational Reinforcement Learning (CVRL), a model-based method that tackles complex visual observations in DRL.

Atari Games Continuous Control +4

Intention-Net: Integrating Planning and Deep Learning for Goal-Directed Autonomous Navigation

2 code implementations16 Oct 2017 Wei Gao, David Hsu, Wee Sun Lee, ShengMei Shen, Karthikk Subramanian

How can a delivery robot navigate reliably to a destination in a new office building, with minimal prior information?

Autonomous Navigation Navigate

None Class Ranking Loss for Document-Level Relation Extraction

1 code implementation1 May 2022 Yang Zhou, Wee Sun Lee

This ignores the context of entity pairs and the label correlations between the none class and pre-defined classes, leading to sub-optimal predictions.

Document-level Relation Extraction Emotion Classification +3

Push-Net: Deep Planar Pushing for Objects with Unknown Physical Properties

1 code implementation Robotics: Science and Systems 2018 Jue Kun Li, David Hsu, Wee Sun Lee

This paper introduces Push-Net, a deep recurrent neural network model, which enables a robot to push objects of unknown physical properties for re-positioning and re-orientation, using only visual camera images as input.

PF-GNN: Differentiable particle filtering based approximation of universal graph representations

1 code implementation ICLR 2022 Mohammed Haroon Dupty, Yanfei Dong, Wee Sun Lee

Message passing Graph Neural Networks (GNNs) are known to be limited in expressive power by the 1-WL color-refinement test for graph isomorphism.

Combining Reinforcement Learning and Optimal Transport for the Traveling Salesman Problem

1 code implementation2 Mar 2022 Yong Liang Goh, Wee Sun Lee, Xavier Bresson, Thomas Laurent, Nicholas Lim

This paper exemplifies the integration of entropic regularized optimal transport techniques as a layer in a deep reinforcement learning network.

Combinatorial Optimization reinforcement-learning +2

Ensemble and Auxiliary Tasks for Data-Efficient Deep Reinforcement Learning

1 code implementation5 Jul 2021 Muhammad Rizki Maulana, Wee Sun Lee

Ensemble and auxiliary tasks are both well known to improve the performance of machine learning models when data is limited.

Atari Games Q-Learning +2

Factored Contextual Policy Search with Bayesian Optimization

no code implementations6 Dec 2016 Peter Karkus, Andras Kupcsik, David Hsu, Wee Sun Lee

Scarce data is a major challenge to scaling robot learning to truly complex tasks, as we need to generalize locally learned policies over different "contexts".

Active Learning Bayesian Optimization +2

POMDP-lite for Robust Robot Planning under Uncertainty

no code implementations16 Feb 2016 Min Chen, Emilio Frazzoli, David Hsu, Wee Sun Lee

We show that a POMDP-lite is equivalent to a set of fully observable Markov decision processes indexed by a hidden parameter and is useful for modeling a variety of interesting robotic tasks.

Reinforcement Learning (RL)

Integrating Algorithmic Planning and Deep Learning for Partially Observable Navigation

no code implementations17 Jul 2018 Peter Karkus, David Hsu, Wee Sun Lee

We propose to take a novel approach to robot system design where each building block of a larger system is represented as a differentiable program, i. e. a deep neural network.

Navigate Robot Navigation

Learning with Invariance via Linear Functionals on Reproducing Kernel Hilbert Space

no code implementations NeurIPS 2013 Xinhua Zhang, Wee Sun Lee, Yee Whye Teh

For the representer theorem to hold, the linear functionals are required to be bounded in the RKHS, and we show that this is true for a variety of commonly used RKHS and invariances.

Tensor Belief Propagation

no code implementations ICML 2017 Andrew Wrigley, Wee Sun Lee, Nan Ye

We propose a new approximate inference algorithm for graphical models, tensor belief propagation, based on approximating the messages passed in the junction tree algorithm.

Monte Carlo Bayesian Reinforcement Learning

no code implementations27 Jun 2012 Yi Wang, Kok Sung Won, David Hsu, Wee Sun Lee

Bayesian reinforcement learning (BRL) encodes prior knowledge of the world in a model and represents uncertainty in model parameters by maintaining a probability distribution over them.

reinforcement-learning Reinforcement Learning (RL)

Differentiable Algorithm Networks for Composable Robot Learning

no code implementations28 May 2019 Peter Karkus, Xiao Ma, David Hsu, Leslie Pack Kaelbling, Wee Sun Lee, Tomas Lozano-Perez

This paper introduces the Differentiable Algorithm Network (DAN), a composable architecture for robot learning systems.

Navigate

LeTS-Drive: Driving in a Crowd by Learning from Tree Search

no code implementations29 May 2019 Panpan Cai, Yuanfu Luo, Aseem Saxena, David Hsu, Wee Sun Lee

LeTS-Drive leverages the robustness of planning and the runtime efficiency of learning to enhance the performance of both.

Autonomous Driving Imitation Learning

Visual Relationship Detection with Low Rank Non-Negative Tensor Decomposition

no code implementations22 Nov 2019 Mohammed Haroon Dupty, Zhen Zhang, Wee Sun Lee

We address the problem of Visual Relationship Detection (VRD) which aims to describe the relationships between pairs of objects in the form of triplets of (subject, predicate, object).

Relationship Detection Tensor Decomposition +1

Multiplicative Gaussian Particle Filter

no code implementations29 Feb 2020 Xuan Su, Wee Sun Lee, Zhen Zhang

We propose a new sampling-based approach for approximate inference in filtering problems.

PORCA: Modeling and Planning for Autonomous Driving among Many Pedestrians

no code implementations30 May 2018 Yuanfu Luo, Panpan Cai, Aniket Bera, David Hsu, Wee Sun Lee, Dinesh Manocha

Our planning system combines a POMDP algorithm with the pedestrian motion model and runs in near real time.

Robotics

Neuralizing Efficient Higher-order Belief Propagation

no code implementations19 Oct 2020 Mohammed Haroon Dupty, Wee Sun Lee

In this paper, we propose to combine these approaches to learn better node and graph representations.

Inductive Bias

Factor Graph Molecule Network for Structure Elucidation

no code implementations10 Dec 2020 Hieu Le Trung, Yiqing Xu, Wee Sun Lee

Designing a network to learn a molecule structure given its physical/chemical properties is a hard problem, but is useful for drug discovery tasks.

Drug Discovery Relational Reasoning

State-Aware Variational Thompson Sampling for Deep Q-Networks

no code implementations7 Feb 2021 Siddharth Aravindan, Wee Sun Lee

We derive a variational Thompson sampling approximation for DQNs which uses a deep network whose parameters are perturbed by a learned variational noise distribution.

Thompson Sampling

Learning Latent Graph Dynamics for Visual Manipulation of Deformable Objects

no code implementations25 Apr 2021 Xiao Ma, David Hsu, Wee Sun Lee

Manipulating deformable objects, such as ropes and clothing, is a long-standing challenge in robotics, because of their large degrees of freedom, complex non-linear dynamics, and self-occlusion in visual perception.

Contrastive Learning Deformable Object Manipulation +3

EVaDE : Event-Based Variational Thompson Sampling for Model-Based Reinforcement Learning

no code implementations29 Sep 2021 Siddharth Aravindan, Dixant Mittal, Wee Sun Lee

These layers rely on Gaussian dropouts and are inserted in between the layers of the deep neural network model to help facilitate variational Thompson sampling.

Atari Games Model-based Reinforcement Learning +3

ExPoSe: Combining State-Based Exploration with Gradient-Based Online Search

1 code implementation3 Feb 2022 Dixant Mittal, Siddharth Aravindan, Wee Sun Lee

Depending upon the smoothness of the action-value function, one approach to overcoming this issue is through online learning, where information is interpolated among similar states; Policy Gradient Search provides a practical algorithm to achieve this.

Atari Games Decision Making

Context-Hierarchy Inverse Reinforcement Learning

no code implementations25 Feb 2022 Wei Gao, David Hsu, Wee Sun Lee

To solve these issues, we present Context Hierarchy IRL(CHIRL), a new IRL algorithm that exploits the context to scale up IRL and learn reward functions of complex behaviors.

Autonomous Driving reinforcement-learning +1

Graph Representation Learning with Individualization and Refinement

no code implementations17 Mar 2022 Mohammed Haroon Dupty, Wee Sun Lee

Individualization refers to artificially distinguishing a node in the graph and refinement is the propagation of this information to other nodes through message passing.

Graph Representation Learning

Differentiable Parsing and Visual Grounding of Natural Language Instructions for Object Placement

no code implementations1 Oct 2022 Zirui Zhao, Wee Sun Lee, David Hsu

Natural language generally describes objects and spatial relations with compositionality and ambiguity, two major obstacles to effective language grounding.

Object Relational Reasoning +1

Factor Graph Neural Networks

no code implementations NeurIPS 2020 Zhen Zhang, Mohammed Haroon Dupty, Fan Wu, Javen Qinfeng Shi, Wee Sun Lee

In recent years, we have witnessed a surge of Graph Neural Networks (GNNs), most of which can learn powerful representations in an end-to-end fashion with great success in many real-world applications.

Representation Learning

Locality Sensitive Sparse Encoding for Learning World Models Online

no code implementations23 Jan 2024 Zichen Liu, Chao Du, Wee Sun Lee, Min Lin

Unfortunately, NN-based models need re-training on all accumulated data at every interaction step to achieve FTL, which is computationally expensive for lifelong agents.

Continual Learning Model-based Reinforcement Learning

Constrained Layout Generation with Factor Graphs

no code implementations30 Mar 2024 Mohammed Haroon Dupty, Yanfei Dong, Sicong Leng, Guoji Fu, Yong Liang Goh, Wei Lu, Wee Sun Lee

This paper addresses the challenge of object-centric layout generation under spatial constraints, seen in multiple domains including floorplan design process.

Object

Continual Learning of Numerous Tasks from Long-tail Distributions

no code implementations3 Apr 2024 Liwei Kang, Wee Sun Lee

In this paper, we investigate the performance of continual learning algorithms with a large number of tasks drawn from a task distribution that is long-tail in terms of task sizes.

Continual Learning

On the Empirical Complexity of Reasoning and Planning in LLMs

no code implementations17 Apr 2024 Liwei Kang, Zirui Zhao, David Hsu, Wee Sun Lee

We found that if problems can be decomposed into a sequence of reasoning steps and learning to predict the next step has a low sample and computational complexity, explicitly outlining the reasoning chain with all necessary information for predicting the next step may improve performance.

Cannot find the paper you are looking for? You can Submit a new open access paper.