Search Results for author: Huaping Liu

Found 24 papers, 4 papers with code

Multi-Agent Embodied Question Answering in Interactive Environments

no code implementations ECCV 2020 Sinan Tan, Weilai Xiang, Huaping Liu, Di Guo, Fuchun Sun

We investigate a new AI task --- Multi-Agent Interactive Question Answering --- where several agents explore the scene jointly in interactive environments to answer a question.

3D Reconstruction Embodied Question Answering +1

Multi-Agent Embodied Visual Semantic Navigation with Scene Prior Knowledge

no code implementations20 Sep 2021 Xinzhu Liu, Di Guo, Huaping Liu, Fuchun Sun

In this paper, we propose the multi-agent visual semantic navigation, in which multiple agents collaborate with others to find multiple target objects.

Efficient Exploration

A novel multimodal fusion network based on a joint coding model for lane line segmentation

no code implementations20 Mar 2021 Zhenhong Zou, Xinyu Zhang, Huaping Liu, Zhiwei Li, Amir Hussain, Jun Li

There has recently been growing interest in utilizing multimodal sensors to achieve robust lane line segmentation.

Understanding the Behaviour of Contrastive Loss

no code implementations CVPR 2021 Feng Wang, Huaping Liu

We will show that the contrastive loss is a hardness-aware loss function, and the temperature {\tau} controls the strength of penalties on hard negative samples.

Contrastive Learning

Unsupervised Representation Learning by Invariance Propagation

no code implementations NeurIPS 2020 Feng Wang, Huaping Liu, Di Guo, Sun Fuchun

In this paper, we propose Invariance Propagation to focus on learning representations invariant to category-level variations, which are provided by different instances from the same category.

Contrastive Learning Transfer Learning +1

Fault-Aware Robust Control via Adversarial Reinforcement Learning

no code implementations17 Nov 2020 Fan Yang, Chao Yang, Di Guo, Huaping Liu, Fuchun Sun

Robots have limited adaptation ability compared to humans and animals in the case of damage.

Unsupervised Representation Learning by InvariancePropagation

1 code implementation7 Oct 2020 Feng Wang, Huaping Liu, Di Guo, Fuchun Sun

In this paper, we propose Invariance Propagation to focus on learning representations invariant to category-level variations, which are provided by different instances from the same category.

Contrastive Learning Transfer Learning +1

DeepSSM: Deep State-Space Model for 3D Human Motion Prediction

no code implementations25 May 2020 Xiaoli Liu, Jianqin Yin, Huaping Liu, Jun Liu

Moreover, a novel deep network is designed to build this system, enabling us to utilize both the advantages of deep network and state-space model.

Human motion prediction motion prediction

Towards Embodied Scene Description

no code implementations30 Apr 2020 Sinan Tan, Huaping Liu, Di Guo, Xin-Yu Zhang, Fuchun Sun

Embodiment is an important characteristic for all intelligent agents (creatures and robots), while existing scene description tasks mainly focus on analyzing images passively and the semantic understanding of the scenario is separated from the interaction between the agent and the environment.

Imitation Learning

Energy-based Periodicity Mining with Deep Features for Action Repetition Counting in Unconstrained Videos

no code implementations15 Mar 2020 Jianqin Yin, Yanchun Wu, Huaping Liu, Yonghao Dang, Zhiyi Liu, Jun Liu

Our work features two-fold: 1) An important insight that deep features extracted for action recognition can well model the self-similarity periodicity of the repetitive action is presented.

Action Recognition

MQA: Answering the Question via Robotic Manipulation

no code implementations10 Mar 2020 Yuhong Deng, Di Guo, Xiaofeng Guo, Naifu Zhang, Huaping Liu, Fuchun Sun

In this paper, we propose a novel task, Manipulation Question Answering (MQA), where the robot performs manipulation actions to change the environment in order to answer a given question.

Imitation Learning Question Answering +1

FoveaBox: Beyound Anchor-based Object Detection

no code implementations ICLR 2020 Tao Kong, Fuchun Sun, Huaping Liu, Yuning Jiang, Lei LI, Jianbo Shi

While almost all state-of-the-art object detectors utilize predefined anchors to enumerate possible locations, scales and aspect ratios for the search of the objects, their performance and generalization ability are also limited to the design of anchors.

Object Detection

Reinforcement Learning from Imperfect Demonstrations under Soft Expert Guidance

no code implementations16 Nov 2019 Mingxuan Jing, Xiaojian Ma, Wenbing Huang, Fuchun Sun, Chao Yang, Bin Fang, Huaping Liu

In this paper, we study Reinforcement Learning from Demonstrations (RLfD) that improves the exploration efficiency of Reinforcement Learning (RL) by providing expert demonstrations.

TrajectoryNet: a new spatio-temporal feature learning network for human motion prediction

no code implementations15 Oct 2019 Xiaoli Liu, Jianqin Yin, Jin Liu, Pengxiang Ding, Jun Liu, Huaping Liu

And the global temporal co-occurrence features represent the co-occurrence relationship that different subsequences in a complex motion sequence are appeared simultaneously, which can be obtained automatically with our proposed TrajectoryNet by reorganizing the temporal information as the depth dimension of the input tensor.

Human motion prediction motion prediction +1

PISEP^2: Pseudo Image Sequence Evolution based 3D Pose Prediction

no code implementations arXiv:1909.01818 2019 Xiaoli Liu, Jianqin Yin, Huaping Liu, Yilong Yin

Specifically, a skeletal representation is proposed by transforming the joint coordinate sequence into an image sequence, which can model the different correlations of different joints.

Pose Prediction

FoveaBox: Beyond Anchor-based Object Detector

6 code implementations8 Apr 2019 Tao Kong, Fuchun Sun, Huaping Liu, Yuning Jiang, Lei LI, Jianbo Shi

In FoveaBox, an instance is assigned to adjacent feature levels to make the model more accurate. We demonstrate its effectiveness on standard benchmarks and report extensive experimental analysis.

Ranked #86 on Object Detection on COCO test-dev (APM metric)

Object Detection

Deep Feature Pyramid Reconfiguration for Object Detection

no code implementations ECCV 2018 Tao Kong, Fuchun Sun, Wenbing Huang, Huaping Liu

In this paper, we begin by investigating current feature pyramids solutions, and then reformulate the feature pyramid construction as the feature reconfiguration process.

Object Detection

Learning and Inferring Movement with Deep Generative Model

no code implementations18 May 2018 Mingxuan Jing, Xiaojian Ma, Fuchun Sun, Huaping Liu

Learning and inference movement is a very challenging problem due to its high dimensionality and dependency to varied environments or tasks.

Motion Planning

Task Transfer by Preference-Based Cost Learning

no code implementations12 May 2018 Mingxuan Jing, Xiaojian Ma, Wenbing Huang, Fuchun Sun, Huaping Liu

The goal of task transfer in reinforcement learning is migrating the action policy of an agent to the target task from the source task.

Sparse Coding and Dictionary Learning With Linear Dynamical Systems

no code implementations CVPR 2016 Wenbing Huang, Fuchun Sun, Lele Cao, Deli Zhao, Huaping Liu, Mehrtash Harandi

To enhance the performance of LDSs, in this paper, we address the challenging issue of performing sparse coding on the space of LDSs, where both data and dictionary atoms are LDSs.

Dictionary Learning Video Classification

Cannot find the paper you are looking for? You can Submit a new open access paper.