Empowering Large Language Models on Robotic Manipulation with Affordance Prompting

no code implementations • 17 Apr 2024 • Guangran Cheng, Chuheng Zhang, Wenzhe Cai, Li Zhao, Changyin Sun, Jiang Bian

While large language models (LLMs) are successful in completing various language processing tasks, they easily fail to interact with the physical world by generating control sequences properly.

XuanCe: A Comprehensive and Unified Deep Reinforcement Learning Library

1 code implementation • 25 Dec 2023 • Wenzhang Liu, Wenzhe Cai, Kun Jiang, Guangran Cheng, Yuanda Wang, Jiawei Wang, Jingyu Cao, Lele Xu, Chaoxu Mu, Changyin Sun

In this paper, we present XuanCe, a comprehensive and unified deep reinforcement learning (DRL) library designed to be compatible with PyTorch, TensorFlow, and MindSpore.

reinforcement-learning

Robust Navigation with Cross-Modal Fusion and Knowledge Transfer

1 code implementation • 23 Sep 2023 • Wenzhe Cai, Guangran Cheng, Lingyue Kong, Lu Dong, Changyin Sun

We consider the problem of improving the generalization of mobile robots and achieving sim-to-real transfer for navigation skills.

Transfer Learning