Towards Human-Centered Construction Robotics: An RL-Driven Companion Robot For Contextually Assisting Carpentry Workers

no code implementations • 27 Mar 2024 • Yuning Wu, Jiaying Wei, Jean Oh, Daniel Cardoso Llach

In the dynamic construction industry, traditional robotic integration has primarily focused on automating specific tasks, often overlooking the complexity and variability of human aspects in construction workflows.

Reinforcement Learning (RL)

AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head

1 code implementation • 25 Apr 2023 • Rongjie Huang, Mingze Li, Dongchao Yang, Jiatong Shi, Xuankai Chang, Zhenhui Ye, Yuning Wu, Zhiqing Hong, Jiawei Huang, Jinglin Liu, Yi Ren, Zhou Zhao, Shinji Watanabe

In this work, we propose a multi-modal AI system named AudioGPT, which complements LLMs (i. e., ChatGPT) with 1) foundation models to process complex audio information and solve numerous understanding and generation tasks; and 2) the input/output interface (ASR, TTS) to support spoken dialogue.

Learning Dense Reward with Temporal Variant Self-Supervision

no code implementations • 20 May 2022 • Yuning Wu, Jieliang Luo, Hui Li

Rewards play an essential role in reinforcement learning.

Self-Supervised Learning