Aligning Knowledge Graph with Visual Perception for Object-goal Navigation

1 code implementation • 29 Feb 2024 • Nuo Xu, Wen Wang, Rong Yang, Mengjie Qin, Zheyuan Lin, Wei Song, Chunlong Zhang, Jason Gu, Chao Li

Object-goal navigation is a challenging task that requires guiding an agent to specific objects based on first-person visual observations.

Object

End-To-End Audiovisual Feature Fusion for Active Speaker Detection

no code implementations • 27 Jul 2022 • Fiseha B. Tesema, Zheyuan Lin, Shiqiang Zhu, Wei Song, Jason Gu, Hong Wu

After fusion, one BiGRU layer is attached to model the joint temporal dynamics.

TGRMPT: A Head-Shoulder Aided Multi-Person Tracker and a New Large-Scale Dataset for Tour-Guide Robot

1 code implementation • 8 Jul 2022 • Wen Wang, Shunda Hu, Shiqiang Zhu, Wei Song, Zheyuan Lin, Tianlei Jin, Zonghao Mu, Yuanhai Zhou

A service robot serving safely and politely needs to track the surrounding people robustly, especially for Tour-Guide Robot (TGR).

Multi-Object Tracking