no code implementations • 14 Mar 2024 • Jianwei Sun, Chaoyang Mei, Linlin Wei, Kaiyu Zheng, Na Liu, Ming Cui, Tianyi Li
The efficacy of large language models (LLMs) is heavily dependent on the quality of the underlying data, particularly within specialized domains.
1 code implementation • 6 Mar 2023 • Kaiyu Zheng, Anirudha Paul, Stefanie Tellex
GenMOS takes as input point cloud observations of the local region, object detection results, and localization of the robot's view pose, and outputs a 6D viewpoint to move to through online planning.
no code implementations • 24 Jan 2023 • Kaiyu Zheng
Future collaborative robots must be capable of finding objects.
no code implementations • 20 Mar 2022 • Shangqun Yu, Sreehari Rammohan, Kaiyu Zheng, George Konidaris
Animals such as rabbits and birds can instantly generate locomotion behavior in reaction to a dynamic, approaching object, such as a person or a rock, despite having possibly never seen the object before and having limited perception of the object's properties.
1 code implementation • 19 Oct 2021 • Kaiyu Zheng, Rohan Chitnis, Yoonchang Sung, George Konidaris, Stefanie Tellex
In realistic applications of object search, robots will need to locate target objects in complex environments while coping with unreliable sensors, especially for small or hard-to-detect objects.
no code implementations • 22 Jul 2021 • Monica Roy, Kaiyu Zheng, Jason Liu, Stefanie Tellex
To this end, we introduce a new task, dialogue object search: A robot is tasked to search for a target object (e. g. fork) in a human environment (e. g., kitchen), while engaging in a "video call" with a remote human who has additional but inexact knowledge about the target's location.
1 code implementation • 4 Dec 2020 • Kaiyu Zheng, Deniz Bayazit, Rebecca Mathew, Ellie Pavlick, Stefanie Tellex
We propose SLOOP (Spatial Language Object-Oriented POMDP), a new framework for partially observable decision making with a probabilistic observation model for spatial language.
1 code implementation • 6 May 2020 • Kaiyu Zheng, Yoonchang Sung, George Konidaris, Stefanie Tellex
Robots operating in households must find objects on shelves, under tables, and in cupboards.
1 code implementation • 21 Apr 2020 • Kaiyu Zheng, Stefanie Tellex
In this paper, we present pomdp_py, a general purpose Partially Observable Markov Decision Process (POMDP) library written in Python and Cython.
no code implementations • 31 Dec 2018 • Kaiyu Zheng, Andrzej Pronobis
We introduce TopoNets, end-to-end probabilistic deep networks for modeling semantic maps with structure reflecting the topology of large-scale environments.
1 code implementation • 24 Sep 2017 • Kaiyu Zheng, Andrzej Pronobis, Rajesh P. N. Rao
We introduce Graph-Structured Sum-Product Networks (GraphSPNs), a probabilistic approach to structured prediction for problems where dependencies between latent variables are expressed in terms of arbitrary, dynamic graphs.
1 code implementation • 27 Jun 2017 • Kaiyu Zheng
This article intends to guide the reader through the process of fine tuning navigation parameters.
Robotics
no code implementations • 11 Jun 2017 • Kaiyu Zheng
Our experiments evaluate the ability of our models to enable robots to infer semantic attributes and detect maps with novel semantic attribute arrangements.