Search Results for author: Kaiyu Zheng

Found 13 papers, 7 papers with code

Dial-insight: Fine-tuning Large Language Models with High-Quality Domain-Specific Data Preventing Capability Collapse

no code implementations14 Mar 2024 Jianwei Sun, Chaoyang Mei, Linlin Wei, Kaiyu Zheng, Na Liu, Ming Cui, Tianyi Li

The efficacy of large language models (LLMs) is heavily dependent on the quality of the underlying data, particularly within specialized domains.

A System for Generalized 3D Multi-Object Search

1 code implementation6 Mar 2023 Kaiyu Zheng, Anirudha Paul, Stefanie Tellex

GenMOS takes as input point cloud observations of the local region, object detection results, and localization of the robot's view pose, and outputs a 6D viewpoint to move to through online planning.

Object object-detection +1

Generalized Object Search

no code implementations24 Jan 2023 Kaiyu Zheng

Future collaborative robots must be capable of finding objects.

Motion Planning Object +2

Hierarchical Reinforcement Learning of Locomotion Policies in Response to Approaching Objects: A Preliminary Study

no code implementations20 Mar 2022 Shangqun Yu, Sreehari Rammohan, Kaiyu Zheng, George Konidaris

Animals such as rabbits and birds can instantly generate locomotion behavior in reaction to a dynamic, approaching object, such as a person or a rock, despite having possibly never seen the object before and having limited perception of the object's properties.

Hierarchical Reinforcement Learning Object +2

Towards Optimal Correlational Object Search

1 code implementation19 Oct 2021 Kaiyu Zheng, Rohan Chitnis, Yoonchang Sung, George Konidaris, Stefanie Tellex

In realistic applications of object search, robots will need to locate target objects in complex environments while coping with unreliable sensors, especially for small or hard-to-detect objects.

Object

Dialogue Object Search

no code implementations22 Jul 2021 Monica Roy, Kaiyu Zheng, Jason Liu, Stefanie Tellex

To this end, we introduce a new task, dialogue object search: A robot is tasked to search for a target object (e. g. fork) in a human environment (e. g., kitchen), while engaging in a "video call" with a remote human who has additional but inexact knowledge about the target's location.

Object

Spatial Language Understanding for Object Search in Partially Observed City-scale Environments

1 code implementation4 Dec 2020 Kaiyu Zheng, Deniz Bayazit, Rebecca Mathew, Ellie Pavlick, Stefanie Tellex

We propose SLOOP (Spatial Language Object-Oriented POMDP), a new framework for partially observable decision making with a probabilistic observation model for spatial language.

Decision Making Instruction Following

Multi-Resolution POMDP Planning for Multi-Object Search in 3D

1 code implementation6 May 2020 Kaiyu Zheng, Yoonchang Sung, George Konidaris, Stefanie Tellex

Robots operating in households must find objects on shelves, under tables, and in cupboards.

pomdp_py: A Framework to Build and Solve POMDP Problems

1 code implementation21 Apr 2020 Kaiyu Zheng, Stefanie Tellex

In this paper, we present pomdp_py, a general purpose Partially Observable Markov Decision Process (POMDP) library written in Python and Cython.

From Pixels to Buildings: End-to-end Probabilistic Deep Networks for Large-scale Semantic Mapping

no code implementations31 Dec 2018 Kaiyu Zheng, Andrzej Pronobis

We introduce TopoNets, end-to-end probabilistic deep networks for modeling semantic maps with structure reflecting the topology of large-scale environments.

Learning Graph-Structured Sum-Product Networks for Probabilistic Semantic Maps

1 code implementation24 Sep 2017 Kaiyu Zheng, Andrzej Pronobis, Rajesh P. N. Rao

We introduce Graph-Structured Sum-Product Networks (GraphSPNs), a probabilistic approach to structured prediction for problems where dependencies between latent variables are expressed in terms of arbitrary, dynamic graphs.

Structured Prediction

ROS Navigation Tuning Guide

1 code implementation27 Jun 2017 Kaiyu Zheng

This article intends to guide the reader through the process of fine tuning navigation parameters.

Robotics

Learning Large-Scale Topological Maps Using Sum-Product Networks

no code implementations11 Jun 2017 Kaiyu Zheng

Our experiments evaluate the ability of our models to enable robots to infer semantic attributes and detect maps with novel semantic attribute arrangements.

Attribute Probabilistic Deep Learning

Cannot find the paper you are looking for? You can Submit a new open access paper.