Search Results for author:
Found 7 papers, 2 papers with code
"Is This It?": Towards Ecologically Valid Benchmarks for Situated Collaboration
We report initial work towards constructing ecologically valid benchmarks to assess the capabilities of large multimodal models for engaging in situated collaboration.
SIGMA: An Open-Source Interactive System for Mixed-Reality Task Assistance Research
We introduce an open-source system called SIGMA (short for "Situated Interactive Guidance, Monitoring, and Assistance") as a platform for conducting research on task-assistive agents in mixed-reality scenarios.
HoloAssist: an Egocentric Human Interaction Dataset for Interactive AI Assistants in the Real World
Building an interactive AI assistant that can perceive, reason, and collaborate with humans in the real world has been a long-standing pursuit in the AI community.
Platform for Situated Intelligence
We introduce Platform for Situated Intelligence, an open-source framework created to support the rapid development and study of multimodal, integrative-AI systems.
Accelerating the Development of Multimodal, Integrative-AI Systems with Platform for Situated Intelligence
We describe Platform for Situated Intelligence, an open-source framework for multimodal, integrative-AI systems.
REFORM: Recognizing F-formations for Social Robots
Recognizing and understanding conversational groups, or F-formations, is a critical task for situated agents designed to interact with humans.
Metareasoning in Modular Software Systems: On-the-Fly Configuration using Reinforcement Learning with Rich Contextual Representations
We address the opportunity to maximize the utility of an overall computing system by employing reinforcement learning to guide the configuration of the set of interacting modules that comprise the system.
