Search Results for author: Dan Bohus

Found 9 papers, 1 papers with code

"Is This It?": Towards Ecologically Valid Benchmarks for Situated Collaboration

no code implementations • 30 Aug 2024 • Dan Bohus, Sean Andrist, Yuwei Bao, Eric Horvitz, Ann Paradiso

We report initial work towards constructing ecologically valid benchmarks to assess the capabilities of large multimodal models for engaging in situated collaboration.

Embodied Question Answering Question Answering +1

Paper
Add Code

SIGMA: An Open-Source Interactive System for Mixed-Reality Task Assistance Research

no code implementations • 16 May 2024 • Dan Bohus, Sean Andrist, Nick Saw, Ann Paradiso, Ishani Chakraborty, Mahdi Rad

We introduce an open-source system called SIGMA (short for "Situated Interactive Guidance, Monitoring, and Assistance") as a platform for conducting research on task-assistive agents in mixed-reality scenarios.

Mixed Reality

Paper
Add Code

HoloAssist: an Egocentric Human Interaction Dataset for Interactive AI Assistants in the Real World

no code implementations • ICCV 2023 • Xin Wang, Taein Kwon, Mahdi Rad, Bowen Pan, Ishani Chakraborty, Sean Andrist, Dan Bohus, Ashley Feniello, Bugra Tekin, Felipe Vieira Frujeri, Neel Joshi, Marc Pollefeys

Building an interactive AI assistant that can perceive, reason, and collaborate with humans in the real world has been a long-standing pursuit in the AI community.

Mistake Detection Mixed Reality +1

Paper
Add Code

Platform for Situated Intelligence

1 code implementation • 29 Mar 2021 • Dan Bohus, Sean Andrist, Ashley Feniello, Nick Saw, Mihai Jalobeanu, Patrick Sweeney, Anne Loomis Thompson, Eric Horvitz

We introduce Platform for Situated Intelligence, an open-source framework created to support the rapid development and study of multimodal, integrative-AI systems.

537

Paper
Code