Search Results for author:
Found 5 papers, 4 papers with code
VideoWebArena: Evaluating Long Context Multimodal Agents with Video Understanding Web Tasks
Videos are often used to learn or extract the necessary information to complete tasks in ways different than what text and static imagery alone can provide.
Windows Agent Arena: Evaluating Multi-Modal OS Agents at Scale
To demonstrate Windows Agent Arena's capabilities, we also introduce a new multi-modal agent, Navi.
VLM Agents Generate Their Own Memories: Distilling Experience into Embodied Programs of Thought
We propose In-Context Abstraction Learning (ICAL), a method that builds a memory of multimodal experience from sub-optimal demonstrations and human feedback.
VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web Tasks
Through extensive quantitative and qualitative analysis, we identify several limitations of text-only LLM agents, and reveal gaps in the capabilities of state-of-the-art multimodal language agents.
MMoE: Enhancing Multimodal Models with Mixtures of Multimodal Interaction Experts
Advances in multimodal models have greatly improved how interactions relevant to various tasks are modeled.
