Sonicverse is a multisensory simulation platform with integrated audio-visual simulation for training household agents that can both see and hear. Sonicverse models realistic continuous audio rendering in 3D environments in real-time. Together with a new audio-Visual VR interface that allows humans to interact with agents with audio, Sonicverse enables a series of embodied AI tasks that need audio-visual perception.
Source: Sonicverse: A Multisensory Simulation Platform for Embodied Household Agents that See and HearPaper | Code | Results | Date | Stars |
---|