Search Results for author:
Found 9 papers, 4 papers with code
The Sound of Pixels
We introduce PixelPlayer, a system that, by leveraging large amounts of unlabeled videos, learns to locate image regions which produce sounds and separate the input sounds into a set of components that represents the sound from each pixel.
The ThreeDWorld Transport Challenge: A Visually Guided Task-and-Motion Planning Benchmark for Physically Realistic Embodied AI
To complete the task, an embodied agent must plan a sequence of actions to change the state of a large number of objects in the face of realistic physical constraints.
Untangling in Invariant Speech Recognition
Higher level concepts such as parts-of-speech and context dependence also emerge in the later layers of the network.
Metamers of neural networks reveal divergence from human perceptual systems
Although model metamers from early network layers were recognizable to humans, those from deeper layers were not.
Self-Supervised Audio-Visual Co-Segmentation
Segmenting objects in images and separating sound sources in audio are challenging tasks, in part because traditional approaches require large amounts of labeled data.
Probing emergent geometry in speech models via replica theory
The success of deep neural networks in visual tasks have motivated recent theoretical and empirical work to understand how these networks operate.
Object-based synthesis of scraping and rolling sounds based on non-linear physical constraints
Sustained contact interactions like scraping and rolling produce a wide variety of sounds.
Finding Fallen Objects Via Asynchronous Audio-Visual Integration
The way an object looks and sounds provide complementary reflections of its physical properties.
