SoundCam: A Dataset for Finding Humans Using Room Acoustics

no code implementations • NeurIPS 2023 • Mason Wang, Samuel Clarke, Jui-Hsien Wang, Ruohan Gao, Jiajun Wu

A room's acoustic properties are a product of the room's geometry, the objects within the room, and their specific positions.

RealImpact: A Dataset of Impact Sound Fields for Real Objects

no code implementations • CVPR 2023 • Samuel Clarke, Ruohan Gao, Mason Wang, Mark Rau, Julia Xu, Jui-Hsien Wang, Doug L. James, Jiajun Wu

Objects make unique sounds under different perturbations, environment conditions, and poses relative to the listener.

audio-visual learning

Sparse Fusion for Multimodal Transformers

no code implementations • 23 Nov 2021 • Yi Ding, Alex Rich, Mason Wang, Noah Stier, Matthew Turk, Pradeep Sen, Tobias Höllerer

Multimodal classification is a core task in human-centric machine learning.

ClefNet: Recurrent Autoencoders with Dynamic Time Warping for Near-Lossless Music Compression and Minimal-Latency Transmission

1 code implementation • 15 Mar 2021 • Vignav Ramesh, Mason Wang

The onset of coronavirus disease 2019 (COVID-19), an infectious disease caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), has sparked unprecedented change.

Audio Compression Dynamic Time Warping +1