Visually-Guided Sound Source Separation with Audio-Visual Predictive Coding

1 code implementation • 19 Jun 2023 • Zengjie Song, Zhaoxiang Zhang

The framework of visually-guided sound source separation generally consists of three parts: visual feature extraction, multimodal feature fusion, and sound signal processing.

valid Visually Guided Sound Source Separation

SSF: Accelerating Training of Spiking Neural Networks with Stabilized Spiking Flow

no code implementations • ICCV 2023 • Jingtao Wang, Zengjie Song, Yuxi Wang, Jun Xiao, Yuran Yang, Shuqi Mei, Zhaoxiang Zhang

Surrogate gradient (SG) is one of the most effective approaches for training spiking neural networks (SNNs).

Self-Supervised Predictive Learning: A Negative-Free Method for Sound Source Localization in Visual Scenes

1 code implementation • CVPR 2022 • Zengjie Song, Yuxi Wang, Junsong Fan, Tieniu Tan, Zhaoxiang Zhang

Sound source localization in visual scenes aims to localize objects emitting the sound in a given image.

Contrastive Learning

Toward a Controllable Disentanglement Network

1 code implementation • 22 Jan 2020 • Zengjie Song, Oluwasanmi Koyejo, Jiangshe Zhang

By exploring the real-valued space of the soft target representation, we are able to synthesize novel images with the designated properties.

Disentanglement Generative Adversarial Network

Learning Controllable Disentangled Representations with Decorrelation Regularization

no code implementations • 25 Dec 2019 • Zengjie Song, Oluwasanmi Koyejo, Jiangshe Zhang

By exploiting the real-valued space of the soft target representations, we are able to synthesize novel images with the designated properties.

Disentanglement