UniCon+: ICTCAS-UCAS Submission to the AVA-ActiveSpeaker Task at ActivityNet Challenge 2022

22 Jun 2022  ·  Yuanhang Zhang, Susan Liang, Shuang Yang, Shiguang Shan ·

This report presents a brief description of our winning solution to the AVA Active Speaker Detection (ASD) task at ActivityNet Challenge 2022. Our underlying model UniCon+ continues to build on our previous work, the Unified Context Network (UniCon) and Extended UniCon which are designed for robust scene-level ASD. We augment the architecture with a simple GRU-based module that allows information of recurring identities to flow across scenes through read and update operations. We report a best result of 94.47% mAP on the AVA-ActiveSpeaker test set, which continues to rank first on this year's challenge leaderboard and significantly pushes the state-of-the-art.

PDF Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Audio-Visual Active Speaker Detection AVA-ActiveSpeaker UniCon+ validation mean average precision 94.5% # 2

Methods