Motion-Guided Masking for Spatiotemporal Representation Learning

no code implementations • ICCV 2023 • David Fan, Jue Wang, Shuai Liao, Yi Zhu, Vimal Bhat, Hector Santos-Villalobos, Rohith MV, Xinyu Li

This suggests that the random masking strategy that is inherited from the image MAE is less effective for video MAE.

Domain Adaptation Representation Learning +2

MEGA: Multimodal Alignment Aggregation and Distillation For Cinematic Video Segmentation

no code implementations • ICCV 2023 • Najmeh Sadoughi, Xinyu Li, Avijit Vajpayee, David Fan, Bing Shuai, Hector Santos-Villalobos, Vimal Bhat, Rohith MV

Previous research has studied the task of segmenting cinematic videos into scenes and into narrative acts.

Scene Segmentation Segmentation +2

Nearest-Neighbor Inter-Intra Contrastive Learning from Unlabeled Videos

no code implementations • 13 Mar 2023 • David Fan, Deyu Yang, Xinyu Li, Vimal Bhat, Rohith MV

Contrastive learning has recently narrowed the gap between self-supervised and supervised methods in image and video domain.

Contrastive Learning

Shot Contrastive Self-Supervised Learning for Scene Boundary Detection

no code implementations • CVPR 2021 • Shixing Chen, Xiaohan Nie, David Fan, Dongqing Zhang, Vimal Bhat, Raffay Hamid

To assess the effectiveness of ShotCoL on novel applications of scene boundary detection, we take on the problem of finding timestamps in movies and TV episodes where video-ads can be inserted while offering a minimally disruptive viewing experience.

Boundary Detection Contrastive Learning +1