no code implementations • 28 Aug 2023 • Di Yang, Yaohui Wang, Antitza Dantcheva, Quan Kong, Lorenzo Garattoni, Gianpiero Francesca, Francois Bremond
In this context, we propose Latent Action Composition (LAC), a novel self-supervised framework aiming at learning from synthesized composable motions for skeleton-based action segmentation.
1 code implementation • ICCV 2023 • Emad Bahrami, Gianpiero Francesca, Juergen Gall
In this work, we try to answer how much long-term temporal context is required for temporal action segmentation by introducing a transformer-based model that leverages sparse attention to capture the full context of a video.
Ranked #1 on Action Segmentation on Assembly101
no code implementations • 10 May 2023 • Di Yang, Yaohui Wang, Quan Kong, Antitza Dantcheva, Lorenzo Garattoni, Gianpiero Francesca, Francois Bremond
Self-supervised video representation learning aimed at maximizing similarity between different temporal segments of one video, in order to enforce feature persistence over time.
no code implementations • 19 Jan 2023 • Snehashis Majhi, Rui Dai, Quan Kong, Lorenzo Garattoni, Gianpiero Francesca, Francois Bremond
Video anomaly detection in surveillance systems with only video-level labels (i. e. weakly-supervised) is challenging.
no code implementations • ICCV 2023 • Di Yang, Yaohui Wang, Antitza Dantcheva, Quan Kong, Lorenzo Garattoni, Gianpiero Francesca, Francois Bremond
In this context, we propose Latent Action Composition (LAC), a novel self-supervised framework aiming at learning from synthesized composable motions for skeleton-based action segmentation.
no code implementations • 12 Oct 2022 • Yaser Souri, Yazan Abu Farha, Emad Bahrami, Gianpiero Francesca, Juergen Gall
As obtaining annotations to train an approach for action segmentation in a fully supervised way is expensive, various approaches have been proposed to train action segmentation models using different forms of weak supervision, e. g., action transcripts, action sets, or more recently timestamps.
1 code implementation • 31 Aug 2022 • Di Yang, Yaohui Wang, Antitza Dantcheva, Lorenzo Garattoni, Gianpiero Francesca, Francois Bremond
Current self-supervised approaches for skeleton action representation learning often focus on constrained scenarios, where videos and skeleton data are recorded in laboratory settings.
no code implementations • 27 Oct 2021 • Saber Pourheydari, Emad Bahrami, Mohsen Fayyaz, Gianpiero Francesca, Mehdi Noroozi, Juergen Gall
While recurrent neural networks (RNNs) demonstrate outstanding capabilities for future video frame prediction, they model dynamics in a discrete time space, i. e., they predict the frames sequentially with a fixed temporal step.
no code implementations • 9 Aug 2021 • Yaser Souri, Yazan Abu Farha, Fabien Despinoy, Gianpiero Francesca, Juergen Gall
We apply FIFA on top of state-of-the-art approaches for weakly supervised action segmentation and alignment as well as fully supervised action segmentation.
Segmentation Weakly Supervised Action Segmentation (Transcript)
1 code implementation • 19 Jul 2021 • Di Yang, Yaohui Wang, Antitza Dantcheva, Lorenzo Garattoni, Gianpiero Francesca, Francois Bremond
This is achieved by learning an optimal dependency matrix from the uniform distribution based on a multi-head attention mechanism.
Ranked #1 on Skeleton Based Action Recognition on UPenn Action
1 code implementation • 5 Jan 2021 • Rui Dai, Srijan Das, Luca Minciullo, Lorenzo Garattoni, Gianpiero Francesca, Francois Bremond
Previous action detection methods fail in selecting the key temporal information in long videos.
Ranked #1 on Action Detection on TSU
1 code implementation • 10 Nov 2020 • Di Yang, Rui Dai, Yaohui Wang, Rupayan Mallick, Luca Minciullo, Gianpiero Francesca, Francois Bremond
Taking advantage of human pose data for understanding human activities has attracted much attention these days.
1 code implementation • 28 Oct 2020 • Rui Dai, Srijan Das, Saurav Sharma, Luca Minciullo, Lorenzo Garattoni, Francois Bremond, Gianpiero Francesca
Therefore, we propose a new baseline method for activity detection to tackle the novel challenges provided by our dataset.
1 code implementation • 5 Apr 2019 • Yaser Souri, Mohsen Fayyaz, Luca Minciullo, Gianpiero Francesca, Juergen Gall
Action segmentation is the task of predicting the actions for each frame of a video.
Segmentation Weakly Supervised Action Segmentation (Transcript)
no code implementations • 1 Feb 2018 • Srijan Das, Michal Koperski, Francois Bremond, Gianpiero Francesca
In this paper, we propose to improve the traditional use of RNNs by employing a many to many model for video classification.