Technical Report: Temporal Aggregate Representations

6 Jun 2021  ·  Fadime Sener, Dibyadip Chatterjee, Angela Yao ·

This technical report extends our work presented in [9] with more experiments. In [9], we tackle long-term video understanding, which requires reasoning from current and past or future observations and raises several fundamental questions. How should temporal or sequential relationships be modelled? What temporal extent of information and context needs to be processed? At what temporal scale should they be derived? [9] addresses these questions with a flexible multi-granular temporal aggregation framework. In this report, we conduct further experiments with this framework on different tasks and a new dataset, EPIC-KITCHENS-100.

PDF Abstract

Datasets


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Action Anticipation EPIC-KITCHENS-100 TempAgg Recall@5 14.73 # 5
Action Recognition EPIC-KITCHENS-100 TempAgg Action@1 45.26 # 14
Verb@1 66 # 22
Noun@1 53.35 # 21
Action Anticipation EPIC-KITCHENS-100 (test) TempAgg recall@5 12.6 # 5

Methods


No methods listed for this paper. Add relevant methods here