Search Results for author:
Found 6 papers, 2 papers with code
Eureka-Moments in Transformers: Multi-Step Tasks Reveal Softmax Induced Optimization Problems
In this work, we study rapid, step-wise improvements of the loss in transformers when being confronted with multi-step decision tasks.
Unified Fully and Timestamp Supervised Temporal Action Segmentation via Sequence to Sequence Translation
This paper introduces a unified framework for video action segmentation via sequence to sequence (seq2seq) translation in a fully and timestamp supervised setup.
Ranked #4 on
Action Segmentation
on Assembly101
Ranking Info Noise Contrastive Estimation: Boosting Contrastive Learning via Ranked Positives
This paper introduces Ranking Info Noise Contrastive Estimation (RINCE), a new member in the family of InfoNCE losses that preserves a ranked ordering of positive samples.
Long Short View Feature Decomposition via Contrastive Video Representation Learning
We argue that a single representation to capture both types of features is sub-optimal, and propose to decompose the representation space into stationary and non-stationary features via contrastive learning from long and short views, i. e. long video sequences and their shorter sub-sequences.
Unsupervised Video Representation Learning by Bidirectional Feature Prediction
This paper introduces a novel method for self-supervised video representation learning via feature prediction.
Meta-Learning Runge-Kutta
However, by studying the characteristics of the local error function we show that including the partial derivatives of the initial value problem is favorable.
