Search Results for author:
Found 16 papers, 5 papers with code
Guidance Free Image Editing via Explicit Conditioning
We present Explicit Conditioning (EC) of the noise distribution on the input modalities to achieve this.
EDiT: Efficient Diffusion Transformers with Linear Compressed Attention
Second, we formulate a hybrid attention scheme for multi-modal inputs that combines linear attention for image-to-image interactions and standard scaled dot-product attention for interactions involving prompts.
Edge-SD-SR: Low Latency and Parameter Efficient On-device Super-Resolution with Stable Diffusion via Bidirectional Conditioning
To maintain a high visual quality on such low compute budget, we introduce a number of training strategies: (i) A novel conditioning mechanism on the low resolution input, coined bidirectional conditioning, which tailors the SD model for the SR task.
You Only Need One Step: Fast Super-Resolution with Stable Diffusion via Scale Distillation
We show that the combination of spatially distilled U-Net and fine-tuned decoder outperforms state-of-the-art methods requiring 200 steps with only one single step.
Unified Fully and Timestamp Supervised Temporal Action Segmentation via Sequence to Sequence Translation
This paper introduces a unified framework for video action segmentation via sequence to sequence (seq2seq) translation in a fully and timestamp supervised setup.
Ranked #5 on
Action Segmentation
on Assembly101
Ranking Info Noise Contrastive Estimation: Boosting Contrastive Learning via Ranked Positives
This paper introduces Ranking Info Noise Contrastive Estimation (RINCE), a new member in the family of InfoNCE losses that preserves a ranked ordering of positive samples.
TaylorSwiftNet: Taylor Driven Temporal Modeling for Swift Future Frame Prediction
While recurrent neural networks (RNNs) demonstrate outstanding capabilities for future video frame prediction, they model dynamics in a discrete time space, i. e., they predict the frames sequentially with a fixed temporal step.
Long Short View Feature Decomposition via Contrastive Video Representation Learning
We argue that a single representation to capture both types of features is sub-optimal, and propose to decompose the representation space into stationary and non-stationary features via contrastive learning from long and short views, i. e. long video sequences and their shorter sub-sequences.
Self-labeled Conditional GANs
This paper introduces a novel and fully unsupervised framework for conditional GAN training in which labels are automatically obtained from data.
3D CNNs with Adaptive Temporal Feature Resolutions
While the GFLOPs of a 3D CNN can be decreased by reducing the temporal feature resolution within the network, there is no setting that is optimal for all input clips.
Unsupervised Video Representation Learning by Bidirectional Feature Prediction
This paper introduces a novel method for self-supervised video representation learning via feature prediction.
Boosting Self-Supervised Learning via Knowledge Transfer
We use this framework to design a novel self-supervised task, which achieves state-of-the-art performance on the common benchmarks in PASCAL VOC 2007, ILSVRC12 and Places by a significant margin.
Representation Learning by Learning to Count
In this paper, we use two image transformations in the context of counting: scaling and tiling.
Ranked #142 on
Self-Supervised Image Classification
on ImageNet
Reflection Separation and Deblurring of Plenoptic Images
In this paper, we address the problem of reflection removal and deblurring from a single image captured by a plenoptic camera.
Motion Deblurring in the Wild
The task of image deblurring is a very ill-posed problem as both the image and the blur are unknown.
Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzles
By following the principles of self-supervision, we build a convolutional neural network (CNN) that can be trained to solve Jigsaw puzzles as a pretext task, which requires no manual labeling, and then later repurposed to solve object classification and detection.
