Search Results for author: Klaus Greff

Found 25 papers, 16 papers with code

Sensitivity of Slot-Based Object-Centric Models to their Number of Slots

no code implementations30 May 2023 Roland S. Zimmermann, Sjoerd van Steenkiste, Mehdi S. M. Sajjadi, Thomas Kipf, Klaus Greff

Self-supervised methods for learning object-centric representations have recently been applied successfully to various datasets.

AudioSlots: A slot-centric generative model for audio separation

no code implementations9 May 2023 Pradyumna Reddy, Scott Wisdom, Klaus Greff, John R. Hershey, Thomas Kipf

We discuss the results and limitations of our approach in detail, and further outline potential ways to overcome the limitations and directions for future work.

Speech Separation

RUST: Latent Neural Scene Representations from Unposed Imagery

no code implementations CVPR 2023 Mehdi S. M. Sajjadi, Aravindh Mahendran, Thomas Kipf, Etienne Pot, Daniel Duckworth, Mario Lucic, Klaus Greff

Our main insight is that one can train a Pose Encoder that peeks at the target image and learns a latent pose embedding which is used by the decoder for view synthesis.

Novel View Synthesis

SlotFormer: Unsupervised Visual Dynamics Simulation with Object-Centric Models

1 code implementation12 Oct 2022 Ziyi Wu, Nikita Dvornik, Klaus Greff, Thomas Kipf, Animesh Garg

While recent object-centric models can successfully decompose a scene into objects, modeling their dynamics effectively still remains a challenge.

Question Answering Video Prediction +1

Object Scene Representation Transformer

no code implementations14 Jun 2022 Mehdi S. M. Sajjadi, Daniel Duckworth, Aravindh Mahendran, Sjoerd van Steenkiste, Filip Pavetić, Mario Lučić, Leonidas J. Guibas, Klaus Greff, Thomas Kipf

A compositional understanding of the world in terms of objects and their geometry in 3D space is considered a cornerstone of human cognition.

Novel View Synthesis Representation Learning

Scene Representation Transformer: Geometry-Free Novel View Synthesis Through Set-Latent Scene Representations

1 code implementation CVPR 2022 Mehdi S. M. Sajjadi, Henning Meyer, Etienne Pot, Urs Bergmann, Klaus Greff, Noha Radwan, Suhani Vora, Mario Lucic, Daniel Duckworth, Alexey Dosovitskiy, Jakob Uszkoreit, Thomas Funkhouser, Andrea Tagliasacchi

In this work, we propose the Scene Representation Transformer (SRT), a method which processes posed or unposed RGB images of a new area, infers a "set-latent scene representation", and synthesises novel views, all in a single feed-forward pass.

Novel View Synthesis Semantic Segmentation

Conditional Object-Centric Learning from Video

2 code implementations ICLR 2022 Thomas Kipf, Gamaleldin F. Elsayed, Aravindh Mahendran, Austin Stone, Sara Sabour, Georg Heigold, Rico Jonschkowski, Alexey Dosovitskiy, Klaus Greff

Object-centric representations are a promising path toward more systematic generalization by providing flexible abstractions upon which compositional world models can be built.

Instance Segmentation Optical Flow Estimation +2

On the Binding Problem in Artificial Neural Networks

no code implementations9 Dec 2020 Klaus Greff, Sjoerd van Steenkiste, Jürgen Schmidhuber

Contemporary neural networks still fall short of human-level generalization, which extends far beyond our direct experiences.

Learning Object-Centric Video Models by Contrasting Sets

no code implementations20 Nov 2020 Sindy Löwe, Klaus Greff, Rico Jonschkowski, Alexey Dosovitskiy, Thomas Kipf

We address this problem by introducing a global, set-based contrastive loss: instead of contrasting individual slot representations against one another, we aggregate the representations and contrast the joined sets against one another.

Future prediction Self-Supervised Learning

A Perspective on Objects and Systematic Generalization in Model-Based RL

no code implementations3 Jun 2019 Sjoerd van Steenkiste, Klaus Greff, Jürgen Schmidhuber

In order to meet the diverse challenges in solving many real-world problems, an intelligent agent has to be able to dynamically construct a model of its environment.

Systematic Generalization

Neural Expectation Maximization

1 code implementation NeurIPS 2017 Klaus Greff, Sjoerd van Steenkiste, Jürgen Schmidhuber

Many real world tasks such as reasoning and physical interaction require identification and manipulation of conceptual entities.


Highway and Residual Networks learn Unrolled Iterative Estimation

no code implementations22 Dec 2016 Klaus Greff, Rupesh K. Srivastava, Jürgen Schmidhuber

We demonstrate that this viewpoint directly leads to the construction of Highway and Residual networks.

Tagger: Deep Unsupervised Perceptual Grouping

2 code implementations NeurIPS 2016 Klaus Greff, Antti Rasmus, Mathias Berglund, Tele Hotloo Hao, Jürgen Schmidhuber, Harri Valpola

We present a framework for efficient perceptual inference that explicitly reasons about the segmentation of its inputs and features.

General Classification

Scalable Gradient-Based Tuning of Continuous Regularization Hyperparameters

1 code implementation20 Nov 2015 Jelena Luketina, Mathias Berglund, Klaus Greff, Tapani Raiko

Hyperparameter selection generally relies on running multiple full training trials, with selection based on validation set performance.

Hyperparameter Optimization

Binding via Reconstruction Clustering

1 code implementation19 Nov 2015 Klaus Greff, Rupesh Kumar Srivastava, Jürgen Schmidhuber

Disentangled distributed representations of data are desirable for machine learning, since they are more expressive and can generalize from fewer examples.

Clustering Denoising +1

Training Very Deep Networks

3 code implementations NeurIPS 2015 Rupesh Kumar Srivastava, Klaus Greff, Jürgen Schmidhuber

Theoretical and empirical evidence indicates that the depth of neural networks is crucial for their success.

Image Classification

Highway Networks

3 code implementations3 May 2015 Rupesh Kumar Srivastava, Klaus Greff, Jürgen Schmidhuber

There is plenty of theoretical and empirical evidence that depth of neural networks is a crucial ingredient for their success.

Language Modelling

LSTM: A Search Space Odyssey

14 code implementations13 Mar 2015 Klaus Greff, Rupesh Kumar Srivastava, Jan Koutník, Bas R. Steunebrink, Jürgen Schmidhuber

Several variants of the Long Short-Term Memory (LSTM) architecture for recurrent neural networks have been proposed since its inception in 1995.

Handwriting Recognition Music Modeling +1

A Clockwork RNN

5 code implementations14 Feb 2014 Jan Koutník, Klaus Greff, Faustino Gomez, Jürgen Schmidhuber

Sequence prediction and classification are ubiquitous and challenging problems in machine learning that can require identifying complex dependencies between temporally distant inputs.

General Classification

Cannot find the paper you are looking for? You can Submit a new open access paper.