Search Results for author: Patrick van der Smagt

Found 58 papers, 10 papers with code

A dataset of primary nasopharyngeal carcinoma MRI with multi-modalities segmentation

no code implementations4 Apr 2024 Yin Li, Qi Chen, Kai Wang, Meige Li, Liping Si, Yingwei Guo, Yu Xiong, Qixing Wang, Yang Qin, Ling Xu, Patrick van der Smagt, Jun Tang, Nutan Chen

Multi-modality magnetic resonance imaging data with various sequences facilitate the early diagnosis, tumor segmentation, and disease staging in the management of nasopharyngeal carcinoma (NPC).

Management Tumor Segmentation

Guided Decoding for Robot Motion Generation and Adaption

no code implementations22 Mar 2024 Nutan Chen, Elie Aljalbout, Botond Cseke, Patrick van der Smagt

This integration facilitates rapid adaptation to new tasks and optimizes the utilization of accumulated expertise by allowing robots to learn and generalize from demonstrated trajectories.

Sequential Model for Predicting Patient Adherence in Subcutaneous Immunotherapy for Allergic Rhinitis

1 code implementation21 Jan 2024 Yin Li, Yu Xiong, Wenxin Fan, Kai Wang, Qingqing Yu, Liping Si, Patrick van der Smagt, Jun Tang, Nutan Chen

Conclusion: We creatively apply sequential models in the long-term management of SCIT with promising accuracy in the prediction of SCIT nonadherence in Allergic Rhinitis (AR) patients.

Management

On the Role of the Action Space in Robot Manipulation Learning and Sim-to-Real Transfer

no code implementations6 Dec 2023 Elie Aljalbout, Felix Frank, Maximilian Karl, Patrick van der Smagt

Our findings have important implications for the design of RL algorithms for robot manipulation tasks, and highlight the need for careful consideration of action spaces when training and transferring RL agents for real-world robotics.

Reinforcement Learning (RL) Robot Manipulation

Action Inference by Maximising Evidence: Zero-Shot Imitation from Observation with World Models

1 code implementation NeurIPS 2023 Xingyuan Zhang, Philip Becker-Ehmck, Patrick van der Smagt, Maximilian Karl

Our method is "zero-shot" in the sense that it does not require further training for the world model or online interactions with the environment after given the demonstration.

PRISM: Probabilistic Real-Time Inference in Spatial World Models

no code implementations6 Dec 2022 Atanas Mirchev, Baris Kayalibay, Ahmed Agha, Patrick van der Smagt, Daniel Cremers, Justin Bayer

We introduce PRISM, a method for real-time filtering in a probabilistic generative model of agent motion and visual perception.

Bayesian Inference

CLAS: Coordinating Multi-Robot Manipulation with Central Latent Action Spaces

no code implementations28 Nov 2022 Elie Aljalbout, Maximilian Karl, Patrick van der Smagt

Multi-robot manipulation tasks involve various control entities that can be separated into dynamically independent parts.

Robot Manipulation

Local Distance Preserving Auto-encoders using Continuous k-Nearest Neighbours Graphs

no code implementations13 Jun 2022 Nutan Chen, Patrick van der Smagt, Botond Cseke

Auto-encoder models that preserve similarities in the data are a popular tool in representation learning.

Representation Learning

Flat Latent Manifolds for Human-machine Co-creation of Music

no code implementations23 Feb 2022 Nutan Chen, Djalel Benbouzid, Francesco Ferroni, Mathis Nitschke, Luciano Pinna, Patrick van der Smagt

We therefore consider a music-generating algorithm as a counterpart to a human musician, in a setting where reciprocal interplay is to lead to new experiences, both for the musician and the audience.

Music Generation

Tracking and Planning with Spatial World Models

no code implementations25 Jan 2022 Baris Kayalibay, Atanas Mirchev, Patrick van der Smagt, Justin Bayer

We introduce a method for real-time navigation and tracking with differentiably rendered world models.

Pose Estimation

Latent Matters: Learning Deep State-Space Models

no code implementations NeurIPS 2021 Alexej Klushyn, Richard Kurle, Maximilian Soelch, Botond Cseke, Patrick van der Smagt

Our results show that the constrained optimisation framework significantly improves system identification and prediction accuracy on the example of established state-of-the-art DSSMs.

Variational Inference

Exploration via Empowerment Gain: Combining Novelty, Surprise and Learning Progress

no code implementations ICML Workshop URL 2021 Philip Becker-Ehmck, Maximilian Karl, Jan Peters, Patrick van der Smagt

We show that while such an agent is still novelty seeking, i. e. interested in exploring the whole state space, it focuses on exploration where its perceived influence is greater, avoiding areas of greater stochasticity or traps that limit its control.

Constrained Probabilistic Movement Primitives for Robot Trajectory Adaptation

no code implementations29 Jan 2021 Felix Frank, Alexandros Paraschos, Patrick van der Smagt, Botond Cseke

We unify previous adaptation techniques, for example, various types of obstacle avoidance, via-points, mutual avoidance, in one single framework and combine them to solve complex robotic problems.

Robotics

Mind the Gap when Conditioning Amortised Inference in Sequential Latent-Variable Models

no code implementations ICLR 2021 Justin Bayer, Maximilian Soelch, Atanas Mirchev, Baris Kayalibay, Patrick van der Smagt

Amortised inference enables scalable learning of sequential latent-variable models (LVMs) with the evidence lower bound (ELBO).

Dalek -- a deep-learning emulator for TARDIS

no code implementations3 Jul 2020 Wolfgang E. Kerzendorf, Christian Vogl, Johannes Buchner, Gabriella Contardo, Marc Williamson, Patrick van der Smagt

We show that we can train an emulator for this problem given a modest training set of a hundred thousand spectra (easily calculable on modern supercomputers).

Time Series Analysis

Layerwise learning for quantum neural networks

no code implementations26 Jun 2020 Andrea Skolik, Jarrod R. McClean, Masoud Mohseni, Patrick van der Smagt, Martin Leib

In order to ameliorate some of these challenges, we investigate a layerwise learning strategy for parametrized quantum circuits.

Variational State-Space Models for Localisation and Dense 3D Mapping in 6 DoF

no code implementations ICLR 2021 Atanas Mirchev, Baris Kayalibay, Patrick van der Smagt, Justin Bayer

We solve the problem of 6-DoF localisation and 3D dense reconstruction in spatial environments as approximate Bayesian inference in a deep state-space model.

Bayesian Inference Variational Inference

Continual Learning with Bayesian Neural Networks for Non-Stationary Data

no code implementations ICLR 2020 Richard Kurle, Botond Cseke, Alexej Klushyn, Patrick van der Smagt, Stephan Günnemann

We represent the posterior approximation of the network weights by a diagonal Gaussian distribution and a complementary memory of raw data.

Continual Learning

Learning to Fly via Deep Model-Based Reinforcement Learning

1 code implementation19 Mar 2020 Philip Becker-Ehmck, Maximilian Karl, Jan Peters, Patrick van der Smagt

Learning to control robots without requiring engineered models has been a long-term goal, promising diverse and novel applications.

Model-based Reinforcement Learning reinforcement-learning +1

Learning Flat Latent Manifolds with VAEs

no code implementations ICML 2020 Nutan Chen, Alexej Klushyn, Francesco Ferroni, Justin Bayer, Patrick van der Smagt

Prevalent is the use of the Euclidean metric, which has the drawback of ignoring information about similarity of data stored in the decoder, as captured by the framework of Riemannian geometry.

Computational Efficiency

Beta DVBF: Learning State-Space Models for Control from High Dimensional Observations

no code implementations2 Nov 2019 Neha Das, Maximilian Karl, Philip Becker-Ehmck, Patrick van der Smagt

Learning a model of dynamics from high-dimensional images can be a core ingredient for success in many applications across different domains, especially in sequential decision making.

Decision Making

Variational Tracking and Prediction with Generative Disentangled State-Space Models

no code implementations14 Oct 2019 Adnan Akhundov, Maximilian Soelch, Justin Bayer, Patrick van der Smagt

We address tracking and prediction of multiple moving objects in visual data streams as inference and sampling in a disentangled latent state-space model.

Bayesian Inference Position

FLAT MANIFOLD VAES

no code implementations25 Sep 2019 Nutan Chen, Alexej Klushyn, Francesco Ferroni, Justin Bayer, Patrick van der Smagt

Latent-variable models represent observed data by mapping a prior distribution over some latent space to an observed space.

Estimating Fingertip Forces, Torques, and Local Curvatures from Fingernail Images

no code implementations9 Sep 2019 Nutan Chen, Göran Westling, Benoni B. Edin, Patrick van der Smagt

In addition, compared with previous single finger estimation in an experimental environment, we extend the approach to multiple finger force estimation, which can be used for applications such as human grasping analysis.

Increasing the Generalisation Capacity of Conditional VAEs

no code implementations23 Aug 2019 Alexej Klushyn, Nutan Chen, Botond Cseke, Justin Bayer, Patrick van der Smagt

We address the problem of one-to-many mappings in supervised learning, where a single instance has many different solutions of possibly equal cost.

Structured Prediction

Switching Linear Dynamics for Variational Bayes Filtering

no code implementations29 May 2019 Philip Becker-Ehmck, Jan Peters, Patrick van der Smagt

System identification of complex and nonlinear systems is a central problem for model predictive control and model-based reinforcement learning.

Bayesian Inference Model-based Reinforcement Learning +3

Learning Hierarchical Priors in VAEs

no code implementations NeurIPS 2019 Alexej Klushyn, Nutan Chen, Richard Kurle, Botond Cseke, Patrick van der Smagt

We propose to learn a hierarchical prior in the context of variational autoencoders to avoid the over-regularisation resulting from a standard normal prior distribution.

On Deep Set Learning and the Choice of Aggregations

no code implementations18 Mar 2019 Maximilian Soelch, Adnan Akhundov, Patrick van der Smagt, Justin Bayer

Recently, it has been shown that many functions on sets can be represented by sum decompositions.

Bayesian Learning of Neural Network Architectures

1 code implementation14 Jan 2019 Georgi Dikov, Patrick van der Smagt, Justin Bayer

In this paper we propose a Bayesian method for estimating architectural parameters of neural networks, namely layer size and network depth.

Neural Architecture Search

Fast Approximate Geodesics for Deep Generative Models

no code implementations19 Dec 2018 Nutan Chen, Francesco Ferroni, Alexej Klushyn, Alexandros Paraschos, Justin Bayer, Patrick van der Smagt

The length of the geodesic between two data points along a Riemannian manifold, induced by a deep generative model, yields a principled measure of similarity.

Multi-Source Neural Variational Inference

no code implementations11 Nov 2018 Richard Kurle, Stephan Günnemann, Patrick van der Smagt

Learning from multiple sources of information is an important problem in machine-learning research.

Variational Inference

Active Learning based on Data Uncertainty and Model Sensitivity

no code implementations6 Aug 2018 Nutan Chen, Alexej Klushyn, Alexandros Paraschos, Djalel Benbouzid, Patrick van der Smagt

It relies on the Jacobian of the likelihood to detect non-smooth transitions in the latent space, i. e., transitions that lead to abrupt changes in the movement of the robot.

Active Learning Metric Learning

Gaussian Process Neurons

no code implementations ICLR 2018 Sebastian Urban, Patrick van der Smagt

We propose a method to learn stochastic activation functions for use in probabilistic neural networks.

Bayesian Inference Gaussian Processes

Gaussian Process Neurons Learn Stochastic Activation Functions

no code implementations29 Nov 2017 Sebastian Urban, Marcus Basalla, Patrick van der Smagt

The proposed model can intrinsically handle uncertainties in its inputs and self-estimate the confidence of its predictions.

Bayesian Inference Gaussian Processes

Metrics for Deep Generative Models

no code implementations3 Nov 2017 Nutan Chen, Alexej Klushyn, Richard Kurle, Xueyan Jiang, Justin Bayer, Patrick van der Smagt

Neural samplers such as variational autoencoders (VAEs) or generative adversarial networks (GANs) approximate distributions by transforming samples from a simple random source---the latent space---to samples from a more complex distribution represented by a dataset.

Automatic Differentiation for Tensor Algebras

19 code implementations3 Nov 2017 Sebastian Urban, Patrick van der Smagt

For the function $f_{ij} (x) = x_i^2$, the derivative of the loss is $(dx)_i=\partial l/\partial x_i=\sum_j (df)_{ij}2x_i$; the sum is necessary because index $j$ does not appear in the indices of $f$.

Unsupervised Real-Time Control through Variational Empowerment

no code implementations13 Oct 2017 Maximilian Karl, Maximilian Soelch, Philip Becker-Ehmck, Djalel Benbouzid, Patrick van der Smagt, Justin Bayer

We introduce a methodology for efficiently computing a lower bound to empowerment, allowing it to be used as an unsupervised cost function for policy learning in real-time control.

Two-Stream RNN/CNN for Action Recognition in 3D Videos

no code implementations22 Mar 2017 Rui Zhao, Haider Ali, Patrick van der Smagt

The recognition of actions from video sequences has many applications in health monitoring, assisted living, surveillance, and smart homes.

Action Recognition Temporal Action Localization +1

CNN-based Segmentation of Medical Imaging Data

2 code implementations11 Jan 2017 Baris Kayalibay, Grady Jensen, Patrick van der Smagt

While most of the existing literature on medical image segmentation focuses on soft tissue and the major organs, this work is validated on data both from the central nervous system as well as the bones of the hand.

Ranked #2 on Brain Tumor Segmentation on BRATS-2015 (using extra training data)

Brain Tumor Segmentation Image Segmentation +2

Unsupervised preprocessing for Tactile Data

no code implementations23 Jun 2016 Maximilian Karl, Justin Bayer, Patrick van der Smagt

Tactile information is important for gripping, stable grasp, and in-hand manipulation, yet the complexity of tactile data prevents widespread use of such sensors.

reinforcement-learning Reinforcement Learning (RL)

ML-based tactile sensor calibration: A universal approach

no code implementations21 Jun 2016 Maximilian Karl, Artur Lohrer, Dhananjay Shah, Frederik Diehl, Max Fiedler, Saahil Ognawala, Justin Bayer, Patrick van der Smagt

We study the responses of two tactile sensors, the fingertip sensor from the iCub and the BioTac under different external stimuli.

Deep Variational Bayes Filters: Unsupervised Learning of State Space Models from Raw Data

4 code implementations20 May 2016 Maximilian Karl, Maximilian Soelch, Justin Bayer, Patrick van der Smagt

We introduce Deep Variational Bayes Filters (DVBF), a new method for unsupervised learning and identification of latent Markovian state space models.

Variational Inference

A Differentiable Transition Between Additive and Multiplicative Neurons

no code implementations13 Apr 2016 Wiebke Köpp, Patrick van der Smagt, Sebastian Urban

Existing approaches to combine both additive and multiplicative neural units either use a fixed assignment of operations or require discrete optimization to determine what function a neuron should perform.

Efficient Empowerment

no code implementations28 Sep 2015 Maximilian Karl, Justin Bayer, Patrick van der Smagt

This is a natural candidate for an intrinsic reward signal in the context of reinforcement learning: the agent will place itself in a situation where its action have maximum stability and maximum influence on the future.

Fast Adaptive Weight Noise

no code implementations19 Jul 2015 Justin Bayer, Maximilian Karl, Daniela Korhammer, Patrick van der Smagt

Marginalising out uncertain quantities within the internal representations or parameters of neural networks is of central importance for a wide range of learning techniques, such as empirical, variational or full Bayesian methods.

Gaussian Processes

A Neural Transfer Function for a Smooth and Differentiable Transition Between Additive and Multiplicative Interactions

1 code implementation19 Mar 2015 Sebastian Urban, Patrick van der Smagt

Existing approaches to combine both additive and multiplicative neural units either use a fixed assignment of operations or require discrete optimization to determine what function a neuron should perform.

Convolutional Neural Networks learn compact local image descriptors

no code implementations30 Apr 2013 Christian Osendorfer, Justin Bayer, Patrick van der Smagt

A standard deep convolutional neural network paired with a suitable loss function learns compact local image descriptors that perform comparably to state-of-the art approaches.

Unsupervised Feature Learning for low-level Local Image Descriptors

no code implementations14 Jan 2013 Christian Osendorfer, Justin Bayer, Sebastian Urban, Patrick van der Smagt

Unsupervised feature learning has shown impressive results for a wide range of input modalities, in particular for object classification tasks in computer vision.

Binarization General Classification

Learning Sequence Neighbourhood Metrics

no code implementations9 Sep 2011 Justin Bayer, Christian Osendorfer, Patrick van der Smagt

Recurrent neural networks (RNNs) in combination with a pooling operator and the neighbourhood components analysis (NCA) objective function are able to detect the characterizing dynamics of sequences and embed them into a fixed-length vector space of arbitrary dimensionality.

General Classification Metric Learning

Cannot find the paper you are looking for? You can Submit a new open access paper.