Search Results for author: Franz Pernkopf

Found 31 papers, 11 papers with code

Distribution Mismatch Correction for Improved Robustness in Deep Neural Networks

no code implementations5 Oct 2021 Alexander Fuchs, Christian Knoll, Franz Pernkopf

The most common normalization method, batch normalization, reduces the distribution shift during training but is agnostic to changes in the input distribution during test time.

Lung Sound Classification Using Co-tuning and Stochastic Normalization

1 code implementation4 Aug 2021 Truc Nguyen, Franz Pernkopf

In this paper, we use pre-trained ResNet models as backbone architectures for classification of adventitious lung sounds and respiratory diseases.

Classification Data Augmentation

Complex-valued Convolutional Neural Networks for Enhanced Radar Signal Denoising and Interference Mitigation

no code implementations29 Apr 2021 Alexander Fuchs, Johanna Rock, Mate Toth, Paul Meissner, Franz Pernkopf

Our experiments show, that the use of CVCNNs increases data efficiency, speeds up network training and substantially improves the conservation of phase information during interference removal.

Autonomous Driving Denoising

End-to-end Keyword Spotting using Neural Architecture Search and Quantization

no code implementations14 Apr 2021 David Peter, Wolfgang Roth, Franz Pernkopf

This paper introduces neural architecture search (NAS) for the automatic discovery of end-to-end keyword spotting (KWS) models in limited resource environments.

Ranked #17 on Keyword Spotting on Google Speech Commands (Google Speech Commands V2 12 metric)

Keyword Spotting Neural Architecture Search +1

Blind Speech Separation and Dereverberation using Neural Beamforming

1 code implementation24 Mar 2021 Lukas Pfeifenberger, Franz Pernkopf

In this paper, we present the Blind Speech Separation and Dereverberation (BSSD) network, which performs simultaneous speaker separation, dereverberation and speaker identification in a single neural network.

Speaker Identification Speaker Separation +1

Resource-efficient DNNs for Keyword Spotting using Neural Architecture Search and Quantization

1 code implementation18 Dec 2020 David Peter, Wolfgang Roth, Franz Pernkopf

This paper introduces neural architecture search (NAS) for the automatic discovery of small models for keyword spotting (KWS) in limited resource environments.

Keyword Spotting Neural Architecture Search +1

Deep Interference Mitigation and Denoising of Real-World FMCW Radar Signals

no code implementations4 Dec 2020 Johanna Rock, Mate Toth, Paul Meissner, Franz Pernkopf

We combine real measurements with simulated interference in order to create input-output data suitable for training the model.

Denoising Transfer Learning

Quantized Neural Networks for Radar Interference Mitigation

no code implementations25 Nov 2020 Johanna Rock, Wolfgang Roth, Paul Meissner, Franz Pernkopf

Radar sensors are crucial for environment perception of driver assistance systems as well as autonomous vehicles.

Autonomous Vehicles Denoising +1

Differentiable TAN Structure Learning for Bayesian Network Classifiers

1 code implementation21 Aug 2020 Wolfgang Roth, Franz Pernkopf

Learning the structure of Bayesian networks is a difficult combinatorial optimization problem.

Combinatorial Optimization

Resource-Efficient Speech Mask Estimation for Multi-Channel Speech Enhancement

no code implementations22 Jul 2020 Lukas Pfeifenberger, Matthias Zöhrer, Günther Schindler, Wolfgang Roth, Holger Fröning, Franz Pernkopf

While machine learning techniques are traditionally resource intensive, we are currently witnessing an increased interest in hardware and energy efficient approaches.

Speech Enhancement

Wasserstein Routed Capsule Networks

no code implementations22 Jul 2020 Alexander Fuchs, Franz Pernkopf

Capsule networks offer interesting properties and provide an alternative to today's deep neural network architectures.

Resource-Efficient Neural Networks for Embedded Systems

no code implementations7 Jan 2020 Wolfgang Roth, Günther Schindler, Matthias Zöhrer, Lukas Pfeifenberger, Robert Peharz, Sebastian Tschiatschek, Holger Fröning, Franz Pernkopf, Zoubin Ghahramani

While machine learning is traditionally a resource intensive task, embedded systems, autonomous navigation, and the vision of the Internet of Things fuel the interest in resource-efficient approaches.

Autonomous Navigation Network Pruning

Deep Structured Mixtures of Gaussian Processes

1 code implementation10 Oct 2019 Martin Trapp, Robert Peharz, Franz Pernkopf, Carl E. Rasmussen

Gaussian Processes (GPs) are powerful non-parametric Bayesian regression models that allow exact posterior inference, but exhibit high computational and memory costs.

Gaussian Processes

Learning a Behavior Model of Hybrid Systems Through Combining Model-Based Testing and Machine Learning (Full Version)

no code implementations10 Jul 2019 Bernhard K. Aichernig, Roderick Bloem, Masoud Ebrahimi, Martin Horn, Franz Pernkopf, Wolfgang Roth, Astrid Rupp, Martin Tappler, Markus Tranninger

Therefore, there is considerable interest in learning such hybrid behavior by means of machine learning which requires sufficient and representative training data covering the behavior of the physical system adequately.

Parameterized Structured Pruning for Deep Neural Networks

no code implementations12 Jun 2019 Guenther Schindler, Wolfgang Roth, Franz Pernkopf, Holger Froening

As a result, PSP maintains prediction performance, creates a substantial amount of sparsity that is structured and, thus, easy and efficient to map to a variety of massively parallel processors, which are mandatory for utmost compute power and energy efficiency.

Quantization

Bayesian Learning of Sum-Product Networks

1 code implementation NeurIPS 2019 Martin Trapp, Robert Peharz, Hong Ge, Franz Pernkopf, Zoubin Ghahramani

While parameter learning in SPNs is well developed, structure learning leaves something to be desired: Even though there is a plethora of SPN structure learners, most of them are somewhat ad-hoc and based on intuition rather than a clear learning principle.

Optimisation of Overparametrized Sum-Product Networks

1 code implementation20 May 2019 Martin Trapp, Robert Peharz, Franz Pernkopf

It seems to be a pearl of conventional wisdom that parameter learning in deep sum-product networks is surprisingly fast compared to shallow mixture models.

N-Ary Quantization for CNN Model Compression and Inference Acceleration

no code implementations ICLR 2019 Günther Schindler, Wolfgang Roth, Franz Pernkopf, Holger Fröning

In this work we propose a method for weight and activation quantization that is scalable in terms of quantization levels (n-ary representations) and easy to compute while maintaining the performance close to full-precision CNNs.

Model Compression Quantization

Self-Guided Belief Propagation -- A Homotopy Continuation Method

no code implementations4 Dec 2018 Christian Knoll, Adrian Weller, Franz Pernkopf

Belief propagation (BP) is a popular method for performing probabilistic inference on graphical models.

Learning Deep Mixtures of Gaussian Process Experts Using Sum-Product Networks

1 code implementation12 Sep 2018 Martin Trapp, Robert Peharz, Carl E. Rasmussen, Franz Pernkopf

In this paper, we introduce a natural and expressive way to tackle these problems, by incorporating GPs in sum-product networks (SPNs), a recently proposed tractable probabilistic model allowing exact and efficient inference.

Gaussian Processes Time Series

Sum-Product Networks for Sequence Labeling

no code implementations6 Jul 2018 Martin Ratajczak, Sebastian Tschiatschek, Franz Pernkopf

We consider higher-order linear-chain conditional random fields (HO-LC-CRFs) for sequence modelling, and use sum-product networks (SPNs) for representing higher-order input- and output-dependent factors.

Optical Character Recognition

Automatic Clustering of a Network Protocol with Weakly-Supervised Clustering

no code implementations4 Jun 2018 Tobias Schrank, Franz Pernkopf

Abstraction is a fundamental part when learning behavioral models of systems.

Discrete-Valued Neural Networks Using Variational Inference

no code implementations ICLR 2018 Wolfgang Roth, Franz Pernkopf

The increasing demand for neural networks (NNs) being employed on embedded devices has led to plenty of research investigating methods for training low precision NNs.

Quantization Variational Inference

Safe Semi-Supervised Learning of Sum-Product Networks

1 code implementation10 Oct 2017 Martin Trapp, Tamas Madl, Robert Peharz, Franz Pernkopf, Robert Trappl

In several domains obtaining class annotations is expensive while at the same time unlabelled data are abundant.

Fixed Points of Belief Propagation -- An Analysis via Polynomial Homotopy Continuation

no code implementations20 May 2016 Christian Knoll, Franz Pernkopf, Dhagash Mehta, Tianran Chen

Moreover, we show that this fixed point gives a good approximation, and the NPHC method is able to obtain this fixed point.

On the Latent Variable Interpretation in Sum-Product Networks

no code implementations22 Jan 2016 Robert Peharz, Robert Gens, Franz Pernkopf, Pedro Domingos

We discuss conditional independencies in augmented SPNs, formally establish the probabilistic interpretation of the sum-weights and give an interpretation of augmented SPNs as Bayesian networks.

Cannot find the paper you are looking for? You can Submit a new open access paper.