Search Results for author: Tillman Weyde

Found 25 papers, 7 papers with code

Improved Data Generation for Enhanced Asset Allocation: A Synthetic Dataset Approach for the Fixed Income Universe

no code implementations27 Nov 2023 Szymon Kubiak, Tillman Weyde, Oleksandr Galkin, Dan Philps, Ram Gopal

We present a novel process for generating synthetic datasets tailored to assess asset allocation methods and construct portfolios within the fixed income universe.

Theoretical Conditions and Empirical Failure of Bracket Counting on Long Sequences with Linear Recurrent Networks

no code implementations7 Apr 2023 Nadine El-Naggar, Pranava Madhyastha, Tillman Weyde

We conduct a theoretical analysis of linear RNNs and identify conditions for the models to exhibit exact counting behaviour.

Towards a Unified Model for Generating Answers and Explanations in Visual Question Answering

no code implementations25 Jan 2023 Chenxi Whitehouse, Tillman Weyde, Pranava Madhyastha

The field of visual question answering (VQA) has recently seen a surge in research focused on providing explanations for predicted answers.

Explanation Generation Question Answering +1

Exploring the Long-Term Generalization of Counting Behavior in RNNs

no code implementations29 Nov 2022 Nadine El-Naggar, Pranava Madhyastha, Tillman Weyde

Despite this and some positive empirical results for LSTMs on Dyck-1 languages, our experimental results show that LSTMs fail to learn correct counting behavior for sequences that are significantly longer than in the training data.

The Beyond the Fence Musical and Computer Says Show Documentary

no code implementations11 May 2022 Simon Colton, Maria Teresa Llano, Rose Hepworth, John Charnley, Catherine V. Gale, Archie Baron, Francois Pachet, Pierre Roy, Pablo Gervas, Nick Collins, Bob Sturm, Tillman Weyde, Daniel Wolff, James Robert Lloyd

During 2015 and early 2016, the cultural application of Computational Creativity research and practice took a big leap forward, with a project where multiple computational systems were used to provide advice and material for a new musical theatre production.

Learning Speech Emotion Representations in the Quaternion Domain

1 code implementation5 Apr 2022 Eric Guizzo, Tillman Weyde, Simone Scardapane, Danilo Comminiello

On the one hand, the classifier permits to optimize each latent axis of the embeddings for the classification of a specific emotion-related characteristic: valence, arousal, dominance and overall emotion.

Speech Emotion Recognition

Evaluation of Fake News Detection with Knowledge-Enhanced Language Models

1 code implementation1 Apr 2022 Chenxi Whitehouse, Tillman Weyde, Pranava Madhyastha, Nikos Komninos

The predominant state-of-the-art approaches are based on fine-tuning PLMs on labelled fake news datasets.

Fake News Detection

Relational Weight Priors in Neural Networks for Abstract Pattern Learning and Language Modelling

no code implementations10 Mar 2021 Radha Kopparti, Tillman Weyde

Abstract patterns are the best known examples of a hard problem for neural networks in terms of generalisation to unseen data.

Inductive Bias Language Modelling +1

Anti-Transfer Learning for Task Invariance in Convolutional Neural Networks for Speech Processing

1 code implementation11 Jun 2020 Eric Guizzo, Tillman Weyde, Giacomo Tarroni

While transfer learning assumes that the learning process for a target task will benefit from re-using representations learned for another task, anti-transfer avoids the learning of representations that have been learned for an orthogonal task, i. e., one that is not relevant and potentially misleading for the target task, such as speaker identity for speech recognition or speech content for emotion recognition.

Emotion Recognition speech-recognition +2

Weight Priors for Learning Identity Relations

no code implementations6 Mar 2020 Radha Kopparti, Tillman Weyde

In this work, we extend RBP by realizing it as a Bayesian prior on network weights to model the identity relations.

Inductive Bias

Multi-Time-Scale Convolution for Emotion Recognition from Speech Audio Signals

1 code implementation6 Mar 2020 Eric Guizzo, Tillman Weyde, Jack Barnett Leveson

We evaluate MTS and standard convolutional layers in different architectures for emotion recognition from speech audio, using 4 datasets of different sizes.

Emotion Recognition

Making Good on LSTMs' Unfulfilled Promise

no code implementations11 Nov 2019 Daniel Philps, Artur d'Avila Garcez, Tillman Weyde

We examine an alternative called Continual Learning (CL), a memory-augmented approach, which can provide transparent explanations, i. e. which memory did what and when.

Continual Learning Decision Making +5

Trepan Reloaded: A Knowledge-driven Approach to Explaining Artificial Neural Networks

no code implementations19 Jun 2019 Roberto Confalonieri, Tillman Weyde, Tarek R. Besold, Fermín Moscoso del Prado Martín

Whilst a plethora of approaches have been developed for post-hoc explainability, only a few focus on how to use domain knowledge, and how this influences the understandability of global explanations from the users' perspective.

Decision Making Interpretable Machine Learning

Factors for the Generalisation of Identity Relations by Neural Networks

no code implementations13 Jun 2019 Radha Kopparti, Tillman Weyde

In this work we explore various factors in the neural network architecture and learning process whether they make a difference to the generalisation on equality detection of Neural Networks without and and with DR units in early and mid fusion architectures.

Inductive Bias

Continual Learning Augmented Investment Decisions

no code implementations6 Dec 2018 Daniel Philps, Tillman Weyde, Artur d'Avila Garcez, Roy Batchelor

Investment decisions can benefit from incorporating an accumulated knowledge of the past to drive future decision making.

Continual Learning Decision Making +1

Modelling Identity Rules with Neural Networks

no code implementations6 Dec 2018 Tillman Weyde, Radha Manisha Kopparti

We propose a new approach to modify standard neural network architectures, called Relation Based Patterns (RBP) with different variants for classification and prediction.

General Classification Inductive Bias

Feed-Forward Neural Networks Need Inductive Bias to Learn Equality Relations

no code implementations4 Dec 2018 Tillman Weyde, Radha Manisha Kopparti

The DR units create an inductive bias in the networks, so that they do learn to generalise, even from small numbers of examples and we have not found any negative effect of their inclusion in the network.

Inductive Bias Relational Reasoning

Improved Speech Enhancement with the Wave-U-Net

3 code implementations27 Nov 2018 Craig Macartney, Tillman Weyde

We study the use of the Wave-U-Net architecture for speech enhancement, a model introduced by Stoller et al for the separation of music vocals and accompaniment.

Audio Source Separation Speech Enhancement +2

M2U-Net: Effective and Efficient Retinal Vessel Segmentation for Resource-Constrained Environments

no code implementations19 Nov 2018 Tim Laibacher, Tillman Weyde, Sepehr Jalali

In this paper, we present a novel neural network architecture for retinal vessel segmentation that improves over the state of the art on two benchmark datasets, is the first to run in real time on high resolution images, and its small memory and processing requirements make it deployable in mobile and embedded systems.

Retinal Vessel Segmentation

Singing Voice Separation with Deep U-Net Convolutional Networks

1 code implementation International Society for Music Information Retrieval 2017 Andreas Jansson, Eric Humphrey, Nicola Montecchio, Rachel Bittner, Aparna Kumar, Tillman Weyde

The decomposition of a music audio signal into its vocal and backing track components is analogous to image-toimage translation, where a mixed spectrogram is transformed into its constituent sources.

Speech Separation Translation

Linear-Time Sequence Classification using Restricted Boltzmann Machines

no code implementations6 Oct 2017 Son N. Tran, Srikanth Cherla, Artur Garcez, Tillman Weyde

Also, the experimental results on optical character recognition, part-of-speech tagging and text chunking demonstrate that our model is comparable to recurrent neural networks with complex memory gates while requiring far fewer parameters.

Chunking Classification +5

Generalising the Discriminative Restricted Boltzmann Machine

no code implementations6 Apr 2016 Srikanth Cherla, Son N. Tran, Tillman Weyde, Artur d'Avila Garcez

Results show that each of the three compared models outperforms the remaining two in one of the three datasets, thus indicating that the proposed theoretical generalisation of the DRBM may be valuable in practice.

Document Classification General Classification

A Hybrid Recurrent Neural Network For Music Transcription

no code implementations6 Nov 2014 Siddharth Sigtia, Emmanouil Benetos, Nicolas Boulanger-Lewandowski, Tillman Weyde, Artur S. d'Avila Garcez, Simon Dixon

We investigate the problem of incorporating higher-level symbolic score-like information into Automatic Music Transcription (AMT) systems to improve their performance.

Music Transcription

Cannot find the paper you are looking for? You can Submit a new open access paper.