Search Results for author: Mark Schöne

Found 4 papers, 1 papers with code

Language Modeling on a SpiNNaker 2 Neuromorphic Chip

no code implementations14 Dec 2023 Khaleelulla Khan Nazeer, Mark Schöne, Rishav Mukherji, Bernhard Vogginger, Christian Mayr, David Kappel, Anand Subramoney

In this work, we demonstrate the first-ever implementation of a language model on a neuromorphic device - specifically the SpiNNaker 2 chip - based on a recently published event-based architecture called the EGRU.

Gesture Recognition Language Modelling

Activity Sparsity Complements Weight Sparsity for Efficient RNN Inference

no code implementations13 Nov 2023 Rishav Mukherji, Mark Schöne, Khaleelulla Khan Nazeer, Christian Mayr, Anand Subramoney

Yet, sparse activations, while omnipresent in both biological neural networks and deep learning systems, have not been fully utilized as a compression technique in deep learning.

Language Modelling

Efficient recurrent architectures through activity sparsity and sparse back-propagation through time

1 code implementation13 Jun 2022 Anand Subramoney, Khaleelulla Khan Nazeer, Mark Schöne, Christian Mayr, David Kappel

However, there is still a need to bridge the gap between what RNNs are capable of in terms of efficiency and performance and real-world application requirements.

Ranked #2 on Gesture Recognition on DVS128 Gesture (using extra training data)

Gesture Recognition Language Modelling +2

Cannot find the paper you are looking for? You can Submit a new open access paper.