Search Results for author: Rishav Mukherji

Found 4 papers, 1 papers with code

Language Modeling on a SpiNNaker 2 Neuromorphic Chip

no code implementations14 Dec 2023 Khaleelulla Khan Nazeer, Mark Schöne, Rishav Mukherji, Bernhard Vogginger, Christian Mayr, David Kappel, Anand Subramoney

In this work, we demonstrate the first-ever implementation of a language model on a neuromorphic device - specifically the SpiNNaker 2 chip - based on a recently published event-based architecture called the EGRU.

Gesture Recognition Language Modelling

Activity Sparsity Complements Weight Sparsity for Efficient RNN Inference

no code implementations13 Nov 2023 Rishav Mukherji, Mark Schöne, Khaleelulla Khan Nazeer, Christian Mayr, Anand Subramoney

Yet, sparse activations, while omnipresent in both biological neural networks and deep learning systems, have not been fully utilized as a compression technique in deep learning.

Language Modelling

Diffusion Models as Artists: Are we Closing the Gap between Humans and Machines?

1 code implementation27 Jan 2023 Victor Boutin, Thomas Fel, Lakshya Singhal, Rishav Mukherji, Akash Nagaraj, Julien Colin, Thomas Serre

An important milestone for AI is the development of algorithms that can produce drawings that are indistinguishable from those of humans.

Cannot find the paper you are looking for? You can Submit a new open access paper.