Search Results for author:
Found 11 papers, 7 papers with code
Dynamic Memory Compression: Retrofitting LLMs for Accelerated Inference
As a solution, we propose Dynamic Memory Compression (DMC), a method for on-line key-value cache compression at inference time.
Efficient Transformers with Dynamic Token Pooling
Transformers achieve unrivalled performance in modelling language, but remain inefficient in terms of memory and time complexity.
Variable-rate hierarchical CPC leads to acoustic unit discovery in speech
The success of deep learning comes from its ability to capture the hierarchical structure of data by learning high-level representations defined in terms of low-level ones.
Contrastive prediction strategies for unsupervised segmentation and categorization of phonemes and words
We investigate the performance on phoneme categorization and phoneme and word segmentation of several self-supervised learning (SSL) methods based on Contrastive Predictive Coding (CPC).
Information Retrieval for ZeroSpeech 2021: The Submission by University of Wroclaw
We present a number of low-resource approaches to the tasks of the Zero Resource Speech Challenge 2021.
Named Entity Recognition and Linking Augmented with Large-Scale Structured Data
In this paper we describe our submissions to the 2nd and 3rd SlavNER Shared Tasks held at BSNLP 2019 and BSNLP 2021, respectively.
Aligned Contrastive Predictive Coding
We investigate the possibility of forcing a self-supervised model trained using a contrastive predictive loss to extract slowly varying latent representations.
FastPitch: Parallel Text-to-speech with Pitch Prediction
We present FastPitch, a fully-parallel text-to-speech model based on FastSpeech, conditioned on fundamental frequency contours.
Robust Training of Vector Quantized Bottleneck Models
We show that the codebook learning can suffer from poor initialization and non-stationarity of clustered encoder outputs.
A Talker Ensemble: the University of Wrocław's Entry to the NIPS 2017 Conversational Intelligence Challenge
We present Poetwannabe, a chatbot submitted by the University of Wroc{\l}aw to the NIPS 2017 Conversational Intelligence Challenge, in which it ranked first ex-aequo.
GGP with Advanced Reasoning and Board Knowledge Discovery
Quality of General Game Playing (GGP) matches suffers from slow state-switching and weak knowledge modules.
