no code implementations • 24 May 2023 • Shahar Lutati, Itamar Zimerman, Lior Wolf
We present a new layer in which dynamic (i. e., input-dependent) Infinite Impulse Response (IIR) filters of order two are used to process the input sequence prior to applying conventional attention.
Ranked #1 on Language Modelling on Text8
no code implementations • 25 Jan 2023 • Shahar Lutati, Eliya Nachmani, Lior Wolf
Applying a diffusion model Vocoder that was pretrained to model single-speaker voices on the output of a deterministic separation model leads to state-of-the-art separation results.
Ranked #1 on Speech Separation on Libri20Mix
1 code implementation • 2 Oct 2022 • Shahar Lutati, Lior Wolf
We present a dynamic model in which the weights are conditioned on an input sample x and are learned to match those that would be obtained by finetuning a base model on x and its label y.
Ranked #1 on Few-Shot Text Classification on SST-5
no code implementations • 24 May 2022 • Shahar Lutati, Eliya Nachmani, Lior Wolf
We present an upper bound for the Single Channel Speech Separation task, which is based on an assumption regarding the nature of short segments of speech.
Ranked #2 on Speech Separation on Libri10Mix
1 code implementation • 9 May 2021 • Shahar Lutati, Lior Wolf
Our experiments demonstrate that our approach is able to design novel antennas and antenna arrays that are compliant with the design requirements, considerably better than the baseline methods.