Search Results for author: Pavel Kordík

Found 6 papers, 2 papers with code

Learning to Optimize with Dynamic Mode Decomposition

no code implementations29 Nov 2022 Petr Šimánek, Daniel Vašata, Pavel Kordík

Designing faster optimization algorithms is of ever-growing interest.

SimpleTRON: Simple Transformer with O(N) Complexity

no code implementations23 Nov 2021 Uladzislau Yorsh, Alexander Kovalenko, Vojtěch Vančura, Daniel Vašata, Pavel Kordík, Tomáš Mikolov

In this paper, we propose that the dot product pairwise matching attention layer, which is widely used in Transformer-based models, is redundant for the model performance.

Text Classification

Dynamic Neural Diversification: Path to Computationally Sustainable Neural Networks

no code implementations20 Sep 2021 Alexander Kovalenko, Pavel Kordík, Magda Friedjungová

However, such models face several problems during the learning process, mainly due to the redundancy of the individual neurons, which results in sub-optimal accuracy or the need for additional training steps.

Efficient Neural Network

Deep Variational Autoencoder with Shallow Parallel Path for Top-N Recommendation (VASP)

1 code implementation10 Feb 2021 Vojtěch Vančura, Pavel Kordík

Recently introduced EASE algorithm presents a simple and elegant way, how to solve the top-N recommendation task.

 Ranked #1 on Recommendation Systems on MovieLens 20M (using extra training data)

Recommendation Systems

Cannot find the paper you are looking for? You can Submit a new open access paper.