Distributed Deep Learning in Open Collaborations

2 code implementations • NeurIPS 2021 • Michael Diskin, Alexey Bukhtiyarov, Max Ryabinin, Lucile Saulnier, Quentin Lhoest, Anton Sinitsin, Dmitry Popov, Dmitry Pyrkin, Maxim Kashirin, Alexander Borzunov, Albert Villanova del Moral, Denis Mazur, Ilia Kobelev, Yacine Jernite, Thomas Wolf, Gennady Pekhimenko

Modern deep learning applications require increasingly more compute to train state-of-the-art models.

Language Modelling

Editable Neural Networks

4 code implementations • ICLR 2020 • Anton Sinitsin, Vsevolod Plokhotnyuk, Dmitriy Pyrkin, Sergei Popov, Artem Babenko

We empirically demonstrate the effectiveness of this method on large-scale image classification and machine translation tasks.

Face Identification General Classification +4

Learning to Route in Similarity Graphs

1 code implementation • 27 May 2019 • Dmitry Baranchuk, Dmitry Persiyanov, Anton Sinitsin, Artem Babenko

Recently similarity graphs became the leading paradigm for efficient nearest neighbor search, outperforming traditional tree-based and LSH-based methods.