Toloka Visual Question Answering Benchmark

1 code implementation • 28 Sep 2023 • Dmitry Ustalov, Nikita Pavlichenko, Sergey Koshelev, Daniil Likhobaba, Alisa Smirnova

In this paper, we present Toloka Visual Question Answering, a new crowdsourced dataset allowing comparing performance of machine learning systems against human level of expertise in the grounding visual question answering task.

Question Answering Visual Question Answering

Best Prompts for Text-to-Image Models and How to Find Them

1 code implementation • 23 Sep 2022 • Nikita Pavlichenko, Dmitry Ustalov

Recent progress in generative models, especially in text-guided diffusion models, has enabled the production of aesthetically-pleasing imagery resembling the works of professional human artists.

CrowdSpeech and VoxDIY: Benchmark Datasets for Crowdsourced Audio Transcription

1 code implementation • 2 Jul 2021 • Nikita Pavlichenko, Ivan Stelmakh, Dmitry Ustalov

The main obstacle towards designing aggregation methods for more advanced applications is the absence of training data, and in this work, we focus on bridging this gap in speech recognition.

Crowdsourced Text Aggregation speech-recognition

Spherical convolutions on molecular graphs for protein model quality assessment

1 code implementation • 16 Nov 2020 • Ilia Igashov, Nikita Pavlichenko, Sergei Grudinin

Within the framework of the protein model quality assessment problem, we demonstrate that the proposed spherical convolution method significantly improves the quality of model assessment compared to the standard message-passing approach.

Protein Folding Quality Prediction Protein Fold Quality Estimation