VLDB 2021 Crowd Science Challenge on Aggregating Crowdsourced Audio Transcriptions. - Dmitry Ustalov; Nikita Pavlichenko; Ivan Stelmakh; Dmitriy Kuznetsov (CSW@VLDB, 2021)

CrowdSpeech and Vox DIY: Benchmark Dataset for Crowdsourced Audio Transcription. - Nikita Pavlichenko; Ivan Stelmakh; Dmitry Ustalov (NeurIPS Datasets and Benchmarks, 2021)

Vox Populi, Vox DIY: Benchmark Dataset for Crowdsourced Audio Transcription. - Nikita Pavlichenko; Ivan Stelmakh; Dmitry Ustalov (CoRR, 2021)

A General-Purpose Crowdsourcing Computational Quality Control Toolkit for Python. - Dmitry Ustalov; Nikita Pavlichenko; Vladimir Losev; Evgeny Tulin; Iulian Giliazev (CoRR, 2021)

IMDB-WIKI-SbS: An Evaluation Dataset for Crowdsourced Pairwise Comparisons. - Nikita Pavlichenko; Dmitry Ustalov (CoRR, 2021)

Spherical convolutions on molecular graphs for protein model quality assessment. - Ilia Igashov; Nikita Pavlichenko; Sergei Grudinin (Mach. Learn. Sci. Technol., 2021)

Web Engineering with Human-in-the-Loop. - Dmitry Ustalov; Nikita Pavlichenko; Boris Tseytlin; Daria Baidakova; Alexey Drutsa (ICWE, 2022)

Improving Recommender Systems with Human-in-the-Loop. - Dmitry Ustalov; Natalia Fedorova; Nikita Pavlichenko (RecSys, 2022)

WSDM Cup 2023 Challenge on Visual Question Answering. - Dmitry Ustalov; Nikita Pavlichenko; Daniil Likhobaba; Alisa Smirnova (CSW@WSDM, 2023)

Crowdsourcing for Information Retrieval. - Dmitry Ustalov; Alisa Smirnova; Natalia Fedorova; Nikita Pavlichenko (ECIR (3), 2023)

Best Prompts for Text-to-Image Models and How to Find Them. - Nikita Pavlichenko; Dmitry Ustalov (SIGIR, 2023)

Toloka Visual Question Answering Benchmark. - Dmitry Ustalov; Nikita Pavlichenko; Sergey Koshelev; Daniil Likhobaba; Alisa Smirnova (CoRR, 2023)

Learning from Crowds with Crowd-Kit. - Dmitry Ustalov; Nikita Pavlichenko; Boris Tseitlin (J. Open Source Softw., 2024)