Daria Soboleva

According to our database, Daria Soboleva authored at least 10 papers between 2021 and 2026.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2026

GQA-μP: The maximal parameterization update for grouped query attention.

Kyle R. Chickering, Huijuan Wang, Mengxi Wu, Alexander Moreno, Muhao Chen, Xuezhe Ma, Daria Soboleva, Joel Hestness, Zhengzhong Liu, Eric P. Xing

CoRR, May, 2026

2025

Batch Tiling on Attention: Efficient Mixture of Experts Training on Wafer-Scale Processors.

Daria Soboleva, Étienne Goffinet, Hui Zeng, Sangamesh Ragate, Elif Albuz, Natalia Vassilieva

Proceedings of the SC '25 Workshops of the International Conference for High Performance Computing, 2025

MoE-Inference-Bench: Performance Evaluation of Mixture of Expert Large Language and Vision Models.

Krishna Teja Chitty-Venkata, Sylvia Howland, Golara Azar, Daria Soboleva, Natalia Vassilieva, Siddhisanket Raskar, Murali Emani, Venkatram Vishwanath

Proceedings of the SC '25 Workshops of the International Conference for High Performance Computing, 2025

Power Lines: Scaling laws for weight decay and batch size in LLM pre-training.

Shane Bergsma, Nolan Dey, Gurpreet Gosal, Gavia Gray, Daria Soboleva, Joel Hestness

Proceedings of the Advances in Neural Information Processing Systems 38: Annual Conference on Neural Information Processing Systems 2025, 2025

Straight to Zero: Why Linearly Decaying the Learning Rate to Zero Works Best for LLMs.

Shane Bergsma, Nolan Simran Dey, Gurpreet Gosal, Gavia Gray, Daria Soboleva, Joel Hestness

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

2024

Agent-Based Insight into Eco-Choices: Simulating the Fast Fashion Shift.

Daria Soboleva, Angel Sánchez

CoRR, 2024

2023

Position Interpolation Improves ALiBi Extrapolation.

Faisal Al-Khateeb, Nolan Dey, Daria Soboleva, Joel Hestness

CoRR, 2023

BTLM-3B-8K: 7B Parameter Performance in a 3B Parameter Model.

Nolan Dey, Daria Soboleva, Faisal Al-Khateeb, Bowen Yang, Ribhu Pathria, Hemant Khachane, Shaheer Muhammad, Zhiming Chen, Robert Myers, Jacob Robert Steeves, Natalia Vassilieva, Marvin Tom, Joel Hestness

CoRR, 2023

SlimPajama-DC: Understanding Data Combinations for LLM Training.

Zhiqiang Shen, Tianhua Tao, Liqun Ma, Willie Neiswanger, Zhengzhong Liu, Hongyi Wang, Bowen Tan, Joel Hestness, Natalia Vassilieva, Daria Soboleva, Eric P. Xing

CoRR, 2023

2021

Replacing Human Audio with Synthetic Audio for on-Device Unspoken Punctuation Prediction.

Daria Soboleva, Ondrej Skopek, Márius Sajgalík, Victor Carbune, Felix Weissenberger, Julia Proskurnia, Bogdan Prisacari, Daniel Valcarce, Justin Lu, Rohit Prabhavalkar, Balint Miklos

Proceedings of the IEEE International Conference on Acoustics, 2021