Sebastian Jaszczur

According to our database, Sebastian Jaszczur authored at least 13 papers between 2017 and 2025.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of three.

2025

μ-Parametrization for Mixture of Experts.

Jan Malasnicki, Kamil Ciebiera, Mateusz Borun, Maciej Pióro, Jan Ludziejewski, Maciej Stefaniak, Michal Krutul, Sebastian Jaszczur, Marek Cygan, Kamil Adamczewski, Jakub Krajewski

CoRR, August, 2025

Decoupled Relative Learning Rate Schedules.

Jan Ludziejewski, Jan Malasnicki, Maciej Pióro, Michal Krutul, Kamil Ciebiera, Maciej Stefaniak, Jakub Krajewski, Piotr Sankowski, Marek Cygan, Kamil Adamczewski, Sebastian Jaszczur

CoRR, July, 2025

Projected Compression: Trainable Projection for Efficient Transformer Compression.

Maciej Stefaniak, Michal Krutul, Jan Malasnicki, Maciej Pióro, Jakub Krajewski, Sebastian Jaszczur, Marek Cygan, Kamil Adamczewski, Jan Ludziejewski

CoRR, June, 2025

Joint MoE Scaling Laws: Mixture of Experts Can Be Memory Efficient.

Jan Ludziejewski, Maciej Pióro, Jakub Krajewski, Maciej Stefaniak, Michal Krutul, Jan Malasnicki, Marek Cygan, Piotr Sankowski, Kamil Adamczewski, Piotr Milos, Sebastian Jaszczur

Proceedings of the Forty-second International Conference on Machine Learning, 2025

Structured Packing in LLM Training Improves Long Context Utilization.

Konrad Staniszewski, Szymon Tworkowski, Sebastian Jaszczur, Yu Zhao, Henryk Michalewski, Lukasz Kucinski, Piotr Milos

Proceedings of the Thirty-Ninth AAAI Conference on Artificial Intelligence, 2025

2024

MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts.

Maciej Pióro, Kamil Ciebiera, Krystian Król, Jan Ludziejewski, Sebastian Jaszczur

CoRR, 2024

Mixture of Tokens: Continuous MoE through Cross-Example Aggregation.

Szymon Antoniak, Michal Krutul, Maciej Pióro, Jakub Krajewski, Jan Ludziejewski, Kamil Ciebiera, Krystian Król, Tomasz Odrzygózdz, Marek Cygan, Sebastian Jaszczur

Proceedings of the Advances in Neural Information Processing Systems 37: Annual Conference on Neural Information Processing Systems 2024, 2024

Scaling Laws for Fine-Grained Mixture of Experts.

Jan Ludziejewski, Jakub Krajewski, Kamil Adamczewski, Maciej Pióro, Michal Krutul, Szymon Antoniak, Kamil Ciebiera, Krystian Król, Tomasz Odrzygózdz, Piotr Sankowski, Marek Cygan, Sebastian Jaszczur

Proceedings of the Forty-first International Conference on Machine Learning, 2024

2023

Structured Packing in LLM Training Improves Long Context Utilization.

Konrad Staniszewski, Szymon Tworkowski, Sebastian Jaszczur, Henryk Michalewski, Lukasz Kucinski, Piotr Milos

CoRR, 2023

Mixture of Tokens: Efficient LLMs through Cross-Example Aggregation.

Szymon Antoniak, Sebastian Jaszczur, Michal Krutul, Maciej Pióro, Jakub Krajewski, Jan Ludziejewski, Tomasz Odrzygózdz, Marek Cygan

CoRR, 2023

2021

Sparse is Enough in Scaling Transformers.

Sebastian Jaszczur, Aakanksha Chowdhery, Afroz Mohiuddin, Lukasz Kaiser, Wojciech Gajewski, Henryk Michalewski, Jonni Kanerva

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021

2020

Neural heuristics for SAT solving.

Sebastian Jaszczur, Michal Luszczyk, Henryk Michalewski

CoRR, 2020

2017

Use of Domain Knowledge and Feature Engineering in Helping AI to Play Hearthstone.

Przemyslaw Przybyszewski, Szymon Dziewiatkowski, Sebastian Jaszczur, Mateusz Smiech, Marcin S. Szczuka

Proceedings of the 2017 Federated Conference on Computer Science and Information Systems, 2017