Bettina Messmer

According to our database, Bettina Messmer authored at least 9 papers between 2023 and 2026.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2026

Toward Cross-Lingual Quality Classifiers for Multilingual Pretraining Data Selection.

Yassine Turki, Vinko Sabolcec, Bettina Messmer, Martin Jaggi

CoRR, April, 2026

2025

FineWeb2: One Pipeline to Scale Them All - Adapting Pre-Training Data Processing to Every Language.

Guilherme Penedo, Hynek Kydlícek, Vinko Sabolcec, Bettina Messmer, Negar Foroutan, Amir Hossein Kargaran, Colin Raffel, Martin Jaggi, Leandro von Werra, Thomas Wolf

CoRR, June, 2025

Enhancing Multilingual LLM Pretraining with Model-Based Data Selection.

Bettina Messmer, Vinko Sabolcec, Martin Jaggi

CoRR, February, 2025

On-Device Collaborative Language Modeling via a Mixture of Generalists and Specialists.

Dongyang Fan, Bettina Messmer, Nikita Doikov, Martin Jaggi

Proceedings of the Forty-second International Conference on Machine Learning, 2025

2024

On-device Collaborative Language Modeling via a Mixture of Generalists and Specialists.

Dongyang Fan, Bettina Messmer, Martin Jaggi

CoRR, 2024

Towards an empirical understanding of MoE design choices.

Dongyang Fan, Bettina Messmer, Martin Jaggi

CoRR, 2024

Analyzing & Reducing the Need for Learning Rate Warmup in GPT Training.

Atli Kosson, Bettina Messmer, Martin Jaggi

Proceedings of the Advances in Neural Information Processing Systems 37: Annual Conference on Neural Information Processing Systems 2024, 2024

Rotational Equilibrium: How Weight Decay Balances Learning Across Neural Networks.

Atli Kosson, Bettina Messmer, Martin Jaggi

Proceedings of the Forty-first International Conference on Machine Learning, 2024

2023

Rotational Optimizers: Simple & Robust DNN Training.

Atli Kosson, Bettina Messmer, Martin Jaggi

CoRR, 2023