Investigating the Encoding of Words in BERT's Neurons Using Feature Textualization. - Tanja Baeumel; Soniya Vijayakumar; Josef van Genabith; Guenter Neumann; Simon Ostermann 002 (BlackboxNLP@EMNLP, 2023)

Where exactly does contextualization in a PLM happen? - Soniya Vijayakumar; Tanja Bäumel; Simon Ostermann 002; Josef van Genabith (CoRR, 2023)

Multilingual Large Language Models and Curse of Multilinguality. - Daniil Gurgurov; Tanja Bäumel; Tatiana Anikina (CoRR, 2024)

The Lookahead Limitation: Why Multi-Operand Addition is Hard for LLMs. - Tanja Baeumel; Josef van Genabith; Simon Ostermann 002 (CoRR, 2025)

What Language(s) Does Aya-23 Think In? How Multilinguality Affects Internal Language Representations. - Katharina Trinley; Toshiki Nakai; Tatiana Anikina; Tanja Baeumel (CoRR, 2025)

Language Arithmetics: Towards Systematic Language Neuron Identification and Manipulation. - Daniil Gurgurov; Katharina Trinley; Yusser Al Ghussin; Tanja Baeumel; Josef van Genabith; Simon Ostermann 002 (CoRR, 2025)

Modular Arithmetic: Language Models Solve Math Digit by Digit. - Tanja Baeumel; Daniil Gurgurov; Yusser Al Ghussin; Josef van Genabith; Simon Ostermann 002 (CoRR, 2025)