Interpretability in Activation Space Analysis of Transformers: A Focused Survey. - Soniya Vijayakumar (CIKM Workshops, 2022)

Investigating the Encoding of Words in BERT's Neurons Using Feature Textualization. - Tanja Baeumel; Soniya Vijayakumar; Josef van Genabith; Guenter Neumann; Simon Ostermann 002 (BlackboxNLP@EMNLP, 2023)

Where exactly does contextualization in a PLM happen? - Soniya Vijayakumar; Tanja Bäumel; Simon Ostermann 002; Josef van Genabith (CoRR, 2023)

Probing Context Localization of Polysemous Words in Pre-trained Language Model Sub-Layers. - Soniya Vijayakumar; Josef van Genabith; Simon Ostermann 002 (CoRR, 2024)