Not All Models Localize Linguistic Knowledge in the Same Place: A Layer-wise Probing on BERToids' Representations. - Mohsen Fayyaz; Ehsan Aghazadeh; Ali Modarressi; Hosein Mohebbi; Mohammad Taher Pilehvar (BlackboxNLP@EMNLP, 2021)

Exploring the Role of BERT Token Representations to Explain Sentence Probing Results. - Hosein Mohebbi; Ali Modarressi; Mohammad Taher Pilehvar (EMNLP (1), 2021)

AdapLeR: Speeding up Inference by Adaptive Length Reduction. - Ali Modarressi; Hosein Mohebbi; Mohammad Taher Pilehvar (ACL (1), 2022)

GlobEnc: Quantifying Global Token Attribution by Incorporating the Whole Encoder Layer in Transformers. - Ali Modarressi; Mohsen Fayyaz; Yadollah Yaghoobzadeh; Mohammad Taher Pilehvar (NAACL-HLT, 2022)

BERT on a Data Diet: Finding Important Examples by Gradient-Based Pruning. - Mohsen Fayyaz; Ehsan Aghazadeh; Ali Modarressi; Mohammad Taher Pilehvar; Yadollah Yaghoobzadeh; Samira Ebrahimi Kahou (CoRR, 2022)

DecompX: Explaining Transformers Decisions by Propagating Token Decomposition. - Ali Modarressi; Mohsen Fayyaz; Ehsan Aghazadeh; Yadollah Yaghoobzadeh; Mohammad Taher Pilehvar (ACL (1), 2023)

Guide the Learner: Controlling Product of Experts Debiasing Method Based on Token Attribution Similarities. - Ali Modarressi; Hossein Amirkhani; Mohammad Taher Pilehvar (EACL, 2023)

RET-LLM: Towards a General Read-Write Memory for Large Language Models. - Ali Modarressi; Ayyoob Imani; Mohsen Fayyaz; Hinrich Schütze (CoRR, 2023)

Consistent Document-level Relation Extraction via Counterfactuals. - Ali Modarressi; Abdullatif Köksal; Hinrich Schütze (EMNLP (Findings), 2024)

MemLLM: Finetuning LLMs to Use An Explicit Read-Write Memory. - Ali Modarressi; Abdullatif Köksal; Ayyoob Imani; Mohsen Fayyaz; Hinrich Schütze (CoRR, 2024)

Collapse of Dense Retrievers: Short, Early, and Literal Biases Outranking Factual Evidence. - Mohsen Fayyaz; Ali Modarressi; Hinrich Schütze; Nanyun Peng 001 (ACL (1), 2025)

Time Course MechInterp: Analyzing the Evolution of Components and Knowledge in Large Language Models. - Ahmad Dawar Hakimi; Ali Modarressi; Philipp Wicke; Hinrich Schütze (ACL (Findings), 2025)

MEXA: Multilingual Evaluation of English-Centric LLMs via Cross-Lingual Alignment. - Amir Hossein Kargaran; Ali Modarressi; Nafiseh Nikeghbal; Jana Diesner; François Yvon; Hinrich Schütze (ACL (Findings), 2025)

MemLLM: Finetuning LLMs to Use Explicit Read-Write Memory. - Ali Modarressi; Abdullatif Köksal; Ayyoob Imani; Mohsen Fayyaz; Hinrich Schütze (Trans. Mach. Learn. Res., 2025)

NoLiMa: Long-Context Evaluation Beyond Literal Matching. - Ali Modarressi; Hanieh Deilamsalehy; Franck Dernoncourt; Trung Bui; Ryan A. Rossi; Seunghyun Yoon 002; Hinrich Schütze (CoRR, 2025)

Do We Know What LLMs Don't Know? A Study of Consistency in Knowledge Probing. - Raoyuan Zhao; Abdullatif Köksal; Ali Modarressi; Michael A. Hedderich; Hinrich Schütze (CoRR, 2025)

ImpliRet: Benchmarking the Implicit Fact Retrieval Challenge. - Zeinab Sadat Taghavi; Ali Modarressi; Yunpu Ma; Hinrich Schütze (CoRR, 2025)