The Future of Large Language Model Pre-training is Federated. - Lorenzo Sani; Alex Iacob; Zeyu Cao; Bill Marino; Yan Gao 016; Tomás Paulik; Wanru Zhao; William F. Shen; Preslav Aleksandrov; Xinchi Qiu; Nicholas D. Lane (CoRR, 2024)

Worldwide Federated Training of Language Models. - Alex Iacob; Lorenzo Sani; Bill Marino; Preslav Aleksandrov; William F. Shen; Nicholas Donald Lane (CoRR, 2024)

PISTOL: Dataset Compilation Pipeline for Structural Unlearning of LLMs. - Xinchi Qiu; William F. Shen; Yihong Chen; Nicola Cancedda; Pontus Stenetorp; Nicholas D. Lane (CoRR, 2024)

DEPT: Decoupled Embeddings for Pre-training Language Models. - Alex Iacob; Lorenzo Sani; Meghdad Kurmanji; William F. Shen; Xinchi Qiu; Dongqi Cai 001; Yan Gao 016; Nicholas Donald Lane (ICLR, 2025)

LUNAR: LLM Unlearning via Neural Activation Redirection. - William F. Shen; Xinchi Qiu; Meghdad Kurmanji; Alex Iacob; Lorenzo Sani; Yihong Chen; Nicola Cancedda; Nicholas D. Lane (CoRR, 2025)

Editing as Unlearning: Are Knowledge Editing Methods Strong Baselines for Large Language Model Unlearning? - Zexi Li; Xiangzhu Wang; William F. Shen; Meghdad Kurmanji; Xinchi Qiu; Dongqi Cai 001; Chao Wu; Nicholas D. Lane (CoRR, 2025)

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models. - Alex Iacob; Lorenzo Sani; Mher Safaryan; Paris Giampouras; Samuel Horváth; Andrej Jovanovic; Meghdad Kurmanji; Preslav Aleksandrov; William F. Shen; Xinchi Qiu; Nicholas D. Lane (CoRR, 2025)

Permissioned LLMs: Enforcing Access Control in Large Language Models. - Bargav Jayaraman; Virendra J. Marathe; Hamid Mozaffari; William F. Shen; Krishnaram Kenthapadi (CoRR, 2025)

Don't Make It Up: Preserving Ignorance Awareness in LLM Fine-Tuning. - William F. Shen; Xinchi Qiu; Nicola Cancedda; Nicholas D. Lane (CoRR, 2025)

AbbIE: Autoregressive Block-Based Iterative Encoder for Efficient Sequence Modeling. - Preslav Aleksandrov; Meghdad Kurmanji; Fernando García-Redondo; David O'Shea; William F. Shen; Alex Iacob; Lorenzo Sani; Xinchi Qiu; Nicola Cancedda; Nicholas D. Lane (CoRR, 2025)