Character Eyes: Seeing Language through Character-Level Taggers. - Yuval Pinter; Marc Marone; Jacob Eisenstein (BlackboxNLP@ACL, 2019)

Selecting, Planning, and Rewriting: A Modular Approach for Data-to-Document Generation and Translation. - Lesly Miculicich; Marc Marone; Hany Hassan (NGT@EMNLP-IJCNLP, 2019)

Everything Is All It Takes: A Multipronged Strategy for Zero-Shot Cross-Lingual Information Extraction. - Mahsa Yarmohammadi; Shijie Wu; Marc Marone; Haoran Xu; Seth Ebner; Guanghui Qin; Yunmo Chen; Jialiang Guo; Craig Harman; Kenton Murray; Aaron Steven White; Mark Dredze; et al. (EMNLP (1), 2021)

Pretrained Models for Multilingual Federated Learning. - Orion Weller; Marc Marone; Vladimir Braverman; Dawn J. Lawrie; Benjamin Van Durme (NAACL-HLT, 2022)

Data Portraits: Recording Foundation Model Training Data. - Marc Marone; Benjamin Van Durme (NeurIPS, 2023)

StarCoder: may the source be with you! - Raymond Li; Loubna Ben Allal; Yangtian Zi; Niklas Muennighoff; Denis Kocetkov; Chenghao Mou; Marc Marone; Christopher Akiki; Jia Li 015; Jenny Chim; Qian Liu 012; Evgenii Zheltonozhskii; et al. (Trans. Mach. Learn. Res., 2023)

"According to . . . ": Prompting Language Models Improves Quoting from Pre-Training Data. - Orion Weller; Marc Marone; Nathaniel Weir; Dawn J. Lawrie; Daniel Khashabi; Benjamin Van Durme (EACL (1), 2024)

StarCoder 2 and The Stack v2: The Next Generation. - Anton Lozhkov; Raymond Li; Loubna Ben Allal; Federico Cassano; Joel Lamy-Poirier; Nouamane Tazi; Ao Tang; Dmytro Pykhtar; Jiawei Liu 004; Yuxiang Wei 003; Tianyang Liu 003; Max Tian; et al. (CoRR, 2024)

Dated Data: Tracing Knowledge Cutoffs in Large Language Models. - Jeffrey Cheng; Marc Marone; Orion Weller; Dawn J. Lawrie; Daniel Khashabi; Benjamin Van Durme (CoRR, 2024)

AdapterSwap: Continuous Training of LLMs with Data Removal and Access-Control Guarantees. - William Fleshman; Aleem Khan; Marc Marone; Benjamin Van Durme (CoRR, 2024)

Verifiable by Design: Aligning Language Models to Quote from Pre-Training Data. - Jingyu Zhang; Marc Marone; Tianjian Li; Benjamin Van Durme; Daniel Khashabi (NAACL (Long Papers), 2025)

Certified Mitigation of Worst-Case LLM Copyright Infringement. - Jingyu Zhang; Jiacan Yu; Marc Marone; Benjamin Van Durme; Daniel Khashabi (CoRR, 2025)

Seq vs Seq: An Open Suite of Paired Encoders and Decoders. - Orion Weller; Kathryn Ricci; Marc Marone; Antoine Chaffin; Dawn J. Lawrie; Benjamin Van Durme (CoRR, 2025)