A Hierarchical Multi-Task Approach for Learning Embeddings from Semantic Tasks. - Victor Sanh; Thomas Wolf 008; Sebastian Ruder (AAAI, 2019)

TransferTransfo: A Transfer Learning Approach for Neural Network Based Conversational Agents. - Thomas Wolf 008; Victor Sanh; Julien Chaumond; Clement Delangue (CoRR, 2019)

DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter. - Victor Sanh; Lysandre Debut; Julien Chaumond; Thomas Wolf 008 (CoRR, 2019)

HuggingFace's Transformers: State-of-the-art Natural Language Processing. - Thomas Wolf 008; Lysandre Debut; Victor Sanh; Julien Chaumond; Clement Delangue; Anthony Moi; Pierric Cistac; Tim Rault; Rémi Louf; Morgan Funtowicz; Jamie Brew (CoRR, 2019)

Transformers: State-of-the-Art Natural Language Processing. - Thomas Wolf 008; Lysandre Debut; Victor Sanh; Julien Chaumond; Clement Delangue; Anthony Moi; Pierric Cistac; Tim Rault; Rémi Louf; Morgan Funtowicz; Joe Davison; Sam Shleifer; et al. (EMNLP (Demos), 2020)

Movement Pruning: Adaptive Sparsity by Fine-Tuning. - Victor Sanh; Thomas Wolf 008; Alexander M. Rush (NeurIPS, 2020)

EdgeBERT: Optimizing On-Chip Inference for Multi-Task NLP. - Thierry Tambe; Coleman Hooper; Lillian Pentecost; En-Yu Yang; Marco Donato; Victor Sanh; Alexander M. Rush; David Brooks 001; Gu-Yeon Wei (CoRR, 2020)

Block Pruning For Faster Transformers. - François Lagunas; Ella Charlaix; Victor Sanh; Alexander M. Rush (EMNLP (1), 2021)

Datasets: A Community Library for Natural Language Processing. - Quentin Lhoest; Albert Villanova del Moral; Yacine Jernite; Abhishek Thakur; Patrick von Platen; Suraj Patil; Julien Chaumond; Mariama Drame; Julien Plu; Lewis Tunstall; Joe Davison; Mario Sasko; et al. (EMNLP (Demos), 2021)

Avoiding Inference Heuristics in Few-shot Prompt-based Finetuning. - Prasetya Ajie Utama; Nafise Sadat Moosavi; Victor Sanh; Iryna Gurevych (EMNLP (1), 2021)

Learning from others' mistakes: Avoiding dataset biases without modeling them. - Victor Sanh; Thomas Wolf 008; Yonatan Belinkov; Alexander M. Rush (ICLR, 2021)

EdgeBERT: Sentence-Level Energy Optimizations for Latency-Aware Multi-Task NLP Inference. - Thierry Tambe; Coleman Hooper; Lillian Pentecost; Tianyu Jia; En-Yu Yang; Marco Donato; Victor Sanh; Paul N. Whatmough; Alexander M. Rush; David Brooks 001; Gu-Yeon Wei (MICRO, 2021)

Low-Complexity Probing via Finding Subnetworks. - Victor Sanh; Alexander M. Rush (NAACL-HLT, 2021)

Low-Complexity Probing via Finding Subnetworks. - Steven Cao; Victor Sanh; Alexander M. Rush (CoRR, 2021)

Multitask Prompted Training Enables Zero-Shot Task Generalization. - Victor Sanh; Albert Webson; Colin Raffel; Stephen H. Bach; Lintang Sutawika; Zaid Alyafeai; Antoine Chaffin; Arnaud Stiegler; Teven Le Scao; Arun Raja; Manan Dey; M. Saiful Bari; et al. (CoRR, 2021)

PromptSource: An Integrated Development Environment and Repository for Natural Language Prompts. - Stephen H. Bach; Victor Sanh; Zheng Xin Yong; Albert Webson; Colin Raffel; Nihal V. Nayak; Abheesht Sharma; Taewoon Kim 002; M. Saiful Bari; Thibault Févry; Zaid Alyafeai; Manan Dey; et al. (ACL (demo), 2022)

What Language Model to Train if You Have One Million GPU Hours? - Teven Le Scao; Thomas Wang; Daniel Hesslow; Lucile Saulnier; Stas Bekman; M. Saiful Bari; Stella Biderman; Hady Elsahar; Niklas Muennighoff; Jason Phang; Ofir Press; Colin Raffel; et al. (EMNLP (Findings), 2022)

Multitask Prompted Training Enables Zero-Shot Task Generalization. - Victor Sanh; Albert Webson; Colin Raffel; Stephen H. Bach; Lintang Sutawika; Zaid Alyafeai; Antoine Chaffin; Arnaud Stiegler; Arun Raja; Manan Dey; M Saiful Bari; Canwen Xu; et al. (ICLR, 2022)

PromptSource: An Integrated Development Environment and Repository for Natural Language Prompts. - Stephen H. Bach; Victor Sanh; Zheng Xin Yong; Albert Webson; Colin Raffel; Nihal V. Nayak; Abheesht Sharma; Taewoon Kim 002; M. Saiful Bari; Thibault Févry; Zaid Alyafeai; Manan Dey; et al. (CoRR, 2022)

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model. - Teven Le Scao; Angela Fan; Christopher Akiki; Ellie Pavlick; Suzana Ilic; Daniel Hesslow; Roman Castagné; Alexandra Sasha Luccioni; François Yvon; Matthias Gallé; Jonathan Tow; Alexander M. Rush; et al. (CoRR, 2022)

OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents. - Hugo Laurençon; Lucile Saulnier; Léo Tronchon; Stas Bekman; Amanpreet Singh; Anton Lozhkov; Thomas Wang; Siddharth Karamcheti; Alexander M. Rush; Douwe Kiela; Matthieu Cord; Victor Sanh (NeurIPS, 2023)

OBELISC: An Open Web-Scale Filtered Dataset of Interleaved Image-Text Documents. - Hugo Laurençon; Lucile Saulnier; Léo Tronchon; Stas Bekman; Amanpreet Singh; Anton Lozhkov; Thomas Wang; Siddharth Karamcheti; Alexander M. Rush; Douwe Kiela; Matthieu Cord; Victor Sanh (CoRR, 2023)

Interactive and Visual Prompt Engineering for Ad-hoc Task Adaptation with Large Language Models. - Hendrik Strobelt; Albert Webson; Victor Sanh; Benjamin Hoover; Johanna Beyer; Hanspeter Pfister; Alexander M. Rush (IEEE Trans. Vis. Comput. Graph., 2023)

What matters when building vision-language models? - Hugo Laurençon; Léo Tronchon; Matthieu Cord; Victor Sanh (NeurIPS, 2024)

Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Dataset. - Hugo Laurençon; Léo Tronchon; Victor Sanh (CoRR, 2024)

Building and better understanding vision-language models: insights and future directions. - Hugo Laurençon; Andrés Marafioti; Victor Sanh; Léo Tronchon (CoRR, 2024)

The Responsible Foundation Model Development Cheatsheet: A Review of Tools & Resources. - Shayne Longpre; Stella Biderman; Alon Albalak; Hailey Schoelkopf; Daniel McDuff; Sayash Kapoor; Kevin Klyman; Kyle Lo; Gabriel Ilharco; Nay San; Maribeth Rauh; Aviya Skowron; et al. (Trans. Mach. Learn. Res., 2024)