Energy-Aware Resources in Digital Twin: The Case of Injection Moulding Machines. - Olivier Cardin; Pierre Castagna; Daniel Couedel; Christophe Plot; Julien Launay; Nadine Allanic; Yannick Madec; Stéphanie Jegouzo (SOHOMA, 2019)

Principled Training of Neural Networks with Direct Feedback Alignment. - Julien Launay; Iacopo Poli; Florent Krzakala (CoRR, 2019)

Direct Feedback Alignment Scales to Modern Deep Learning Tasks and Architectures. - Julien Launay; Iacopo Poli; François Boniface; Florent Krzakala (NeurIPS, 2020)

Light-in-the-loop: using a photonics co-processor for scalable training of neural networks. - Julien Launay; Iacopo Poli; Kilian Müller; Igor Carron; Laurent Daudet; Florent Krzakala; Sylvain Gigan (CoRR, 2020)

Hardware Beyond Backpropagation: a Photonic Co-Processor for Direct Feedback Alignment. - Julien Launay; Iacopo Poli; Kilian Müller; Gustave Pariente; Igor Carron; Laurent Daudet; Florent Krzakala; Sylvain Gigan (CoRR, 2020)

LightOn Optical Processing Unit : Scaling-up AI and HPC with a Non von Neumann co-processor. - Charles Brossollet; Alessandro Cappelli; Igor Carron; Charidimos Chaintoutis; Amélie Chatelain; Laurent Daudet; Sylvain Gigan; Daniel Hesslow; Florent Krzakala; Julien Launay; Safa Mokaadi; Fabien Moreau; et al. (HCS, 2021)

Is the Number of Trainable Parameters All That Actually Matters? - Amélie Chatelain; Amine Djeghri; Daniel Hesslow; Julien Launay (ICBINB@NeurIPS, 2021)

Photonic Differential Privacy with Direct Feedback Alignment. - Ruben Ohana; Hamlet Jesse Medina Ruiz; Julien Launay; Alessandro Cappelli; Iacopo Poli; Liva Ralaivola; Alain Rakotomamonjy (NeurIPS, 2021)

ROPUST: Improving Robustness through Fine-tuning with Photonic Processors and Synthetic Gradients. - Alessandro Cappelli; Julien Launay; Laurent Meunier; Ruben Ohana; Iacopo Poli (CoRR, 2021)

Is the Number of Trainable Parameters All That Actually Matters? - Amélie Chatelain; Amine Djeghri; Daniel Hesslow; Julien Launay; Iacopo Poli (CoRR, 2021)

What Language Model to Train if You Have One Million GPU Hours? - Teven Le Scao; Thomas Wang; Daniel Hesslow; Lucile Saulnier; Stas Bekman; M. Saiful Bari; Stella Biderman; Hady Elsahar; Niklas Muennighoff; Jason Phang; Ofir Press; Colin Raffel; et al. (EMNLP (Findings), 2022)

Adversarial Robustness by Design Through Analog Computing And Synthetic Gradients. - Alessandro Cappelli; Ruben Ohana; Julien Launay; Laurent Meunier; Iacopo Poli; Florent Krzakala (ICASSP, 2022)

What Language Model Architecture and Pretraining Objective Works Best for Zero-Shot Generalization? - Thomas Wang; Adam Roberts; Daniel Hesslow; Teven Le Scao; Hyung Won Chung; Iz Beltagy; Julien Launay; Colin Raffel (ICML, 2022)

PAGnol: An Extra-Large French Generative Model. - Julien Launay; E. L. Tommasone; Baptiste Pannier; François Boniface; Amélie Chatelain; Alessandro Cappelli; Iacopo Poli; Djamé Seddah (LREC, 2022)

What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot Generalization? - Thomas Wang; Adam Roberts; Daniel Hesslow; Teven Le Scao; Hyung Won Chung; Iz Beltagy; Julien Launay; Colin Raffel (CoRR, 2022)

Scaling Laws Beyond Backpropagation. - Matthew J. Filipovich; Alessandro Cappelli; Daniel Hesslow; Julien Launay (CoRR, 2022)

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model. - Teven Le Scao; Angela Fan; Christopher Akiki; Ellie Pavlick; Suzana Ilic; Daniel Hesslow; Roman Castagné; Alexandra Sasha Luccioni; François Yvon; Matthias Gallé; Jonathan Tow; Alexander M. Rush; et al. (CoRR, 2022)

The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data Only. - Guilherme Penedo; Quentin Malartic; Daniel Hesslow; Ruxandra Cojocaru; Hamza Alobeidli; Alessandro Cappelli; Baptiste Pannier; Ebtesam Almazrouei; Julien Launay (NeurIPS, 2023)

AlGhafa Evaluation Benchmark for Arabic Language Models. - Ebtesam Almazrouei; Ruxandra Cojocaru; Michele Baldo; Quentin Malartic; Hamza Alobeidli; Daniele Mazzotta; Guilherme Penedo; Giulia Campesan; Mugariya Farooq; Maitha Alhammadi; Julien Launay; Badreddine Noune (ArabicNLP, 2023)

The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Only. - Guilherme Penedo; Quentin Malartic; Daniel Hesslow; Ruxandra Cojocaru; Alessandro Cappelli; Hamza Alobeidli; Baptiste Pannier; Ebtesam Almazrouei; Julien Launay (CoRR, 2023)

The Falcon Series of Open Language Models. - Ebtesam Almazrouei; Hamza Alobeidli; Abdulaziz Alshamsi; Alessandro Cappelli; Ruxandra Cojocaru; Mérouane Debbah; Étienne Goffinet; Daniel Hesslow; Julien Launay; Quentin Malartic; Daniele Mazzotta; Badreddine Noune; et al. (CoRR, 2023)

Optical training of large-scale Transformers and deep neural networks with direct feedback alignment. - Ziao Wang; Kilian Müller; Matthew J. Filipovich; Julien Launay; Ruben Ohana; Gustave Pariente; Safa Mokaadi; Charles Brossollet; Fabien Moreau; Alessandro Cappelli; Iacopo Poli; Igor Carron; et al. (CoRR, 2024)