Deep Learning For Symbolic Mathematics. - Guillaume Lample; François Charton (ICLR, 2020)

Deep Differential System Stability - Learning advanced computations from examples. - François Charton; Amaury Hayat; Guillaume Lample (CoRR, 2020)

Back-to-back regression: Disentangling the influence of correlated factors from multivariate observations. - Jean-Rémi King; François Charton; David Lopez-Paz; Maxime Oquab (NeuroImage, 2020)

Learning advanced mathematical computations from examples. - François Charton; Amaury Hayat; Guillaume Lample (ICLR, 2021)

A deep language model to predict metabolic network equilibria. - François Charton; Amaury Hayat; Sean T. McQuade; Nathaniel J. Merrill; Benedetto Piccoli (CoRR, 2021)

Leveraging Automated Unit Tests for Unsupervised Code Translation. - Baptiste Rozière; Jie Zhang 050; François Charton; Mark Harman; Gabriel Synnaeve; Guillaume Lample (ICLR, 2022)

Deep symbolic regression for recurrence prediction. - Stéphane d'Ascoli; Pierre-Alexandre Kamienny; Guillaume Lample; François Charton (ICML, 2022)

End-to-end Symbolic Regression with Transformers. - Pierre-Alexandre Kamienny; Stéphane d'Ascoli; Guillaume Lample; François Charton (NeurIPS, 2022)

Deep Symbolic Regression for Recurrent Sequences. - Stéphane d'Ascoli; Pierre-Alexandre Kamienny; Guillaume Lample; François Charton (CoRR, 2022)

What is my math transformer doing? - Three results on interpretability and generalization. - François Charton (CoRR, 2022)

Contrastive Distillation Is a Sample-Efficient Self-Supervised Loss Policy for Transfer Learning. - Chris Lengerich; Gabriel Synnaeve; Amy Zhang 001; Hugh Leather; Kurt Shuster 001; François Charton; Charysse Redwood (CoRR, 2022)

SALSA: Attacking Lattice Cryptography with Transformers. - Emily Wenger; Mingjie Chen; François Charton; Kristin E. Lauter (IACR Cryptol. ePrint Arch., 2022)

Linear algebra with transformers. - François Charton (Trans. Mach. Learn. Res., 2022)

SalsaPicante: A Machine Learning Attack on LWE with Binary Secrets. - Cathy Yuanchen Li; Jana Sotáková; Emily Wenger; Mohamed Malhou; Evrard Garcelon; François Charton; Kristin E. Lauter (CCS, 2023)

Code Translation with Compiler Representations. - Marc Szafraniec; Baptiste Rozière; Hugh Leather; Patrick Labatut; François Charton; Gabriel Synnaeve (ICLR, 2023)

SALSA VERDE: a machine learning attack on LWE with sparse small secrets. - Cathy Yuanchen Li; Emily Wenger; Zeyuan Allen-Zhu; François Charton; Kristin E. Lauter (NeurIPS, 2023)

A mimetic approach to social influence on Instagram. - Hubert Etienne; François Charton (CoRR, 2023)

Length Generalization in Arithmetic Transformers. - Samy Jelassi; Stéphane d'Ascoli; Carles Domingo-Enrich; Yuhuai Wu; Yuanzhi Li; François Charton (CoRR, 2023)

Can transformers learn the greatest common divisor? - François Charton (CoRR, 2023)

SALSA VERDE: a machine learning attack on Learning with Errors with sparse small secrets. - Cathy Yuanchen Li; Jana Sotáková; Emily Wenger; Zeyuan Allen-Zhu; François Charton; Kristin E. Lauter (IACR Cryptol. ePrint Arch., 2023)

SALSA PICANTE: a machine learning attack on LWE with binary secrets. - Cathy Yuanchen Li; Jana Sotáková; Emily Wenger; Mohamed Malhou; Evrard Garcelon; François Charton; Kristin E. Lauter (IACR Cryptol. ePrint Arch., 2023)

Learning the greatest common divisor: explaining transformer predictions. - François Charton (ICLR, 2024)

A Tale of Tails: Model Collapse as a Change of Scaling Laws. - Elvis Dohmatob; Yunzhen Feng; Pu Yang; François Charton; Julia Kempe (ICML, 2024)

Global Lyapunov functions: a long-standing open problem in mathematics, with symbolic transformers. - Alberto Alfarano; François Charton; Amaury Hayat (NeurIPS, 2024)

Iteration Head: A Mechanistic Study of Chain-of-Thought. - Vivien Cabannes; Charles Arnal; Wassim Bouaziz; Xingyu Yang; François Charton; Julia Kempe (NeurIPS, 2024)

Instruction Diversity Drives Generalization To Unseen Tasks. - Dylan Zhang; Justin Wang; François Charton (CoRR, 2024)

From Symbolic Tasks to Code Generation: Diversification Yields Better Task Performers. - Dylan Zhang; Justin Wang; François Charton (CoRR, 2024)

Iteration Head: A Mechanistic Study of Chain-of-Thought. - Vivien Cabannes; Charles Arnal; Wassim Bouaziz; Alice Yang; François Charton; Julia Kempe (CoRR, 2024)

Beyond Model Collapse: Scaling Up with Synthesized Data Requires Reinforcement. - Yunzhen Feng; Elvis Dohmatob; Pu Yang; François Charton; Julia Kempe (CoRR, 2024)

Is Tokenization Needed for Masked Particle Modelling? - Matthew Leigh; Samuel Klein; François Charton; Tobias Golling; Lukas Heinrich; Michael Kagan; Inês Ochoa; Margarita Osadchy (CoRR, 2024)

Only-IF:Revealing the Decisive Effect of Instruction Diversity on Generalization. - Dylan Zhang; Justin Wang; François Charton (CoRR, 2024)

Emergent properties with repeated examples. - François Charton; Julia Kempe (CoRR, 2024)

PatternBoost: Constructions in Mathematics with a Little Help from AI. - François Charton; Jordan S. Ellenberg; Adam Zsolt Wagner; Geordie Williamson (CoRR, 2024)

Extrapolating Jet Radiation with Autoregressive Transformers. - Anja Butter; François Charton; Javier Mariño Villadamigo; Ayodele Ore; Tilman Plehn; Jonas Spinner (CoRR, 2024)

The cool and the cruel: separating hard parts of LWE secrets. - Niklas Nolte; Mohamed Malhou; Emily Wenger; Samuel Stevens 001; Cathy Yuanchen Li; François Charton; Kristin E. Lauter (IACR Cryptol. ePrint Arch., 2024)

SALSA FRESCA: Angular Embeddings and Pre-Training for ML Attacks on Learning With Errors. - Samuel Stevens 001; Emily Wenger; Cathy Yuanchen Li; Niklas Nolte; Eshika Saxena; François Charton; Kristin E. Lauter (IACR Cryptol. ePrint Arch., 2024)

Transforming the bootstrap: using transformers to compute scattering amplitudes in planar N = 4 super Yang-Mills theory. - Tianji Cai; Garrett W. Merz; François Charton; Niklas Nolte; Matthias Wilhelm 003; Kyle Cranmer; Lance J. Dixon (Mach. Learn. Sci. Technol., 2024)

An Efficient Algorithm for Integer Lattice Reduction. - François Charton; Kristin E. Lauter; Cathy Yuanchen Li; Mark Tygert (SIAM J. Matrix Anal. Appl., 2024)

Diversification Catalyzes Language Models' Instruction Generalization To Unseen Semantics. - Dylan Zhang; Justin Wang; François Charton (ACL (Findings), 2025)

Beyond Model Collapse: Scaling Up with Synthesized Data Requires Verification. - Yunzhen Feng; Elvis Dohmatob; Pu Yang; François Charton; Julia Kempe (ICLR, 2025)

Learning Euler Factors of Elliptic Curves. - Angelica Babei; François Charton; Edgar Costa; Xiaoyu Huang; Kyu-Hwan Lee; David Lowry-Duda; Ashvni Narayanan; Alexey Pozdnyakov (CoRR, 2025)

Int2Int: a framework for mathematics with transformers. - François Charton (CoRR, 2025)

Transforming Calabi-Yau Constructions: Generating New Calabi-Yau Manifolds with Transformers. - Jacky H. T. Yip; Charles Arnal; François Charton; Gary Shiu (CoRR, 2025)