MaskGAN: Better Text Generation via Filling in the _______. - William Fedus; Ian J. Goodfellow; Andrew M. Dai (ICLR (Poster), 2018)

Many Paths to Equilibrium: GANs Do Not Need to Decrease a Divergence At Every Step. - William Fedus; Mihaela Rosca; Balaji Lakshminarayanan; Andrew M. Dai; Shakir Mohamed; Ian J. Goodfellow (ICLR (Poster), 2018)

Disentangling the independently controllable factors of variation by interacting with the world. - Valentin Thomas; Emmanuel Bengio; William Fedus; Jules Pondard; Philippe Beaudoin; Hugo Larochelle; Joelle Pineau; Doina Precup; Yoshua Bengio (CoRR, 2018)

Recall Traces: Backtracking Models for Efficient Reinforcement Learning. - Anirudh Goyal; Philemon Brakel; William Fedus; Timothy P. Lillicrap; Sergey Levine; Hugo Larochelle; Yoshua Bengio (CoRR, 2018)

Recall Traces: Backtracking Models for Efficient Reinforcement Learning. - Anirudh Goyal; Philemon Brakel; William Fedus; Soumye Singhal; Timothy P. Lillicrap; Sergey Levine; Hugo Larochelle; Yoshua Bengio (ICLR (Poster), 2019)

Deep Graph Infomax. - Petar Velickovic; William Fedus; William L. Hamilton; Pietro Liò; Yoshua Bengio; R. Devon Hjelm (ICLR (Poster), 2019)

Hyperbolic Discounting and Learning over Multiple Horizons. - William Fedus; Carles Gelada; Yoshua Bengio; Marc G. Bellemare; Hugo Larochelle (CoRR, 2019)

Benchmarking Bonus-Based Exploration Methods on the Arcade Learning Environment. - Adrien Ali Taïga; William Fedus; Marlos C. Machado; Aaron C. Courville; Marc G. Bellemare (CoRR, 2019)

Algorithmic Improvements for Deep Reinforcement Learning Applied to Interactive Fiction. - Vishal Jain; William Fedus; Hugo Larochelle; Doina Precup; Marc G. Bellemare (AAAI, 2020)

Language GANs Falling Short. - Massimo Caccia; Lucas Caccia; William Fedus; Hugo Larochelle; Joelle Pineau; Laurent Charlin (ICLR, 2020)

On Bonus Based Exploration Methods In The Arcade Learning Environment. - Adrien Ali Taïga; William Fedus; Marlos C. Machado; Aaron C. Courville; Marc G. Bellemare (ICLR, 2020)

Revisiting Fundamentals of Experience Replay. - William Fedus; Prajit Ramachandran; Rishabh Agarwal; Yoshua Bengio; Hugo Larochelle; Mark Rowland 001; Will Dabney (ICML, 2020)

On Catastrophic Interference in Atari 2600 Games. - William Fedus; Dibya Ghosh; John D. Martin; Marc G. Bellemare; Yoshua Bengio; Hugo Larochelle (CoRR, 2020)

Do Transformer Modifications Transfer Across Implementations and Applications? - Sharan Narang; Hyung Won Chung; Yi Tay; Liam Fedus; Thibault Févry; Michael Matena; Karishma Malkan; Noah Fiedel; Noam Shazeer; Zhenzhong Lan; Yanqi Zhou; Wei Li 133; et al. (EMNLP (1), 2021)

Revisiting ResNets: Improved Training and Scaling Strategies. - Irwan Bello; William Fedus; Xianzhi Du; Ekin Dogus Cubuk; Aravind Srinivas; Tsung-Yi Lin; Jonathon Shlens; Barret Zoph (NeurIPS, 2021)

Scale Efficiently: Insights from Pre-training and Fine-tuning Transformers. - Yi Tay; Mostafa Dehghani 001; Jinfeng Rao; William Fedus; Samira Abnar; Hyung Won Chung; Sharan Narang; Dani Yogatama; Ashish Vaswani; Donald Metzler (CoRR, 2021)

Scale Efficiently: Insights from Pretraining and Finetuning Transformers. - Yi Tay; Mostafa Dehghani 001; Jinfeng Rao; William Fedus; Samira Abnar; Hyung Won Chung; Sharan Narang; Dani Yogatama; Ashish Vaswani; Donald Metzler (ICLR, 2022)

GLaM: Efficient Scaling of Language Models with Mixture-of-Experts. - Nan Du 002; Yanping Huang; Andrew M. Dai; Simon Tong; Dmitry Lepikhin; Yuanzhong Xu; Maxim Krikun; Yanqi Zhou; Adams Wei Yu; Orhan Firat; Barret Zoph; Liam Fedus; et al. (ICML, 2022)

Designing Effective Sparse Expert Models. - Barret Zoph; Irwan Bello; Sameer Kumar; Nan Du 002; Yanping Huang; Jeff Dean; Noam Shazeer; William Fedus (CoRR, 2022)

A Review of Sparse Expert Models in Deep Learning. - William Fedus; Jeff Dean; Barret Zoph (CoRR, 2022)

Scaling Instruction-Finetuned Language Models. - Hyung Won Chung; Le Hou; Shayne Longpre; Barret Zoph; Yi Tay; William Fedus; Eric Li; Xuezhi Wang 002; Mostafa Dehghani 001; Siddhartha Brahma; Albert Webson; Shixiang Shane Gu; et al. (CoRR, 2022)

Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity. - William Fedus; Barret Zoph; Noam Shazeer (J. Mach. Learn. Res., 2022)

Emergent Abilities of Large Language Models. - Jason Wei; Yi Tay; Rishi Bommasani; Colin Raffel; Barret Zoph; Sebastian Borgeaud; Dani Yogatama; Maarten Bosma; Denny Zhou; Donald Metzler; Ed H. Chi; Tatsunori Hashimoto; et al. (Trans. Mach. Learn. Res., 2022)

Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling? - Yi Tay; Mostafa Dehghani 001; Samira Abnar; Hyung Won Chung; William Fedus; Jinfeng Rao; Sharan Narang; Vinh Q. Tran 002; Dani Yogatama; Donald Metzler (EMNLP (Findings), 2023)

Flan-MoE: Scaling Instruction-Finetuned Language Models with Sparse Mixture of Experts. - Sheng Shen 001; Le Hou; Yanqi Zhou; Nan Du 002; Shayne Longpre; Jason Wei; Hyung Won Chung; Barret Zoph; William Fedus; Xinyun Chen; Tu Vu; Yuexin Wu; et al. (CoRR, 2023)

PaLM: Scaling Language Modeling with Pathways. - Aakanksha Chowdhery; Sharan Narang; Jacob Devlin; Maarten Bosma; Gaurav Mishra; Adam Roberts; Paul Barham 001; Hyung Won Chung; Charles Sutton; Sebastian Gehrmann; Parker Schuh; Kensen Shi; et al. (J. Mach. Learn. Res., 2023)

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models. - Aarohi Srivastava; Abhinav Rastogi; Abhishek Rao; Abu Awal Md Shoeb; Abubakar Abid; Adam Fisch; Adam R. Brown; Adam Santoro; Aditya Gupta; Adrià Garriga-Alonso; Agnieszka Kluska; Aitor Lewkowycz; et al. (Trans. Mach. Learn. Res., 2023)

Mixture-of-Experts Meets Instruction Tuning: A Winning Combination for Large Language Models. - Sheng Shen 001; Le Hou; Yanqi Zhou; Nan Du 002; Shayne Longpre; Jason Wei; Hyung Won Chung; Barret Zoph; William Fedus; Xinyun Chen; Tu Vu; Yuexin Wu; et al. (ICLR, 2024)

Measuring short-form factuality in large language models. - Jason Wei; Nguyen Karina; Hyung Won Chung; Yunxin Joy Jiao; Spencer Papay; Amelia Glaese; John Schulman; William Fedus (CoRR, 2024)

Scaling Instruction-Finetuned Language Models. - Hyung Won Chung; Le Hou; Shayne Longpre; Barret Zoph; Yi Tay; William Fedus; Yunxuan Li; Xuezhi Wang 002; Mostafa Dehghani 001; Siddhartha Brahma; Albert Webson; Shixiang Shane Gu; et al. (J. Mach. Learn. Res., 2024)

BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agents. - Jason Wei; Zhiqing Sun; Spencer Papay; Scott McKinney; Jeffrey Han; Isa Fulford; Hyung Won Chung; Alex Tachard Passos; William Fedus; Amelia Glaese (CoRR, 2025)