Bobby He

According to our database, Bobby He authored at least 12 papers between 2020 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Hallmarks of Optimization Trajectories in Neural Networks and LLMs: The Lengths, Bends, and Dead Ends.

Sidak Pal Singh, Bobby He, Thomas Hofmann, Bernhard Schölkopf

CoRR, 2024

2023

UncertaINR: Uncertainty Quantification of End-to-End Implicit Neural Representations for Computed Tomography.

Francisca Vasconcelos, Bobby He, Nalini M. Singh, Yee Whye Teh

Trans. Mach. Learn. Res., 2023

Recurrent Distance-Encoding Neural Networks for Graph Representation Learning.

Yuhui Ding, Antonio Orvieto, Bobby He, Thomas Hofmann

CoRR, 2023

Simplifying Transformer Blocks.

Bobby He, Thomas Hofmann

CoRR, 2023

The Shaped Transformer: Attention Models in the Infinite Depth-and-Width Limit.

Lorenzo Noci, Chuning Li, Mufan Bill Li, Bobby He, Thomas Hofmann, Chris J. Maddison, Daniel M. Roy

CoRR, 2023

The Shaped Transformer: Attention Models in the Infinite Depth-and-Width Limit.

Lorenzo Noci, Chuning Li, Mufan Bill Li, Bobby He, Thomas Hofmann, Chris J. Maddison, Dan Roy

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

Deep Transformers without Shortcuts: Modifying Self-attention for Faithful Signal Propagation.

Bobby He, James Martens, Guodong Zhang, Aleksandar Botev, Andrew Brock, Samuel L. Smith, Yee Whye Teh

Proceedings of the Eleventh International Conference on Learning Representations, 2023

2022

Exploring the Gap between Collapsed & Whitened Features in Self-Supervised Learning.

Bobby He, Mete Ozay

Proceedings of the International Conference on Machine Learning, 2022

Feature Kernel Distillation.

Bobby He, Mete Ozay

Proceedings of the Tenth International Conference on Learning Representations, 2022

2021

Probabilistic fine-tuning of pruning masks and PAC-Bayes self-bounded learning.

Soufiane Hayou, Bobby He, Gintare Karolina Dziugaite

CoRR, 2021

Stable ResNet.

Soufiane Hayou, Eugenio Clerico, Bobby He, George Deligiannidis, Arnaud Doucet, Judith Rousseau

Proceedings of the 24th International Conference on Artificial Intelligence and Statistics, 2021

2020

Bayesian Deep Ensembles via the Neural Tangent Kernel.

Bobby He, Balaji Lakshminarayanan, Yee Whye Teh

Proceedings of the Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, 2020