Learning to Segment Medical Images with Scribble-Supervision Alone. - Yigit Baran Can; Krishna Chaitanya; Basil Mustafa; Lisa M. Koch; Ender Konukoglu; Christian F. Baumgartner (DLMIA/ML-CDS@MICCAI, 2018)

Analysis of Softmax Approximation for Deep Classifiers under Input-Dependent Label Noise. - Mark Collier; Basil Mustafa; Efi Kokiopoulou; Jesse Berent (CoRR, 2020)

Deep Ensembles for Low-Data Transfer Learning. - Basil Mustafa; Carlos Riquelme; Joan Puigcerver; André Susano Pinto; Daniel Keysers; Neil Houlsby (CoRR, 2020)

Correlated Input-Dependent Label Noise in Large-Scale Image Classification. - Mark Collier; Basil Mustafa; Efi Kokiopoulou; Rodolphe Jenatton; Jesse Berent (CVPR, 2021)

Big Self-Supervised Models Advance Medical Image Classification. - Shekoofeh Azizi; Basil Mustafa; Fiona Ryan; Zachary Beaver; Jan Freyberg; Jonathan Deaton; Aaron Loh; Alan Karthikesalingam; Simon Kornblith; Ting Chen 007; Vivek Natarajan; Mohammad Norouzi 002 (ICCV, 2021)

Scalable Transfer Learning with Expert Models. - Joan Puigcerver; Carlos Riquelme Ruiz; Basil Mustafa; Cédric Renggli; André Susano Pinto; Sylvain Gelly; Daniel Keysers; Neil Houlsby (ICLR, 2021)

Scaling Vision with Sparse Mixture of Experts. - Carlos Riquelme; Joan Puigcerver; Basil Mustafa; Maxim Neumann; Rodolphe Jenatton; André Susano Pinto; Daniel Keysers; Neil Houlsby (NeurIPS, 2021)

Supervised Transfer Learning at Scale for Medical Imaging. - Basil Mustafa; Aaron Loh; Jan Freyberg; Patricia MacWilliams; Megan Wilson; Scott Mayer McKinney; Marcin Sieniek; Jim Winkens; Yuan Liu; Peggy Bui; Shruthi Prabhakara; Umesh Telang; et al. (CoRR, 2021)

LiT: Zero-Shot Transfer with Locked-image text Tuning. - Xiaohua Zhai; Xiao Wang 038; Basil Mustafa; Andreas Steiner 001; Daniel Keysers; Alexander Kolesnikov 003; Lucas Beyer (CVPR, 2022)

Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Experts. - Basil Mustafa; Carlos Riquelme; Joan Puigcerver; Rodolphe Jenatton; Neil Houlsby (NeurIPS, 2022)

Learning to Merge Tokens in Vision Transformers. - Cédric Renggli; André Susano Pinto; Neil Houlsby; Basil Mustafa; Joan Puigcerver; Carlos Riquelme (CoRR, 2022)

Robust and Efficient Medical Imaging with Self-Supervision. - Shekoofeh Azizi; Laura Culp; Jan Freyberg; Basil Mustafa; Sebastien Baur; Simon Kornblith; Ting Chen 007; Patricia MacWilliams; S. Sara Mahdavi; Ellery Wulczyn; Boris Babenko; Megan Wilson; et al. (CoRR, 2022)

PaLI: A Jointly-Scaled Multilingual Language-Image Model. - Xi Chen 071; Xiao Wang 038; Soravit Changpinyo; A. J. Piergiovanni; Piotr Padlewski; Daniel Salz; Sebastian Goodman; Adam Grycner; Basil Mustafa; Lucas Beyer; Alexander Kolesnikov 003; Joan Puigcerver; et al. (CoRR, 2022)

Image-and-Language Understanding from Pixels Only. - Michael Tschannen; Basil Mustafa; Neil Houlsby (CoRR, 2022)

Does your dermatology classifier know what it doesn't know? Detecting the long-tail of unseen conditions. - Abhijit Guha Roy; Jie Ren 006; Shekoofeh Azizi; Aaron Loh; Vivek Natarajan; Basil Mustafa; Nick Pawlowski; Jan Freyberg; Yuan Liu; Zachary Beaver; Nam Vo; Peggy Bui; et al. (Medical Image Anal., 2022)

Sparse MoEs meet Efficient Ensembles. - James Urquhart Allingham; Florian Wenzel; Zelda E. Mariet; Basil Mustafa; Joan Puigcerver; Neil Houlsby; Ghassen Jerfel; Vincent Fortuin; Balaji Lakshminarayanan; Jasper Snoek; Dustin Tran; Carlos Riquelme Ruiz; et al. (Trans. Mach. Learn. Res., 2022)

CLIPPO: Image-and-Language Understanding from Pixels Only. - Michael Tschannen; Basil Mustafa; Neil Houlsby (CVPR, 2023)

Sigmoid Loss for Language Image Pre-Training. - Xiaohua Zhai; Basil Mustafa; Alexander Kolesnikov 003; Lucas Beyer (ICCV, 2023)

PaLI: A Jointly-Scaled Multilingual Language-Image Model. - Xi Chen 071; Xiao Wang 038; Soravit Changpinyo; A. J. Piergiovanni; Piotr Padlewski; Daniel Salz; Sebastian Goodman; Adam Grycner; Basil Mustafa; Lucas Beyer; Alexander Kolesnikov 003; Joan Puigcerver; et al. (ICLR, 2023)

Massively Scaling Heteroscedastic Classifiers. - Mark Collier; Rodolphe Jenatton; Basil Mustafa; Neil Houlsby; Jesse Berent; Effrosyni Kokiopoulou (ICLR, 2023)

Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints. - Aran Komatsuzaki; Joan Puigcerver; James Lee-Thorp; Carlos Riquelme Ruiz; Basil Mustafa; Joshua Ainslie; Yi Tay; Mostafa Dehghani 001; Neil Houlsby (ICLR, 2023)

Scaling Vision Transformers to 22 Billion Parameters. - Mostafa Dehghani 001; Josip Djolonga; Basil Mustafa; Piotr Padlewski; Jonathan Heek; Justin Gilmer; Andreas Peter Steiner; Mathilde Caron; Robert Geirhos; Ibrahim Alabdulmohsin; Rodolphe Jenatton; Lucas Beyer; et al. (ICML, 2023)

Patch n' Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolution. - Mostafa Dehghani 001; Basil Mustafa; Josip Djolonga; Jonathan Heek; Matthias Minderer; Mathilde Caron; Andreas Steiner 001; Joan Puigcerver; Robert Geirhos; Ibrahim M. Alabdulmohsin; Avital Oliver; Piotr Padlewski; et al. (NeurIPS, 2023)

Three Towers: Flexible Contrastive Learning with Pretrained Image Models. - Jannik Kossen; Mark Collier; Basil Mustafa; Xiao Wang 038; Xiaohua Zhai; Lucas Beyer; Andreas Steiner 001; Jesse Berent; Rodolphe Jenatton; Effrosyni Kokiopoulou (NeurIPS, 2023)

PaLI-X: On Scaling up a Multilingual Vision and Language Model. - Xi Chen 071; Josip Djolonga; Piotr Padlewski; Basil Mustafa; Soravit Changpinyo; Jialin Wu; Carlos Riquelme Ruiz; Sebastian Goodman; Xiao Wang 038; Yi Tay; Siamak Shakeri; Mostafa Dehghani 001; et al. (CoRR, 2023)

Towards Generalist Biomedical AI. - Tao Tu 001; Shekoofeh Azizi; Danny Driess; Mike Schaekermann; Mohamed Amin; Pi-Chuan Chang; Andrew Carroll; Chuck Lau; Ryutaro Tanno; Ira Ktena; Basil Mustafa; Aakanksha Chowdhery; et al. (CoRR, 2023)

PaLI-3 Vision Language Models: Smaller, Faster, Stronger. - Xi Chen 071; Xiao Wang 038; Lucas Beyer; Alexander Kolesnikov 003; Jialin Wu; Paul Voigtlaender; Basil Mustafa; Sebastian Goodman; Ibrahim Alabdulmohsin; Piotr Padlewski; Daniel Salz; Xi Xiong; et al. (CoRR, 2023)

On Scaling Up a Multilingual Vision and Language Model. - Xi Chen 071; Josip Djolonga; Piotr Padlewski; Basil Mustafa; Soravit Changpinyo; Jialin Wu; Carlos Riquelme Ruiz; Sebastian Goodman; Xiao Wang 038; Yi Tay; Siamak Shakeri; Mostafa Dehghani 001; et al. (CVPR, 2024)

From Sparse to Soft Mixtures of Experts. - Joan Puigcerver; Carlos Riquelme Ruiz; Basil Mustafa; Neil Houlsby (ICLR, 2024)

Closing the AI generalization gap by adjusting for dermatology condition distribution differences across clinical settings. - Rajeev V. Rikhye; Aaron Loh; Grace Eunhae Hong; Preeti Singh; Margaret Ann Smith; Vijaytha Muralidharan; Doris Wong; Rory Sayres; Michelle Phung; Nicolas Betancourt; Bradley Fong; Rachna Sahasrabudhe; et al. (CoRR, 2024)

Capabilities of Gemini Models in Medicine. - Khaled Saab 003; Tao Tu 001; Wei-Hung Weng; Ryutaro Tanno; David Stutz; Ellery Wulczyn; Fan Zhang; Tim Strother; Chunjong Park; Elahe Vedadi; Juanma Zambrano Chaves; Szu-Yeu Hu; et al. (CoRR, 2024)

SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Features. - Michael Tschannen; Alexey A. Gritsenko; Xiao Wang 038; Muhammad Ferjad Naeem; Ibrahim Alabdulmohsin; Nikhil Parthasarathy; Talfan Evans; Lucas Beyer; Ye Xia; Basil Mustafa; Olivier J. Hénaff; Jeremiah Harmsen; et al. (CoRR, 2025)

Gemma 3 Technical Report. - Aishwarya Kamath; Johan Ferret; Shreya Pathak; Nino Vieillard; Ramona Merhej; Sarah Perrin; Tatiana Matejovicova; Alexandre Ramé; Morgane Rivière; Louis Rouillard; Thomas Mesnard; Geoffrey Cideron; et al. (CoRR, 2025)