Cerebras-GPT: Open Compute-Optimal Language Models Trained on the Cerebras Wafer-Scale Cluster. - Nolan Dey; Gurpreet Gosal; Zhiming Chen; Hemant Khachane; William Marshall; Ribhu Pathria; Marvin Tom; Joel Hestness (CoRR, 2023)

Improving Resnet-9 Generalization Trained on Small Datasets. - Omar Mohamed Awad; Habib Hajimolahoseini; Michael Lim; Gurpreet Gosal; Walid Ahmed; Yang Liu; Gordon Deng (CoRR, 2023)

Med42 - Evaluating Fine-Tuning Strategies for Medical LLMs: Full-Parameter vs. Parameter-Efficient Approaches. - Clément Christophe; Praveen K. Kanithi; Prateek Munjal; Tathagata Raha; Nasir Hayat; Ronnie Rajan; Ahmed Al-Mahrooqi; Avani Gupta; Muhammad Umar Salman; Gurpreet Gosal; Bhargav Kanakiya; Charles Chen; et al. (CoRR, 2024)

Bilingual Adaptation of Monolingual Foundation Models. - Gurpreet Gosal; Yishi Xu; Gokul Ramakrishnan; Rituraj Joshi; Avraham Sheinin; Zhiming Chen; Biswajit Mishra; Natalia Vassilieva; Joel Hestness; Neha Sengupta; Sunil Kumar Sahu; Bokang Jia; et al. (CoRR, 2024)

Straight to Zero: Why Linearly Decaying the Learning Rate to Zero Works Best for LLMs. - Shane Bergsma; Nolan Simran Dey; Gurpreet Gosal; Gavia Gray; Daria Soboleva; Joel Hestness (ICLR, 2025)

Llama-3.1-Sherkala-8B-Chat: An Open Large Language Model for Kazakh. - Fajri Koto; Rituraj Joshi; Nurdaulet Mukhituly; Yuxia Wang; Zhuohan Xie; Rahul Pal; Daniil Orel; Parvez Mullah; Diana Turmakhan; Maiya Goloburda; Mohammed Kamran; Samujjwal Ghosh; et al. (CoRR, 2025)

Llama-3-Nanda-10B-Chat: An Open Generative Large Language Model for Hindi. - Monojit Choudhury; Shivam Chauhan; Rocktim Jyoti Das; Dhruv Sahnan; Xudong Han; Haonan Li 002; Aaryamonvikram Singh; Alok Anil Jadhav; Utkarsh Agarwal; Mukund Choudhary; Debopriyo Banerjee; Fajri Koto; et al. (CoRR, 2025)

Power Lines: Scaling Laws for Weight Decay and Batch Size in LLM Pre-training. - Shane Bergsma; Nolan Dey; Gurpreet Gosal; Gavia Gray; Daria Soboleva; Joel Hestness (CoRR, 2025)