IndicLLMSuite: A Blueprint for Creating Pre-training and Fine-Tuning Datasets for Indian Languages. - Mohammed Safi Ur Rahman Khan; Priyam Mehta; Ananth Sankar; Umashankar Kumaravelan; Sumanth Doddapaneni; Suriyaprasaad B; Varun Balan G; Sparsh Jain; Anoop Kunchukuttan; Pratyush Kumar; Raj Dabre; Mitesh M. Khapra (ACL (1), 2024)

Finding Blind Spots in Evaluator LLMs with Interpretable Checklists. - Sumanth Doddapaneni; Mohammed Safi Ur Rahman Khan; Sshubam Verma; Mitesh M. Khapra (EMNLP, 2024)

Airavata: Introducing Hindi Instruction-tuned LLM. - Jay P. Gala; Thanmay Jayakumar; Jaavid Aktar Husain; Aswanth Kumar M.; Mohammed Safi Ur Rahman Khan; Diptesh Kanojia; Ratish Puduppully; Mitesh M. Khapra; Raj Dabre; V. Rudra Murthy; Anoop Kunchukuttan (CoRR, 2024)

IndicLLMSuite: A Blueprint for Creating Pre-training and Fine-Tuning Datasets for Indian Languages. - Mohammed Safi Ur Rahman Khan; Priyam Mehta; Ananth Sankar; Umashankar Kumaravelan; Sumanth Doddapaneni; Suriyaprasaad G; Varun Balan G; Sparsh Jain; Anoop Kunchukuttan; Pratyush Kumar; Raj Dabre; Mitesh M. Khapra (CoRR, 2024)

BhasaAnuvaad: A Speech Translation Dataset for 13 Indian Languages. - Sparsh Jain; Ashwin Sankar; Devilal Choudhary; Dhairya Suman; Nikhil Narasimhan; Mohammed Safi Ur Rahman Khan; Anoop Kunchukuttan; Mitesh M. Khapra; Raj Dabre (CoRR, 2024)

Pralekha: An Indic Document Alignment Evaluation Benchmark. - Sanjay Suryanarayanan; Haiyue Song; Mohammed Safi Ur Rahman Khan; Anoop Kunchukuttan; Mitesh M. Khapra; Raj Dabre (CoRR, 2024)

Cross-Lingual Auto Evaluation for Assessing Multilingual LLMs. - Sumanth Doddapaneni; Mohammed Safi Ur Rahman Khan; Dilip Venkatesh; Raj Dabre; Anoop Kunchukuttan; Mitesh M. Khapra (ACL (1), 2025)

Can Vision-Language Models Evaluate Handwritten Math? - Oikantik Nath; Hanani Bathina; Mohammed Safi Ur Rahman Khan; Mitesh M. Khapra (ACL (1), 2025)

FairI Tales: Evaluation of Fairness in Indian Contexts with a Focus on Bias and Stereotypes. - Janki Atul Nawale; Mohammed Safi Ur Rahman Khan; Janani D; Mansi Gupta; Danish Pruthi; Mitesh M. Khapra (ACL (1), 2025)

Towards Building Large Scale Datasets and State-of-the-Art Automatic Speech Translation Systems for 14 Indian Languages. - Ashwin Sankar; Sparsh Jain; Nikhil Narasimhan; Devilal Choudhary; Dhairya Suman; Mohammed Safi Ur Rahman Khan; Anoop Kunchukuttan; Mitesh M. Khapra; Raj Dabre (ACL (1), 2025)

MILU: A Multi-task Indic Language Understanding Benchmark. - Sshubam Verma; Mohammed Safi Ur Rahman Khan; Vishwajeet Kumar; Rudra Murthy; Jaydeep Sen (NAACL (Long Papers), 2025)