On the weak link between importance and prunability of attention heads. - Aakriti Budhraja; Madhura Pande; Preksha Nema; Pratyush Kumar; Mitesh M. Khapra (EMNLP (1), 2020)

On the Importance of Local Information in Transformer Based Models. - Madhura Pande; Aakriti Budhraja; Preksha Nema; Pratyush Kumar; Mitesh M. Khapra (CoRR, 2020)

The Heads Hypothesis: A Unifying Statistical Approach Towards Understanding Multi-Headed Attention in BERT. - Madhura Pande; Aakriti Budhraja; Preksha Nema; Pratyush Kumar; Mitesh M. Khapra (AAAI, 2021)

On the Prunability of Attention Heads in Multilingual BERT. - Aakriti Budhraja; Madhura Pande; Pratyush Kumar; Mitesh M. Khapra (CoRR, 2021)

Learning-to-Spell: Weak Supervision based Query Correction in E-Commerce Search with Small Strong Labels. - Madhura Pande; Vishal Kakkar; Manish Bansal; Surender Kumar; Chinmay Sharma; Himanshu Malhotra; Praneet Mehta (CIKM, 2022)

Search Query Spell Correction with Weak Supervision in E-commerce. - Vishal Kakkar; Chinmay Sharma; Madhura Pande; Surender Kumar (ACL (industry), 2023)