Sunayana Sitaram

According to our database, Sunayana Sitaram authored at least 66 papers between 2009 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

DOSA: A Dataset of Social Artifacts from Different Indian Geographical Subcultures.

Agrima Seth, Sanchit Ahuja, Kalika Bali, Sunayana Sitaram

CoRR, 2024

Private Benchmarking to Prevent Contamination and Improve Comparative Evaluation of LLMs.

Nishanth Chandran, Sunayana Sitaram, Divya Gupta, Rahul Sharma, Kashish Mittal, Manohar Swaminathan

CoRR, 2024

A Unified Framework and Dataset for Assessing Gender Bias in Vision-Language Models.

Ashutosh Sathe, Prachi Jain, Sunayana Sitaram

CoRR, 2024

CultureLLM: Incorporating Cultural Differences into Large Language Models.

Cheng Li, Mengzhou Chen, Jindong Wang, Sunayana Sitaram, Xing Xie

CoRR, 2024

MAPLE: Multilingual Evaluation of Parameter Efficient Finetuning of Large Language Models.

Divyanshu Aggarwal, Ashutosh Sathe, Sunayana Sitaram

CoRR, 2024

MAFIA: Multi-Adapter Fused Inclusive Language Models.

Prachi Jain, Ashutosh Sathe, Varun Gumma, Kabir Ahuja, Sunayana Sitaram

Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics, 2024

Are Large Language Model-based Evaluators the Solution to Scaling Up Multilingual Evaluation?

Rishav Hada, Varun Gumma, Adrian de Wynter, Harshita Diddee, Mohamed Ahmed, Monojit Choudhury, Kalika Bali, Sunayana Sitaram

Proceedings of the Findings of the Association for Computational Linguistics: EACL 2024, 2024

2023

MEGAVERSE: Benchmarking Large Language Models Across Languages, Modalities, Models and Tasks.

Sanchit Ahuja, Divyanshu Aggarwal, Varun Gumma, Ishaan Watts, Ashutosh Sathe, Millicent Ochieng, Rishav Hada, Prachi Jain, Maxamed Axmed, Kalika Bali, Sunayana Sitaram

CoRR, 2023

Breaking Language Barriers with a LEAP: Learning Strategies for Polyglot LLMs.

Akshay Uttama Nambi, Vaibhav Balloli, Mercy Prasanna Ranjit, Tanuja Ganu, Kabir Ahuja, Sunayana Sitaram, Kalika Bali

CoRR, 2023

MEGA: Multilingual Evaluation of Generative AI.

Kabir Ahuja, Rishav Hada, Millicent Ochieng, Prachi Jain, Harshita Diddee, Samuel Maina, Tanuja Ganu, Sameer Segal, Maxamed Axmed, Kalika Bali, Sunayana Sitaram

CoRR, 2023

Analysing the Masked Predictive Coding Training Criterion for Pre-Training a Speech Representation Model.

Hemant Yadav, Sunayana Sitaram, Rajiv Ratn Shah

Proceedings of the IEEE International Conference on Acoustics, 2023

Representativeness as a Forgotten Lesson for Multilingual and Code-switched Data Collection and Preparation.

A. Seza Dogruöz, Sunayana Sitaram, Zheng Xin Yong

Proceedings of the Findings of the Association for Computational Linguistics: EMNLP 2023, 2023

MEGA: Multilingual Evaluation of Generative AI.

Kabir Ahuja, Harshita Diddee, Rishav Hada, Millicent Ochieng, Krithika Ramesh, Prachi Jain, Akshay Uttama Nambi, Tanuja Ganu, Sameer Segal, Mohamed Ahmed, Kalika Bali, Sunayana Sitaram

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

Performance and Risk Trade-offs for Multi-word Text Prediction at Scale.

Aniket Vashishtha, S. Sai Prasad, Payal Bajaj, Vishrav Chaudhary, Kate Cook, Sandipan Dandapat, Sunayana Sitaram, Monojit Choudhury

Proceedings of the Findings of the Association for Computational Linguistics: EACL 2023, 2023

Fairness in Language Models Beyond English: Gaps and Challenges.

Krithika Ramesh, Sunayana Sitaram, Monojit Choudhury

Proceedings of the Findings of the Association for Computational Linguistics: EACL 2023, 2023

DiTTO: A Feature Representation Imitation Approach for Improving Cross-Lingual Transfer.

Shanu Kumar, Abbaraju Soujanya, Sandipan Dandapat, Sunayana Sitaram, Monojit Choudhury

Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, 2023

Partial Rank Similarity Minimization Method for Quality MOS Prediction of Unseen Speech Synthesis Systems in Zero-Shot and Semi-Supervised Setting.

Hemant Yadav, Erica Cooper, Junichi Yamagishi, Sunayana Sitaram, Rajiv Ratn Shah

Proceedings of the IEEE Automatic Speech Recognition and Understanding Workshop, 2023

Everything you need to know about Multilingual LLMs: Towards fair, performant and reliable models for languages of the world.

Sunayana Sitaram, Monojit Choudhury, Barun Patra, Vishrav Chaudhary, Kabir Ahuja, Kalika Bali

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics: Tutorial Abstracts, 2023

On Evaluating and Mitigating Gender Biases in Multilingual Settings.

Aniket Vashishtha, Kabir Ahuja, Sunayana Sitaram

Proceedings of the Findings of the Association for Computational Linguistics: ACL 2023, 2023

A Comparative Study on the Impact of Model Compression Techniques on Fairness in Language Models.

Krithika Ramesh, Arnav Chavan, Shrey Pandit, Sunayana Sitaram

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

2022

Beyond Static Models and Test Sets: Benchmarking the Potential of Pre-trained Models Across Tasks and Languages.

Kabir Ahuja, Sandipan Dandapat, Sunayana Sitaram, Monojit Choudhury

CoRR, 2022

Benchmarking Evaluation Metrics for Code-Switching Automatic Speech Recognition.

Injy Hamed, Amir Hussein, Oumnia Chellah, Shammur Absar Chowdhury, Hamdy Mubarak, Sunayana Sitaram, Nizar Habash, Ahmed Ali

Proceedings of the IEEE Spoken Language Technology Workshop, 2022

A Survey of Multilingual Models for Automatic Speech Recognition.

Hemant Yadav, Sunayana Sitaram

Proceedings of the Thirteenth Language Resources and Evaluation Conference, 2022

Multilingual CheckList: Generation and Evaluation.

Karthikeyan K, Shaily Bhatt, Pankaj Singh, Somak Aditya, Sandipan Dandapat, Sunayana Sitaram, Monojit Choudhury

Proceedings of the Findings of the Association for Computational Linguistics: AACL-IJCNLP 2022, 2022

On the Calibration of Massively Multilingual Language Models.

Kabir Ahuja, Sunayana Sitaram, Sandipan Dandapat, Monojit Choudhury

Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, 2022

LITMUS Predictor: An AI Assistant for Building Reliable, High-Performing and Fair Multilingual NLP Systems.

Anirudh Srinivasan, Gauri Kholkar, Rahul Kejriwal, Tanuja Ganu, Sandipan Dandapat, Sunayana Sitaram, Balakrishnan Santhanam, Somak Aditya, Kalika Bali, Monojit Choudhury

Proceedings of the Thirty-Sixth AAAI Conference on Artificial Intelligence, 2022

2021

Predicting the Performance of Multilingual NLP Models.

Anirudh Srinivasan, Sunayana Sitaram, Tanuja Ganu, Sandipan Dandapat, Kalika Bali, Monojit Choudhury

CoRR, 2021

Multilingual and code-switching ASR challenges for low resource Indian languages.

Anuj Diwan, Rakesh Vaideeswaran, Sanket Shah, Ankita Singh, Srinivasa Raghavan K. M., Shreya Khare, Vinit Unni, Saurabh Vyas, Akash Rajpuria, Chiranjeevi Yarra, Ashish R. Mittal, Prasanta Kumar Ghosh, Preethi Jyothi, Kalika Bali, Vivek Seshadri, Sunayana Sitaram, Samarth Bharadwaj, Jai Nanavati, Raoul Nanavati, Karthik Sankaranarayanan, Tejaswi Seeram, Basil Abraham

CoRR, 2021

MUCS 2021: Multilingual and Code-Switching ASR Challenges for Low Resource Indian Languages.

Anuj Diwan, Rakesh Vaideeswaran, Sanket Shah, Ankita Singh, Srinivasa Raghavan K. M., Shreya Khare, Vinit Unni, Saurabh Vyas, Akash Rajpuria, Chiranjeevi Yarra, Ashish R. Mittal, Prasanta Kumar Ghosh, Preethi Jyothi, Kalika Bali, Vivek Seshadri, Sunayana Sitaram, Samarth Bharadwaj, Jai Nanavati, Raoul Nanavati, Karthik Sankaranarayanan

Proceedings of the Interspeech 2021, 22nd Annual Conference of the International Speech Communication Association, Brno, Czechia, 30 August, 2021

On the Universality of Deep Contextual Language Models.

Shaily Bhatt, Poonam Goyal, Sandipan Dandapat, Monojit Choudhury, Sunayana Sitaram

Proceedings of the 18th International Conference on Natural Language Processing (ICON 2021), National Institute of Technology Silchar, Silchar, India, December 16, 2021

GCM: A Toolkit for Generating Synthetic Code-mixed Text.

Mohd Sanad Zaki Rizvi, Anirudh Srinivasan, Tanuja Ganu, Monojit Choudhury, Sunayana Sitaram

Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: System Demonstrations, 2021

A Survey of Code-switching: Linguistic and Social Perspectives for Language Technologies.

A. Seza Dogruöz, Sunayana Sitaram, Barbara E. Bullock, Almeida Jacqueline Toribio

Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, 2021

2020

Cross-lingual and Multilingual Spoken Term Detection for Low-Resource Indian Languages.

Sanket Shah, Satarupa Guha, Simran Khanuja, Sunayana Sitaram

CoRR, 2020

Learning not to Discriminate: Task Agnostic Learning for Improving Monolingual and Code-switched Speech Recognition.

Gurunath Reddy Madhumani, Sanket Shah, Basil Abraham, Vikas Joshi, Sunayana Sitaram

CoRR, 2020

Learning to Recognize Code-switched Speech Without Forgetting Monolingual Speech Recognition.

Sanket Shah, Basil Abraham, Gurunath Reddy M, Sunayana Sitaram, Vikas Joshi

CoRR, 2020

Crowdsourcing Speech Data for Low-Resource Languages from Low-Income Workers.

Basil Abraham, Danish Goel, Divya Siddarth, Kalika Bali, Manu Chopra, Monojit Choudhury, Pratik Joshi, Preethi Jyothi, Sunayana Sitaram, Vivek Seshadri

Proceedings of The 12th Language Resources and Evaluation Conference, 2020

GLUECoS: An Evaluation Benchmark for Code-Switched NLP.

Simran Khanuja, Sandipan Dandapat, Anirudh Srinivasan, Sunayana Sitaram, Monojit Choudhury

Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 2020

A New Dataset for Natural Language Inference from Code-mixed Conversations.

Simran Khanuja, Sandipan Dandapat, Sunayana Sitaram, Monojit Choudhury

Proceedings of the The 4th Workshop on Computational Approaches to Code Switching, 2020

2019

Unsung Challenges of Building and Deploying Language Technologies for Low Resource Language Communities.

Pratik Joshi, Christain Barnes, Sebastin Santy, Simran Khanuja, Sanket Shah, Anirudh Srinivasan, Satwik Bhattamishra, Sunayana Sitaram, Monojit Choudhury, Kalika Bali

CoRR, 2019

End-to-End ASR for Code-switched Hindi-English Speech.

Brij Mohan Lal Srivastava, Basil Abraham, Sunayana Sitaram, Rupesh K. Mehta, Preethi Jyothi

CoRR, 2019

A Survey of Code-switched Speech and Language Processing.

Sunayana Sitaram, Khyathi Raghavi Chandu, Sai Krishna Rallabandi, Alan W. Black

CoRR, 2019

Using Monolingual Speech Recognition for Spoken Term Detection in Code-switched Hindi-English Speech.

Sanket Shah, Sunayana Sitaram

Proceedings of the 2019 International Conference on Data Mining Workshops, 2019

2018

Interspeech 2018 Low Resource Automatic Speech Recognition Challenge for Indian Languages.

Brij Mohan Lal Srivastava, Sunayana Sitaram, Rupesh Kumar Mehta, Krishna Doss Mohan, Pallavi Matani, Sandeepkumar Satpal, Kalika Bali, Radhakrishnan Srikanth, Niranjan Nayak

Proceedings of the 6th Intl. Workshop on Spoken Language Technologies for Under-Resourced Languages, 2018

Discovering Canonical Indian English Accents: A Crowdsourcing-based Approach.

Sunayana Sitaram, Varun Manjunath, Varun Bharadwaj, Monojit Choudhury, Kalika Bali, Michael Tjalve

Proceedings of the Eleventh International Conference on Language Resources and Evaluation, 2018

Homophone Identification and Merging for Code-switched Speech Recognition.

Brij Mohan Lal Srivastava, Sunayana Sitaram

Proceedings of the Interspeech 2018, 2018

Effect of TTS Generated Audio on OOV Detection and Word Error Rate in ASR for Low-resource Languages.

Savitha Murthy, Dinkar Sitaram, Sunayana Sitaram

Proceedings of the Interspeech 2018, 2018

Word Embeddings for Code-Mixed Language Processing.

Adithya Pratapa, Monojit Choudhury, Sunayana Sitaram

Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, Brussels, Belgium, October 31, 2018

Language Modeling for Code-Mixing: The Role of Linguistic Theory based Synthetic Data.

Adithya Pratapa, Gayatri Bhat, Monojit Choudhury, Sunayana Sitaram, Sandipan Dandapat, Kalika Bali

Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, 2018

Phone Merging For Code-Switched Speech Recognition.

Sunit Sivasankaran, Brij Mohan Lal Srivastava, Sunayana Sitaram, Kalika Bali, Monojit Choudhury

Proceedings of the Third Workshop on Computational Approaches to Linguistic Code-Switching@ACL 2018, 2018

Automatic Detection of Code-switching Style from Acoustics.

Sai Krishna Rallabandi, Sunayana Sitaram, Alan W. Black

Proceedings of the Third Workshop on Computational Approaches to Linguistic Code-Switching@ACL 2018, 2018

2017

Speech Synthesis for Mixed-Language Navigation Instructions.

Khyathi Raghavi Chandu, Sai Krishna Rallabandi, Sunayana Sitaram, Alan W. Black

Proceedings of the Interspeech 2017, 2017

Curriculum Design for Code-switching: Experiments with Language Identification and Language Modeling with Deep Neural Networks.

Monojit Choudhury, Kalika Bali, Sunayana Sitaram, Ashutosh Baheti

Proceedings of the 14th International Conference on Natural Language Processing, 2017

2016

Open-Source Consumer-Grade Indic Text To Speech.

Andrew Wilkinson, Alok Parlikar, Sunayana Sitaram, Tim White, Alan W. Black, Suresh Bazaj

Proceedings of the 9th ISCA Speech Synthesis Workshop, 2016

Experiments with Cross-lingual Systems for Synthesis of Code-Mixed Text.

Sunayana Sitaram, Sai Krishna Rallabandi, Shruti Rijhwani, Alan W. Black

Proceedings of the 9th ISCA Speech Synthesis Workshop, 2016

Polyglot Neural Language Models: A Case Study in Cross-Lingual Phonetic Representation Learning.

Yulia Tsvetkov, Sunayana Sitaram, Manaal Faruqui, Guillaume Lample, Patrick Littell, David R. Mortensen, Alan W. Black, Lori S. Levin, Chris Dyer

Proceedings of the NAACL HLT 2016, 2016

Speech Synthesis of Code-Mixed Text.

Sunayana Sitaram, Alan W. Black

Proceedings of the Tenth International Conference on Language Resources and Evaluation LREC 2016, 2016

2015

Universal grapheme-based speech synthesis.

Sunayana Sitaram, Alok Parlikar, Gopala Krishna Anumanchipalli, Alan W. Black

Proceedings of the INTERSPEECH 2015, 2015

Using acoustics to improve pronunciation for synthesis of low resource languages.

Sunayana Sitaram, Serena Jeblee, Alan W. Black

Proceedings of the INTERSPEECH 2015, 2015

Using articulatory features and inferred phonological segments in zero resource speech processing.

Pallavi Baljekar, Sunayana Sitaram, Prasanna Kumar Muthukumar, Alan W. Black

Proceedings of the INTERSPEECH 2015, 2015

2013

Text to speech in new languages without a standardized orthography.

Sunayana Sitaram, Gopala Krishna Anumanchipalli, Justin T. Chiu, Alok Parlikar, Alan W. Black

Proceedings of the Eighth ISCA Tutorial and Research Workshop on Speech Synthesis, 2013

Bootstrapping Text-to-Speech for speech processing in languages without an orthography.

Sunayana Sitaram, Sukhada Palkar, Yun-Nung Chen, Alok Parlikar, Alan W. Black

Proceedings of the IEEE International Conference on Acoustics, 2013

A Hindi speech recognizer for an agricultural video search application.

Kalika Bali, Sunayana Sitaram, Sébastien Cuendet, Indrani Medhi

Proceedings of the Annual Symposium on Computing for Development, 2013

2012

Mining Data from Project LISTEN's Reading Tutor to Analyze Development of Children's Oral Reading Prosody.

Sunayana Sitaram, Jack Mostow

Proceedings of the Twenty-Fifth International Florida Artificial Intelligence Research Society Conference, 2012

2011

Two methods for assessing oral reading prosody.

Minh Duong, Jack Mostow, Sunayana Sitaram

ACM Trans. Speech Lang. Process., 2011

What visual feedback should a reading tutor give children on their oral reading prosody?

Sunayana Sitaram, Jack Mostow, Yuanpeng Li, Anders Weinstein, David Yen, Joe Valeri

Proceedings of the ISCA International Workshop on Speech and Language Technology in Education, 2011

2009

DA-IICT Cross-lingual and Multilingual Corpora for Speaker Recognition.

Hemant A. Patil, Sunayana Sitaram, Esha Sharma

Proceedings of the Seventh International Conference on Advances in Pattern Recognition, 2009