Mehar Bhatia

According to our database, Mehar Bhatia authored at least 13 papers between 2020 and 2025.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2025

CulturalFrames: Assessing Cultural Expectation Alignment in Text-to-Image Models and Evaluation Metrics.

Shravan Nayak, Mehar Bhatia, Xiaofeng Zhang, Verena Rieser, Lisa Anne Hendricks, Sjoerd van Steenkiste, Yash Goyal, Karolina Stanczak, Aishwarya Agrawal

CoRR, June, 2025

Is It Bad to Work All the Time? Cross-Cultural Evaluation of Social Norm Biases in GPT-4.

Zhuozhuo Joy Liu, Farhan Samir, Mehar Bhatia, Laura K. Nelson, Vered Shwartz

CoRR, May, 2025

DeepSeek-R1 Thoughtology: Let's about LLM Reasoning.

Sara Vera Marjanovic, Arkil Patel, Vaibhav Adlakha, Milad Aghajohari, Parishad BehnamGhader, Mehar Bhatia, Aditi Khandelwal, Austin Kraft, Benno Krojer, Xing Han Lù, Nicholas Meade, Dongchan Shin, Amirhossein Kazemnejad, Gaurav Kamath, Marius Mosbach, Karolina Stanczak, Siva Reddy

CoRR, April, 2025

Societal Alignment Frameworks Can Improve LLM Alignment.

Karolina Stanczak, Nicholas Meade, Mehar Bhatia, Hattie Zhou, Konstantin Böttinger, Jeremy Barnes, Jason Stanley, Jessica Montgomery, Richard S. Zemel, Nicolas Papernot, Nicolas Chapados, Denis Therien, Timothy P. Lillicrap, Ana Marasovic, Sylvie Delacroix, Gillian K. Hadfield, Siva Reddy

CoRR, March, 2025

CulturalBench: A Robust, Diverse and Challenging Benchmark for Measuring LMs' Cultural Knowledge Through Human-AI Red-Teaming.

Yu Ying Chiu, Liwei Jiang, Bill Yuchen Lin, Chan Young Park, Shuyue Stella Li, Sahithya Ravi, Mehar Bhatia, Maria Antoniak, Yulia Tsvetkov, Vered Shwartz, Yejin Choi

Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2025

2024

CulturalBench: a Robust, Diverse and Challenging Benchmark on Measuring the (Lack of) Cultural Knowledge of LLMs.

Yu Ying Chiu, Liwei Jiang, Bill Yuchen Lin, Chan Young Park, Shuyue Stella Li, Sahithya Ravi, Mehar Bhatia, Maria Antoniak, Yulia Tsvetkov, Vered Shwartz, Yejin Choi

CoRR, 2024

CulturalTeaming: AI-Assisted Interactive Red-Teaming for Challenging LLMs' (Lack of) Multicultural Knowledge.

Yu Ying Chiu, Liwei Jiang, Maria Antoniak, Chan Young Park, Shuyue Stella Li, Mehar Bhatia, Sahithya Ravi, Yulia Tsvetkov, Vered Shwartz, Yejin Choi

CoRR, 2024

From Local Concepts to Universals: Evaluating the Multicultural Understanding of Vision-Language Models.

Mehar Bhatia, Sahithya Ravi, Aditya Chinchure, Eunjeong Hwang, Vered Shwartz

Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, 2024

2023

GD-COMET: A Geo-Diverse Commonsense Inference Model.

Mehar Bhatia, Vered Shwartz

Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

2022

Evaluation Toolkit For Robustness Testing Of Automatic Essay Scoring Systems.

Anubha Kabra, Mehar Bhatia, Yaman Kumar Singla, Junyi Jessy Li, Rajiv Ratn Shah

Proceedings of the CODS-COMAD 2022: 5th Joint International Conference on Data Science & Management of Data (9th ACM IKDD CODS and 27th COMAD), Bangalore, India, January 8, 2022

2021

Perception Point: Identifying Critical Learning Periods in Speech for Bilingual Networks.

Anuj Saraswat, Mehar Bhatia, Yaman Kumar Singla, Changyou Chen, Rajiv Ratn Shah

CoRR, 2021

One to Rule Them All: Towards Joint Indic Language Hate Speech Detection.

Mehar Bhatia, Tenzin Singhay Bhotia, Akshat Agarwal, Prakash Ramesh, Shubham Gupta, Kumar Shridhar, Felix Laumann, Ayushman Dash

Proceedings of the Working Notes of FIRE 2021, 2021

2020

Calling Out Bluff: Attacking the Robustness of Automatic Scoring Systems with Simple Adversarial Testing.

Yaman Kumar, Mehar Bhatia, Anubha Kabra, Junyi Jessy Li, Di Jin, Rajiv Ratn Shah

CoRR, 2020