A survey of Community Question Answering. - Barun Patra (CoRR, 2017)

Towards Understanding and Answering Multi-Sentence Recommendation Questions on Tourism. - Danish Contractor; Barun Patra; Mausam; Parag Singla (CoRR, 2018)

Bilingual Lexicon Induction with Semi-supervision in Non-Isometric Embedding Spaces. - Barun Patra; Joel Ruben Antony Moniz; Sarthak Garg; Matthew R. Gormley; Graham Neubig (ACL (1), 2019)

Weakly Supervised Attention Networks for Entity Recognition. - Barun Patra; Joel Ruben Antony Moniz (EMNLP/IJCNLP (1), 2019)

Compression and Localization in Reinforcement Learning for ATARI Games. - Joel Ruben Antony Moniz; Barun Patra; Sarthak Garg (CoRR, 2019)

ScopeIt: Scoping Task Relevant Sentences in Documents. - Barun Patra; Vishwas Suryanarayanan; Chala Fufa; Pamela Bhattacharya; Charles Lee (COLING (Industry), 2020)

To Schedule or not to Schedule: Extracting Task Specific Temporal Entities and Associated Negation Constraints. - Barun Patra; Chala Fufa; Pamela Bhattacharya; Charles Lee (EMNLP (1), 2020)

Invariant Language Modeling. - Maxime Peyrard; Sarvjeet Singh Ghotra; Martin Josifoski; Vidhan Agarwal; Barun Patra; Dean Carignan; Emre Kiciman; Robert West 001 (CoRR, 2021)

Constrained BERT BiLSTM CRF for understanding multi-sentence entity-seeking questions. - Danish Contractor; Barun Patra; Mausam; Parag Singla (Nat. Lang. Eng., 2021)

On Efficiently Acquiring Annotations for Multilingual Models. - Joel Ruben Antony Moniz; Barun Patra; Matthew Gormley 001 (ACL (2), 2022)

Invariant Language Modeling. - Maxime Peyrard; Sarvjeet Singh Ghotra; Martin Josifoski; Vidhan Agarwal; Barun Patra; Dean Carignan; Emre Kiciman; Saurabh Tiwary; Robert West 001 (EMNLP, 2022)

On the Representation Collapse of Sparse Mixture of Experts. - Zewen Chi; Li Dong 004; Shaohan Huang; Damai Dai; Shuming Ma; Barun Patra; Saksham Singhal; Payal Bajaj; Xia Song; Xian-Ling Mao; Heyan Huang; Furu Wei (NeurIPS, 2022)

On the Representation Collapse of Sparse Mixture of Experts. - Zewen Chi; Li Dong 004; Shaohan Huang; Damai Dai; Shuming Ma; Barun Patra; Saksham Singhal; Payal Bajaj; Xia Song; Furu Wei (CoRR, 2022)

Foundation Transformers. - Hongyu Wang 009; Shuming Ma; Shaohan Huang; Li Dong 004; Wenhui Wang 003; Zhiliang Peng; Yu Wu; Payal Bajaj; Saksham Singhal; Alon Benhaim; Barun Patra; Zhun Liu; et al. (CoRR, 2022)

Language Model Decoding as Likelihood-Utility Alignment. - Martin Josifoski; Maxime Peyrard; Frano Rajic; Jiheng Wei; Debjit Paul; Valentin Hartmann; Barun Patra; Vishrav Chaudhary; Emre Kiciman; Boi Faltings; Robert West 001 (CoRR, 2022)

TorchScale: Transformers at Scale. - Shuming Ma; Hongyu Wang 009; Shaohan Huang; Wenhui Wang 003; Zewen Chi; Li Dong 004; Alon Benhaim; Barun Patra; Vishrav Chaudhary; Xia Song; Furu Wei (CoRR, 2022)

Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning. - Barun Patra; Saksham Singhal; Shaohan Huang; Zewen Chi; Li Dong 004; Furu Wei; Vishrav Chaudhary; Xia Song (ACL (1), 2023)

A Length-Extrapolatable Transformer. - Yutao Sun; Li Dong 004; Barun Patra; Shuming Ma; Shaohan Huang; Alon Benhaim; Vishrav Chaudhary; Xia Song; Furu Wei (ACL (1), 2023)

Everything you need to know about Multilingual LLMs: Towards fair, performant and reliable models for languages of the world. - Sunayana Sitaram; Monojit Choudhury; Barun Patra; Vishrav Chaudhary; Kabir Ahuja; Kalika Bali (ACL (tutorial), 2023)

Language Model Decoding as Likelihood-Utility Alignment. - Martin Josifoski; Maxime Peyrard; Frano Rajic; Jiheng Wei; Debjit Paul; Valentin Hartmann; Barun Patra; Vishrav Chaudhary; Emre Kiciman; Boi Faltings (EACL (Findings), 2023)

Magneto: A Foundation Transformer. - Hongyu Wang 009; Shuming Ma; Shaohan Huang; Li Dong 004; Wenhui Wang 003; Zhiliang Peng; Yu Wu; Payal Bajaj; Saksham Singhal; Alon Benhaim; Barun Patra; Zhun Liu; et al. (ICML, 2023)

Language Is Not All You Need: Aligning Perception with Language Models. - Shaohan Huang; Li Dong 004; Wenhui Wang 003; Yaru Hao; Saksham Singhal; Shuming Ma; Tengchao Lv; Lei Cui 001; Owais Khan Mohammed; Barun Patra; Qiang Liu; Kriti Aggarwal; et al. (NeurIPS, 2023)

A Glitch in the Matrix? Locating and Detecting Language Model Grounding with Fakepedia. - Giovanni Monea; Maxime Peyrard; Martin Josifoski; Vishrav Chaudhary; Jason Eisner; Emre Kiciman; Hamid Palangi; Barun Patra; Robert West 001 (ACL (1), 2024)

On the Adaptation of Unlimiformer for Decoder-Only Transformers. - Kian Ahrabian; Alon Benhaim; Barun Patra; Jay Pujara; Saksham Singhal; Xia Song (LREC/COLING, 2024)

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone. - Marah I Abdin; Sam Ade Jacobs; Ammar Ahmad Awan; Jyoti Aneja; Ahmed Awadallah 001; Hany Awadalla; Nguyen Bach; Amit Bahree; Arash Bakhtiari; Harkirat S. Behl; Alon Benhaim; Misha Bilenko; et al. (CoRR, 2024)

sPhinX: Sample Efficient Multilingual Instruction Fine-Tuning Through N-shot Guided Prompting. - Sanchit Ahuja; Kumar Tanmay; Hardik Hansrajbhai Chauhan; Barun Patra; Kriti Aggarwal; Luciano Del Corro; Arindam Mitra; Tejas Indulal Dhamecha; Ahmed Awadallah 001; Monojit Choudhary; Vishrav Chaudhary; Sunayana Sitaram (CoRR, 2024)

The Hitchhiker's Guide to Human Alignment with *PO. - Kian Ahrabian; Xihui Lin; Barun Patra; Vishrav Chaudhary; Alon Benhaim; Jay Pujara; Xia Song (CoRR, 2024)

Efficient LLM Training and Serving with Heterogeneous Context Sharding among Attention Heads. - Xihui Lin; Yunan Zhang 001; Suyu Ge; Barun Patra; Vishrav Chaudhary; Xia Song (CoRR, 2024)

Scaling Laws for Multilingual Language Models. - Yifei He; Alon Benhaim; Barun Patra; Praneetha Vaddamanu; Sanchit Ahuja; Parul Chopra; Vishrav Chaudhary; Han Zhao 002; Xia Song (ACL (Findings), 2025)

Hummingbird: High Fidelity Image Generation via Multimodal Context Alignment. - Minh-Quan Le; Gaurav Mittal; Tianjian Meng; A S. M. Iftekhar; Vishwas Suryanarayanan; Barun Patra; Dimitris Samaras; Mei Chen (ICLR, 2025)

A Practical Analysis of Human Alignment with *PO. - Kian Ahrabian; Xihui Lin; Barun Patra; Vishrav Chaudhary; Alon Benhaim; Jay Pujara; Xia Song (NAACL (Findings), 2025)

EfficientXLang: Towards Improving Token Efficiency Through Cross-Lingual Reasoning. - Sanchit Ahuja; Praneetha Vaddamanu; Barun Patra (CoRR, 2025)