Dispersion Based Similarity for Mining Similar Papers in Citation Network. - Saksham Singhal; Vikram Pudi (ICDM Workshops, 2015)

XLM-T: Scaling up Multilingual Machine Translation with Pretrained Cross-lingual Transformer Encoders. - Shuming Ma; Jian Yang 030; Haoyang Huang; Zewen Chi; Li Dong 004; Dongdong Zhang 001; Hany Hassan Awadalla; Alexandre Muzio; Akiko Eriguchi; Saksham Singhal; Xia Song; Arul Menezes; et al. (CoRR, 2020)

Consistency Regularization for Cross-Lingual Fine-Tuning. - Bo Zheng 010; Li Dong 004; Shaohan Huang; Wenhui Wang 003; Zewen Chi; Saksham Singhal; Wanxiang Che; Ting Liu 001; Xia Song; Furu Wei (ACL/IJCNLP (1), 2021)

mT6: Multilingual Pretrained Text-to-Text Transformer with Translation Pairs. - Zewen Chi; Li Dong 004; Shuming Ma; Shaohan Huang; Saksham Singhal; Xian-Ling Mao; Heyan Huang; Xia Song; Furu Wei (EMNLP (1), 2021)

Allocating Large Vocabulary Capacity for Cross-Lingual Language Model Pre-Training. - Bo Zheng 010; Li Dong 004; Shaohan Huang; Saksham Singhal; Wanxiang Che; Ting Liu 001; Xia Song; Furu Wei (EMNLP (1), 2021)

InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training. - Zewen Chi; Li Dong 004; Furu Wei; Nan Yang 002; Saksham Singhal; Wenhui Wang 003; Xia Song; Xian-Ling Mao; Heyan Huang; Ming Zhou 001 (NAACL-HLT, 2021)

Multilingual Machine Translation Systems from Microsoft for WMT21 Shared Task. - Jian Yang 030; Shuming Ma; Haoyang Huang; Dongdong Zhang 001; Li Dong 004; Shaohan Huang; Alexandre Muzio; Saksham Singhal; Hany Hassan; Xia Song; Furu Wei (WMT@EMNLP, 2021)

DeltaLM: Encoder-Decoder Pre-training for Language Generation and Translation by Augmenting Pretrained Multilingual Encoders. - Shuming Ma; Li Dong 004; Shaohan Huang; Dongdong Zhang 001; Alexandre Muzio; Saksham Singhal; Hany Hassan Awadalla; Xia Song; Furu Wei (CoRR, 2021)

XLM-E: Cross-lingual Language Model Pre-training via ELECTRA. - Zewen Chi; Shaohan Huang; Li Dong 004; Shuming Ma; Saksham Singhal; Payal Bajaj; Xia Song; Furu Wei (CoRR, 2021)

XLM-E: Cross-lingual Language Model Pre-training via ELECTRA. - Zewen Chi; Shaohan Huang; Li Dong 004; Shuming Ma; Bo Zheng 010; Saksham Singhal; Payal Bajaj; Xia Song; Xian-Ling Mao; Heyan Huang; Furu Wei (ACL (1), 2022)

Bootstrapping a high quality multilingual multimodal dataset for Bletchley. - Owais Khan Mohammed; Kriti Aggarwal; Qiang Liu; Saksham Singhal; Johan Bjorck; Subhojit Som (ACML, 2022)

On the Representation Collapse of Sparse Mixture of Experts. - Zewen Chi; Li Dong 004; Shaohan Huang; Damai Dai; Shuming Ma; Barun Patra; Saksham Singhal; Payal Bajaj; Xia Song; Xian-Ling Mao; Heyan Huang; Furu Wei (NeurIPS, 2022)

On the Representation Collapse of Sparse Mixture of Experts. - Zewen Chi; Li Dong 004; Shaohan Huang; Damai Dai; Shuming Ma; Barun Patra; Saksham Singhal; Payal Bajaj; Xia Song; Furu Wei (CoRR, 2022)

Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Tasks. - Wenhui Wang 003; Hangbo Bao; Li Dong 004; Johan Bjorck; Zhiliang Peng; Qiang Liu; Kriti Aggarwal; Owais Khan Mohammed; Saksham Singhal; Subhojit Som; Furu Wei (CoRR, 2022)

Foundation Transformers. - Hongyu Wang 009; Shuming Ma; Shaohan Huang; Li Dong 004; Wenhui Wang 003; Zhiliang Peng; Yu Wu; Payal Bajaj; Saksham Singhal; Alon Benhaim; Barun Patra; Zhun Liu; et al. (CoRR, 2022)

Beyond English-Centric Bitexts for Better Multilingual Language Representation Learning. - Barun Patra; Saksham Singhal; Shaohan Huang; Zewen Chi; Li Dong 004; Furu Wei; Vishrav Chaudhary; Xia Song (ACL (1), 2023)

Image as a Foreign Language: BEIT Pretraining for Vision and Vision-Language Tasks. - Wenhui Wang 003; Hangbo Bao; Li Dong 004; Johan Bjorck; Zhiliang Peng; Qiang Liu; Kriti Aggarwal; Owais Khan Mohammed; Saksham Singhal; Subhojit Som; Furu Wei (CVPR, 2023)

Magneto: A Foundation Transformer. - Hongyu Wang 009; Shuming Ma; Shaohan Huang; Li Dong 004; Wenhui Wang 003; Zhiliang Peng; Yu Wu; Payal Bajaj; Saksham Singhal; Alon Benhaim; Barun Patra; Zhun Liu; et al. (ICML, 2023)

Language Is Not All You Need: Aligning Perception with Language Models. - Shaohan Huang; Li Dong 004; Wenhui Wang 003; Yaru Hao; Saksham Singhal; Shuming Ma; Tengchao Lv; Lei Cui 001; Owais Khan Mohammed; Barun Patra; Qiang Liu; Kriti Aggarwal; et al. (NeurIPS, 2023)

On the Adaptation of Unlimiformer for Decoder-Only Transformers. - Kian Ahrabian; Alon Benhaim; Barun Patra; Jay Pujara; Saksham Singhal; Xia Song (LREC/COLING, 2024)

Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAs. - Abdelrahman Abouelenin; Atabak Ashfaq; Adam Atkinson; Hany Awadalla; Nguyen Bach; Jianmin Bao; Alon Benhaim; Martin Cai; Vishrav Chaudhary; Congcong Chen; Dong Chen 003; Dongdong Chen 001; et al. (CoRR, 2025)