Simple Local Attentions Remain Competitive for Long-Context Tasks. - Wenhan Xiong; Barlas Oguz; Anchit Gupta; Xilun Chen 002; Diana Liskovich; Omer Levy; Scott Yih; Yashar Mehdad (NAACL-HLT, 2022)

A Theory on Adam Instability in Large-Scale Machine Learning. - Igor Molybog; Peter Albert; Moya Chen; Zachary DeVito; David Esiobu; Naman Goyal 001; Punit Singh Koura; Sharan Narang; Andrew Poulton; Ruan Silva; Binh Tang; Diana Liskovich; et al. (CoRR, 2023)

Llama 2: Open Foundation and Fine-Tuned Chat Models. - Hugo Touvron; Louis Martin; Kevin Stone; Peter Albert; Amjad Almahairi; Yasmine Babaei; Nikolay Bashlykov; Soumya Batra; Prajjwal Bhargava; Shruti Bhosale; Dan Bikel; Lukas Blecher; et al. (CoRR, 2023)

LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding. - Mostafa Elhoushi; Akshat Shrivastava; Diana Liskovich; Basil Hosmer; Bram Wasti; Liangzhen Lai; Anas Mahmoud 002; Bilge Acun; Saurabh Agarwal; Ahmed Roman; Ahmed A Aly; Beidi Chen; et al. (ACL (1), 2024)