ETC: Encoding Long and Structured Inputs in Transformers. - Joshua Ainslie; Santiago Ontañón; Chris Alberti; Vaclav Cvicek; Zachary Fisher; Philip Pham; Anirudh Ravula; Sumit Sanghai; Qifan Wang 001; Li Yang (EMNLP (1), 2020)

Neural Structured Learning: Training Neural Networks with Structured Signals. - Arjun Gopalan; Da-Cheng Juan; Cesar Ilharco Magalhaes; Chun-Sung Ferng; Allan Heydon; Chun-Ta Lu; Philip Pham; George Yu (KDD, 2020)

Fair Hierarchical Clustering. - Sara Ahmadian; Alessandro Epasto; Marina Knittel; Ravi Kumar 001; Mohammad Mahdian; Benjamin Moseley; Philip Pham; Sergei Vassilvitskii; Yuyan Wang (NeurIPS, 2020)

Big Bird: Transformers for Longer Sequences. - Manzil Zaheer; Guru Guruganesh; Kumar Avinava Dubey; Joshua Ainslie; Chris Alberti; Santiago Ontañón; Philip Pham; Anirudh Ravula; Qifan Wang 001; Li Yang; Amr Ahmed 001 (NeurIPS, 2020)

ETC: Encoding Long and Structured Data in Transformers. - Joshua Ainslie; Santiago Ontañón; Chris Alberti; Philip Pham; Anirudh Ravula; Sumit Sanghai (CoRR, 2020)

Long Range Arena : A Benchmark for Efficient Transformers. - Yi Tay; Mostafa Dehghani 001; Samira Abnar; Yikang Shen; Dara Bahri; Philip Pham; Jinfeng Rao; Liu Yang; Sebastian Ruder; Donald Metzler (ICLR, 2021)

OmniNet: Omnidirectional Representations from Transformers. - Yi Tay; Mostafa Dehghani 001; Vamsi Aribandi; Jai Prakash Gupta 001; Philip Pham; Zhen Qin 001; Dara Bahri; Da-Cheng Juan; Donald Metzler (ICML, 2021)

ReadTwice: Reading Very Large Documents with Memories. - Yury Zemlyanskiy; Joshua Ainslie; Michiel de Jong; Philip Pham; Ilya Eckstein; Fei Sha (NAACL-HLT, 2021)

Neural Structured Learning: Training Neural Networks with Structured Signals. - Arjun Gopalan; Da-Cheng Juan; Cesar Ilharco Magalhaes; Chun-Sung Ferng; Allan Heydon; Chun-Ta Lu; Philip Pham; George Yu; Yicheng Fan; Yueqi Wang (WSDM, 2021)