Adversarial Contrastive Pre-training for Protein Sequences. - Matthew B. A. McDermott; Brendan Yap; Tzu-Ming Harry Hsu; Di Jin; Peter Szolovits (CoRR, 2021)

Rethinking Relational Encoding in Language Model: Pre-Training for General Sequences. - Matthew B. A. McDermott; Brendan Yap; Peter Szolovits; Marinka Zitnik (CoRR, 2021)

Structure-inducing pre-training. - Matthew B. A. McDermott; Brendan Yap; Peter Szolovits; Marinka Zitnik (Nat. Mac. Intell., 2023)