GroupBERT: Enhanced Transformer Architecture with Efficient Grouped Structures. - Ivan Chelombiev; Daniel Justus; Douglas Orr; Anastasia Dietrich; Frithjof Gressmann; Alexandros Koliousis; Carlo Luschi (CoRR, 2021)

Towards Structured Dynamic Sparse Pre-Training of BERT. - Anastasia Dietrich; Frithjof Gressmann; Douglas Orr; Ivan Chelombiev; Daniel Justus; Carlo Luschi (CoRR, 2021)