GQKVA: Efficient Pre-training of Transformers by Grouping Queries, Keys, and Values. - Farnoosh Javadi; Walid Ahmed; Habib Hajimolahoseini; Foozhan Ataiefard; Mohammad Hassanpour; Saina Asani; Austin Wen; Omar Mohamed Awad; Kangling Liu; Yang Liu (CoRR, 2023)

SwiftLearn: A Data-Efficient Training Method of Deep Learning Models using Importance Sampling. - Habib Hajimolahoseini; Omar Mohamed Awad; Walid Ahmed; Austin Wen; Saina Asani; Mohammad Hassanpour; Farnoosh Javadi; Mehdi Ahmadi; Foozhan Ataiefard; Kangling Liu; Yang Liu (CoRR, 2023)

SkipViT: Speeding Up Vision Transformers with a Token-Level Skip Connection. - Foozhan Ataiefard; Walid Ahmed; Habib Hajimolahoseini; Saina Asani; Farnoosh Javadi; Mohammad Hassanpour; Omar Mohamed Awad; Austin Wen; Kangling Liu; Yang Liu (CoRR, 2024)