Train Big, Then Compress: Rethinking Model Size for Efficient Training and Inference of Transformers. - Zhuohan Li 001; Eric Wallace; Sheng Shen 001; Kevin Lin; Kurt Keutzer; Dan Klein 001; Joey Gonzalez (ICML, 2020)

GACT: Activation Compressed Training for Generic Network Architectures. - Xiaoxuan Liu; Lianmin Zheng; Dequan Wang; Yukuo Cen; Weize Chen; Xu Han 007; Jianfei Chen; Zhiyuan Liu 001; Jie Tang 001; Joey Gonzalez; Michael W. Mahoney; Alvin Cheung (ICML, 2022)

GACT: Activation Compressed Training for General Architectures. - Xiaoxuan Liu; Lianmin Zheng; Dequan Wang; Yukuo Cen; Weize Chen; Xu Han 007; Jianfei Chen; Zhiyuan Liu 001; Jie Tang 001; Joey Gonzalez; Michael W. Mahoney; Alvin Cheung (CoRR, 2022)