Sine Activated Low-Rank Matrices for Parameter Efficient Learning. - Yiping Ji; Hemanth Saratchandran; Cameron Gordon; Zeyu Zhang 006; Simon Lucey (CoRR, 2024)

Rethinking Softmax: Self-Attention with Polynomial Activations. - Hemanth Saratchandran; Jianqiao Zheng; Yiping Ji; Wenbo Zhang; Simon Lucey (CoRR, 2024)

Efficient Learning with Sine-Activated Low-Rank Matrices. - Yiping Ji; Hemanth Saratchandran; Cameron Gordon; Zeyu Zhang 006; Simon Lucey (ICLR, 2025)

Always Skip Attention. - Yiping Ji; Hemanth Saratchandran; Peyman Moghaddam; Simon Lucey (CoRR, 2025)

Compressing Sine-Activated Low-Rank Adapters through Post-Training Quantization. - Cameron Gordon; Yiping Ji; Hemanth Saratchandran; Paul Albert; Simon Lucey (CoRR, 2025)