Shanda Li

According to our database, Shanda Li authored at least 8 papers between 2021 and 2023.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2023

Functional Interpolation for Relative Positions Improves Long Context Transformers.

Shanda Li, Chong You, Guru Guruganesh, Joshua Ainslie, Santiago Ontañón, Manzil Zaheer, Sumit Sanghai, Yiming Yang, Sanjiv Kumar, Srinadh Bhojanapalli

CoRR, 2023

Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers.

Krzysztof Marcin Choromanski, Shanda Li, Valerii Likhosherstov, Kumar Avinava Dubey, Shengjie Luo, Di He, Yiming Yang, Tamás Sarlós, Thomas Weingarten, Adrian Weller

CoRR, 2023

Learning Physics-Informed Neural Networks without Stacked Back-propagation.

Di He, Shanda Li, Wenlei Shi, Xiaotian Gao, Jia Zhang, Jiang Bian, Liwei Wang, Tie-Yan Liu

Proceedings of the International Conference on Artificial Intelligence and Statistics, 2023

2022

Is L² Physics-Informed Loss Always Suitable for Training Physics-Informed Neural Network?

Chuwei Wang, Shanda Li, Di He, Liwei Wang

CoRR, 2022

Is $L^2$ Physics Informed Loss Always Suitable for Training Physics Informed Neural Network?

Chuwei Wang, Shanda Li, Di He, Liwei Wang

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

Your Transformer May Not be as Powerful as You Expect.

Shengjie Luo, Shanda Li, Shuxin Zheng, Tie-Yan Liu, Liwei Wang, Di He

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

2021

Can Vision Transformers Perform Convolution?

Shanda Li, Xiangning Chen, Di He, Cho-Jui Hsieh

CoRR, 2021

Stable, Fast and Accurate: Kernelized Attention with Relative Positional Encoding.

Shengjie Luo, Shanda Li, Tianle Cai, Di He, Dinglan Peng, Shuxin Zheng, Guolin Ke, Liwei Wang, Tie-Yan Liu

Proceedings of the Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, 2021