Rulin Shao

According to our database, Rulin Shao authored at least 14 papers between 2019 and 2024.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2024

Language models scale reliably with over-training and on downstream tasks.

Samir Yitzhak Gadre, Georgios Smyrnis, Vaishaal Shankar, Suchin Gururangan, Mitchell Wortsman, Rulin Shao, Jean Mercat, Alex Fang, Jeffrey Li, Sedrick Keh, Rui Xin, Marianna Nezhurina, Igor Vasiljevic, Jenia Jitsev, Alexandros G. Dimakis, Gabriel Ilharco, Shuran Song, Thomas Kollar, Yair Carmon, Achal Dave, Reinhard Heckel, Niklas Muennighoff, Ludwig Schmidt

CoRR, 2024

Vision-Flan: Scaling Human-Labeled Tasks in Visual Instruction Tuning.

Zhiyang Xu, Chao Feng, Rulin Shao, Trevor Ashby, Ying Shen, Di Jin, Yu Cheng, Qifan Wang, Lifu Huang

CoRR, 2024

2023

LightSeq: Sequence Level Parallelism for Distributed Training of Long Context Transformers.

Dacheng Li, Rulin Shao, Anze Xie, Eric P. Xing, Joseph E. Gonzalez, Ion Stoica, Xuezhe Ma, Hao Zhang

CoRR, 2023

VisIT-Bench: A Benchmark for Vision-Language Instruction Following Inspired by Real-World Use.

Yonatan Bitton, Hritik Bansal, Jack Hessel, Rulin Shao, Wanrong Zhu, Anas Awadalla, Josh Gardner, Rohan Taori, Ludwig Schmidt

CoRR, 2023

VisIT-Bench: A Dynamic Benchmark for Evaluating Instruction-Following Vision-and-Language Models.

Yonatan Bitton, Hritik Bansal, Jack Hessel, Rulin Shao, Wanrong Zhu, Anas Awadalla, Josh Gardner, Rohan Taori, Ludwig Schmidt

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

MPCFORMER: Fast, Performant and Provate Transformer Inference with MPC.

Dacheng Li, Hongyi Wang, Rulin Shao, Han Guo, Eric P. Xing, Hao Zhang

Proceedings of the Eleventh International Conference on Learning Representations, 2023

Cross-modal Attention Congruence Regularization for Vision-Language Relation Alignment.

Rohan Pandey, Rulin Shao, Paul Pu Liang, Ruslan Salakhutdinov, Louis-Philippe Morency

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2023

2022

On the Adversarial Robustness of Vision Transformers.

Rulin Shao, Zhouxing Shi, Jinfeng Yi, Pin-Yu Chen, Cho-Jui Hsieh

Trans. Mach. Learn. Res., 2022

MPCFormer: fast, performant and private Transformer inference with MPC.

Dacheng Li, Rulin Shao, Hongyi Wang, Han Guo, Eric P. Xing, Hao Zhang

CoRR, 2022

Robust Text CAPTCHAs Using Adversarial Examples.

Rulin Shao, Zhouxing Shi, Jinfeng Yi, Pin-Yu Chen, Cho-Jui Hsieh

Proceedings of the IEEE International Conference on Big Data, 2022

2021

How and When Adversarial Robustness Transfers in Knowledge Distillation?

Rulin Shao, Jinfeng Yi, Pin-Yu Chen, Cho-Jui Hsieh

CoRR, 2021

On the Adversarial Robustness of Visual Transformers.

Rulin Shao, Zhouxing Shi, Jinfeng Yi, Pin-Yu Chen, Cho-Jui Hsieh

CoRR, 2021

2019

Stochastic Channel-Based Federated Learning for Medical Data Privacy Preserving.

Rulin Shao, Hongyu He, Hui Liu, Dianbo Liu

CoRR, 2019

Privacy Preserving Stochastic Channel-Based Federated Learning with Neural Network Pruning.

Rulin Shao, Hui Liu, Dianbo Liu

CoRR, 2019