Context Parallelism for Scalable Million-Token Inference. - Amy Yang; Jingyi Yang; Aya Ibrahim; Xinfeng Xie; Bangsheng Tang; Grigory Sizov; Jeremy Reizenstein; Jongsoo Park; Jianyu Huang (CoRR, 2024)

Efficient Speculative Decoding for Llama at Scale: Challenges and Solutions. - Bangsheng Tang; Carl Chengyan Fu; Fei Kou; Grigory Sizov; Haoci Zhang; Jason Park; Jiawen Liu; Jie You; Qirui Yang; Sachin Mehta; Shengyong Cai; Xiaodong Wang; et al. (CoRR, 2025)