Aligning Language Models with Offline Reinforcement Learning from Human Feedback. - Jian Hu; Li Tao; June Yang; Chandler Zhou (CoRR, 2023)

MoE Parallel Folding: Heterogeneous Parallelism Mappings for Efficient Large-Scale MoE Model Training with Megatron Core. - Dennis Liu; Zijie Yan; Xin Yao; Tong Liu; Vijay Korthikanti; Evan Wu; Shiqing Fan; Gao Deng; Hongxiao Bai; Jianbin Chang; Ashwath Aithal; Michael Andersch; et al. (CoRR, 2025)