Shengyi Huang

According to our database, Shengyi Huang authored at least 20 papers between 2019 and 2025.

Collaborative distances:

• Dijkstra number of four.
• Erdős number of four.

2025

Part I: Tricks or Traps? A Deep Dive into RL for LLM Reasoning.

Zihe Liu, Jiashun Liu, Yancheng He, Weixun Wang, Jiaheng Liu, Ling Pan, Xinyu Hu, Shaopan Xiong, Ju Huang, Jian Hu, Shengyi Huang, Siran Yang, Jiamang Wang, Wenbo Su, Bo Zheng

CoRR, August, 2025

Generalizing Verifiable Instruction Following.

Valentina Pyatkin, Saumya Malik, Victoria Graf, Hamish Ivison, Shengyi Huang, Pradeep Dasigi, Nathan Lambert, Hannaneh Hajishirzi

CoRR, July, 2025

2 OLMo 2 Furious.

Team OLMo, Pete Walsh, Luca Soldaini, Dirk Groeneveld, Kyle Lo, Shane Arora, Akshita Bhagia, Yuling Gu, Shengyi Huang, Matt Jordan, Nathan Lambert, Dustin Schwenk, Oyvind Tafjord, Taira Anderson, David Atkinson, Faeze Brahman, Christopher Clark, Pradeep Dasigi, Nouha Dziri, Michal Guerquin, Hamish Ivison, Pang Wei Koh, Jiacheng Liu, Saumya Malik, William Merrill, Lester James V. Miranda, Jacob Morrison, Tyler Murray, Crystal Nam, Valentina Pyatkin, Aman Rangapur, Michael Schmitz, Sam Skjonsberg, David Wadden, Christopher Wilhelm, Michael Wilson, Luke Zettlemoyer, Ali Farhadi, Noah A. Smith, Hannaneh Hajishirzi

CoRR, January, 2025

Asynchronous RLHF: Faster and More Efficient Off-Policy RL for Language Models.

Michael Noukhovitch, Shengyi Huang, Sophie Xhonneux, Arian Hosseini, Rishabh Agarwal, Aaron C. Courville

Proceedings of the Thirteenth International Conference on Learning Representations, 2025

2024

TÜLU 3: Pushing Frontiers in Open Language Model Post-Training.

Nathan Lambert, Jacob Morrison, Valentina Pyatkin, Shengyi Huang, Hamish Ivison, Faeze Brahman, Lester James V. Miranda, Alisa Liu, Nouha Dziri, Shane Lyu, Yuling Gu, Saumya Malik, Victoria Graf, Jena D. Hwang, Jiangjiang Yang, Ronan Le Bras, Oyvind Tafjord, Chris Wilhelm, Luca Soldaini, Noah A. Smith, Yizhong Wang, Pradeep Dasigi, Hannaneh Hajishirzi

CoRR, 2024

The N+ Implementation Details of RLHF with PPO: A Case Study on TL;DR Summarization.

Shengyi Huang, Michael Noukhovitch, Arian Hosseini, Kashif Rasul, Weixun Wang, Lewis Tunstall

CoRR, 2024

Open RL Benchmark: Comprehensive Tracked Experiments for Reinforcement Learning.

Shengyi Huang, Quentin Gallouédec, Florian Felten, Antonin Raffin, Rousslan Fernand Julien Dossa, Yanxiao Zhao, Ryan Sullivan, Viktor Makoviychuk, Denys Makoviichuk, Mohamad H. Danesh, Cyril Roumégous, Jiayi Weng, Chufan Chen, Md Masudur Rahman, João G. M. Araújo, Guorui Quan, Daniel Tan, Timo Klein, Rujikorn Charakorn, Mark Towers, Yann Berthelot, Kinal Mehta, Dipam Chakraborty, Arjun KG, Valentin Charraut, Chang Ye, Zichen Liu, Lucas N. Alegre, Alexander Nikulin, Xiao Hu, Tianlin Liu, Jongwook Choi, Brent Yi

CoRR, 2024

Cleanba: A Reproducible and Efficient Distributed Reinforcement Learning Platform.

Shengyi Huang, Jiayi Weng, Rujikorn Charakorn, Min Lin, Zhongwen Xu, Santiago Ontañón

Proceedings of the Twelfth International Conference on Learning Representations, 2024

2023

Zephyr: Direct Distillation of LM Alignment.

Lewis Tunstall, Edward Beeching, Nathan Lambert, Nazneen Rajani, Kashif Rasul, Younes Belkada, Shengyi Huang, Leandro von Werra, Clémentine Fourrier, Nathan Habib, Nathan Sarrazin, Omar Sanseviero, Alexander M. Rush, Thomas Wolf

CoRR, 2023

Reward Scale Robustness for Proximal Policy Optimization via DreamerV3 Tricks.

Ryan Sullivan, Akarsh Kumar, Shengyi Huang, John P. Dickerson, Joseph Suarez

Proceedings of the Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, 2023

2022

CleanRL: High-quality Single-file Implementations of Deep Reinforcement Learning Algorithms.

Shengyi Huang, Rousslan Fernand Julien Dossa, Chang Ye, Jeff Braga, Dipam Chakraborty, Kinal Mehta, João G. M. Araújo

J. Mach. Learn. Res., 2022

A2C is a special case of PPO.

Shengyi Huang, Anssi Kanervisto, Antonin Raffin, Weixun Wang, Santiago Ontañón, Rousslan Fernand Julien Dossa

CoRR, 2022

EnvPool: A Highly Parallel Reinforcement Learning Environment Execution Engine.

Jiayi Weng, Min Lin, Shengyi Huang, Bo Liu, Denys Makoviichuk, Viktor Makoviychuk, Zichen Liu, Yufan Song, Ting Luo, Yukun Jiang, Zhongwen Xu, Shuicheng Yan

Proceedings of the Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, 2022

A Closer Look at Invalid Action Masking in Policy Gradient Algorithms.

Shengyi Huang, Santiago Ontañón

Proceedings of the Thirty-Fifth International Florida Artificial Intelligence Research Society Conference, 2022

2021

CleanRL: High-quality Single-file Implementations of Deep Reinforcement Learning Algorithms.

Shengyi Huang, Rousslan Fernand Julien Dossa, Chang Ye, Jeff Braga

CoRR, 2021

An Empirical Investigation of Early Stopping Optimizations in Proximal Policy Optimization.

Rousslan Fernand Julien Dossa, Shengyi Huang, Santiago Ontañón, Takashi Matsubara

IEEE Access, 2021

Gym-µRTS: Toward Affordable Full Game Real-time Strategy Games Research with Deep Reinforcement Learning.

Shengyi Huang, Santiago Ontañón, Chris Bamford, Lukasz Grela

Proceedings of the 2021 IEEE Conference on Games (CoG), 2021

2020

Griddly: A platform for AI research in games.

Chris Bamford, Shengyi Huang, Simon M. Lucas

CoRR, 2020

Action Guidance: Getting the Best of Sparse Rewards and Shaped Rewards for Real-time Strategy Games.

Shengyi Huang, Santiago Ontañón

CoRR, 2020

2019

Comparing Observation and Action Representations for Deep Reinforcement Learning in MicroRTS.

Shengyi Huang, Santiago Ontañón

CoRR, 2019