On-line Scheduling via Sampling. - Hyeong Soo Chang; Robert Givan; Edwin K. P. Chong (AIPS, 2000)

A framework for simulation-based network control via hindsight optimization. - Edwin K. P. Chong; Robert Givan; Hyeong Soo Chang (CDC, 2000)

A model for multi-time scaled sequential decision making processes. - Hyeong Soo Chang; Pedram Jaefari Fard; Steven I. Marcus; Mark A. Shayman (CDC, 2002)

Receding horizon approach to Markov games for infinite horizon discounted cost. - Hyeong Soo Chang; Steven I. Marcus (CDC, 2002)

Scheduling Multiclass Packet Streams to Minimize Weighted Loss. - Robert Givan; Edwin K. P. Chong; Hyeong Soo Chang (Queueing Syst. Theory Appl., 2002)

A distributed algorithm for solving a class of multi-agent Markov decision problems. - Hyeong Soo Chang; Michael C. Fu 001 (CDC, 2003)

An asymptotically efficient algorithm for finite horizon stochastic dynamic programming problems. - Hyeong Soo Chang; Michael C. Fu 001; Steven I. Marcus (CDC, 2003)

On the use of flow migration for handling short-term overloads. - Kuo-Tung Kuo; Surapich Phuvoravan; Bobby Bhattacharjee; Richard J. La; Mark A. Shayman; Hyeong Soo Chang (GLOBECOM, 2003)

Parallelizing Parallel Rollout Algorithm for Solving Markov Decision Processes. - Seon Wook Kim; Hyeong Soo Chang (WOMPAT, 2003)

Multitime scale Markov decision processes. - Hyeong Soo Chang; Pedram Jaefari Fard; Steven I. Marcus; Mark A. Shayman (IEEE Trans. Autom. Control., 2003)

Two-person zero-sum Markov games: receding horizon approach. - Hyeong Soo Chang; Steven I. Marcus (IEEE Trans. Autom. Control., 2003)

An ant system approach to Markov decision processes. - Hyeong Soo Chang; Walter J. Gutjahr; Jihoon Yang; Sungyong Park (ACC, 2004)

Localization for a class of two-team zero-sum Markov games. - Hyeong Soo Chang; Michael C. Fu 001 (CDC, 2004)

An ant system based exploration-exploitation for reinforcement learning. - Hyeong Soo Chang (SMC (4), 2004)

An adaptation of particle swarm optimization for Markov decision processes. - Hyeong Soo Chang (SMC (2), 2004)

Parallel Rollout for Online Solution of Partially Observable Markov Decision Processes. - Hyeong Soo Chang; Robert Givan; Edwin K. P. Chong (Discret. Event Dyn. Syst., 2004)

Multi-policy iteration with a distributed voting. - Hyeong Soo Chang (Math. Methods Oper. Res., 2004)

On Solving Controlled Markov Set-Chains via Multi-Policy Improvement. - Hyeong Soo Chang; Edwin K. P. Chong (CDC/ECC, 2005)

Recursive Learning Automata for Control of Partially Observable Markov Decision Processes. - Hyeong Soo Chang; Michael C. Fu 001; Steven I. Marcus (CDC/ECC, 2005)

An ant system based multicasting in mobile ad hoc network. - Se-young Lee; Hyeong Soo Chang (Congress on Evolutionary Computation, 2005)

An Adaptive Sampling Algorithm for Solving Markov Decision Processes. - Hyeong Soo Chang; Michael C. Fu 001; Jiaqiao Hu; Steven I. Marcus (Oper. Res., 2005)

Error bounds for finite step approximations for solving infinite horizon controlled Markov set-chains. - Hyeong Soo Chang (IEEE Trans. Autom. Control., 2005)

Evolutionary policy iteration for solving Markov decision processes. - Hyeong Soo Chang; Hong-Gi Lee; Michael C. Fu 001; Steven I. Marcus (IEEE Trans. Autom. Control., 2005)

Reinforcement learning with supervision by combining multiple learnings and expert advices. - Hyeong Soo Chang (ACC, 2006)

Adversarial Multi-Armed Bandit Approach to Stochastic Optimization. - Hyeong Soo Chang; Michael C. Fu 001; Steven I. Marcus (CDC, 2006)

Advances in Dynamic Games, Applications to Economics, Finance, Optimization, and Stochastic Control: A.S. Nowak, K. Szajowski (Eds.); Birkhauser, Boston, 2005, ISBN 0-8176-4362-1. - Hyeong Soo Chang (Autom., 2006)

Converging Marriage in Honey-Bees Optimization and Application to Stochastic Dynamic Programming. - Hyeong Soo Chang (J. Glob. Optim., 2006)

Perfect information two-person zero-sum markov games with imprecise transition probabilities. - Hyeong Soo Chang (Math. Methods Oper. Res., 2006)

A Policy Improvement Method in Constrained Stochastic Dynamic Programming. - Hyeong Soo Chang (IEEE Trans. Autom. Control., 2006)

Adversarial multi-armed bandit approach to two-person zero-sum Markov games. - Hyeong Soo Chang; Michael C. Fu 001; Steven I. Marcus (CDC, 2007)

A survey of some simulation-based algorithms for Markov decision processes. - Hyeong Soo Chang; Michael C. Fu 001; Jiaqiao Hu; Steven I. Marcus (Commun. Inf. Syst., 2007)

A policy improvement method for constrained average Markov decision processes. - Hyeong Soo Chang (Oper. Res. Lett., 2007)

Solving Controlled Markov Set-Chains With Discounting via Multipolicy Improvement. - Hyeong Soo Chang; Edwin K. P. Chong (IEEE Trans. Autom. Control., 2007)

An Asymptotically Efficient Simulation-Based Algorithm for Finite Horizon Stochastic Dynamic Programming. - Hyeong Soo Chang; Michael C. Fu 001; Jiaqiao Hu; Steven I. Marcus (IEEE Trans. Autom. Control., 2007)

Recursive Learning Automata Approach to Markov Decision Processes. - Hyeong Soo Chang; Michael C. Fu 001; Jiaqiao Hu; Steven I. Marcus (IEEE Trans. Autom. Control., 2007)

A population-based cross-entropy method with dynamic sample allocation. - Jiaqiao Hu; Hyeong Soo Chang (CDC, 2008)

Finite-Step Approximation Error Bounds for Solving Average-Reward-Controlled Markov Set-Chains. - Hyeong Soo Chang (IEEE Trans. Autom. Control., 2008)

Converging Coevolutionary Algorithm for Two-Person Zero-Sum Discounted Markov Games With Perfect Information. - Hyeong Soo Chang (IEEE Trans. Autom. Control., 2008)

Decentralized Learning in Finite Markov Chains: Revisited. - Hyeong Soo Chang (IEEE Trans. Autom. Control., 2009)

An Approximate Stochastic Annealing algorithm for finite horizon Markov decision processes. - Jiaqiao Hu; Hyeong Soo Chang (CDC, 2010)

Adaptive Adversarial Multi-Armed Bandit Approach to Two-Person Zero-Sum Markov Games. - Hyeong Soo Chang; Jiaqiao Hu; Michael C. Fu 001; Steven I. Marcus (IEEE Trans. Autom. Control., 2010)

Dynamic sample budget allocation in model-based optimization. - Jiaqiao Hu; Hyeong Soo Chang; Michael C. Fu 001; Steven I. Marcus (J. Glob. Optim., 2011)

Approximate stochastic annealing for online control of infinite horizon Markov decision processes. - Jiaqiao Hu; Hyeong Soo Chang (Autom., 2012)

On the Probability of Correct Selection in Ordinal Comparison over Dynamic Networks. - Hyeong Soo Chang; Jiaqiao Hu (J. Optim. Theory Appl., 2012)

A policy iteration heuristic for constrained discounted controlled Markov Chains. - Hyeong Soo Chang (Optim. Lett., 2012)

A Stochastic Approximation Framework for a Class of Randomized Optimization Algorithms. - Jiaqiao Hu; Ping Hu; Hyeong Soo Chang (IEEE Trans. Autom. Control., 2012)

On functional equations for Kth best policies in Markov decision processes. - Hyeong Soo Chang (Autom., 2013)

Policy set iteration for Markov decision processes. - Hyeong Soo Chang (Autom., 2013)

An exact iterative search algorithm for constrained Markov decision processes. - Hyeong Soo Chang (Autom., 2014)

Value set iteration for Markov decision processes. - Hyeong Soo Chang (Autom., 2014)

Random search for constrained Markov decision processes with multi-policy improvement. - Hyeong Soo Chang (Autom., 2015)

Sleeping experts and bandits approach to constrained Markov decision processes. - Hyeong Soo Chang (Autom., 2016)

Value set iteration for two-person zero-sum Markov games. - Hyeong Soo Chang (Autom., 2017)

An Index-based Deterministic Asymptotically Optimal Algorithm for Constrained Multi-armed Bandit Problems. - Hyeong Soo Chang (CoRR, 2020)

An asymptotically optimal strategy for constrained multi-armed bandit problems. - Hyeong Soo Chang (Math. Methods Oper. Res., 2020)

An index-based deterministic convergent optimal algorithm for constrained multi-armed bandit problems. - Hyeong Soo Chang (Autom., 2021)

On Supervised Online Rolling-Horizon Control for Infinite-Horizon Discounted Markov Decision Processes. - Hyeong Soo Chang (IEEE Trans. Autom. Control., 2024)

Approximate Constrained Discounted Dynamic Programming With Uniform Feasibility and Optimality. - Hyeong Soo Chang (IEEE Trans. Autom. Control., 2025)

On the Convergence Rate of MCTS for the Optimal Value Estimation in Markov Decision Processes. - Hyeong Soo Chang (IEEE Trans. Autom. Control., 2025)