On the Convergence of Policy Iteration in Stationary Dynamic Programming. - Martin L. Puterman; Shelby L. Brumelle (Math. Oper. Res., 1979)

Action Elimination Procedures for Modified Policy Iteration Algorithms. - Martin L. Puterman; Moon Chirl Shin (Oper. Res., 1982)

Iterative Aggregation-Disaggregation Procedures for Discounted Semi-Markov Reward Processes. - Paul J. Schweitzer; Martin L. Puterman; Kyle W. Kindle (Oper. Res., 1985)

On the Convergence of Policy Iteration in Finite State Undiscounted Markov Decision Processes: The Unichain Case. - Arie Hordijk; Martin L. Puterman (Math. Oper. Res., 1987)

Estimating the value of a discounted reward process. - Moshe Haviv; Martin L. Puterman (Oper. Res. Lett., 1992)

Markov Decision Processes: Discrete Stochastic Dynamic Programming - Martin L. Puterman (Wiley, 1994)

Process-Oriented Planning and Average-Reward Optimality. - Craig Boutilier; Martin L. Puterman (IJCAI, 1995)

Play It Again, Sam? Optimal Replacement Policies for a Motion Picture Exhibitor. - Sanjeev Swami; Martin L. Puterman; Charles B. Weinberg (Manuf. Serv. Oper. Manag., 2001)

A probabilistic analysis of bias optimality in unichain Markov decision processes. - Mark E. Lewis; Martin L. Puterman (IEEE Trans. Autom. Control., 2001)

The Censored Newsvendor and the Optimal Acquisition of Information. - Xiaomei Ding; Martin L. Puterman; Arnab Bisi (Oper. Res., 2002)

Dynamic pricing and reinforcement learning. - Alexandre X. Carvalho; Martin L. Puterman (IJCNN, 2003)

Early Detection of High-Risk Claims at the Workers' Compensation Board of British Columbia. - Ernest Urbanovich; Ella E. Young; Martin L. Puterman; Sidney O. Fattedad (Interfaces, 2003)

Coffee, Tea, or ...?: A Markov Decision Process Model for Airline Meal Provisioning. - Jason H. Goto; Mark E. Lewis; Martin L. Puterman (Transp. Sci., 2004)

Response. - Xiaomei Ding; Arnab Bisi; Martin L. Puterman (Oper. Res., 2005)

Improving resource utilization for diagnostic services through flexible inpatient scheduling: A method for improving resource utilization. - Jonathan Patrick; Martin L. Puterman (J. Oper. Res. Soc., 2007)

Four Canadian Contributions to Stochastic Modeling. - Winfried K. Grassmann; Martin L. Puterman; Pierre L'Ecuyer; Armann Ingolfsson (INFOR Inf. Syst. Oper. Res., 2008)

Dynamic Multipriority Patient Scheduling for a Diagnostic Resource. - Jonathan Patrick; Martin L. Puterman; Maurice Queyranne (Oper. Res., 2008)

Dynamic Programming. - Martin L. Puterman; Jonathan Patrick (Encyclopedia of Machine Learning, 2010)

Dynamic multi-appointment patient scheduling for radiation therapy. - Antoine Sauré; Jonathan Patrick; Scott Tyldesley; Martin L. Puterman (Eur. J. Oper. Res., 2012)

A Simulation Optimization Approach to Long-Term Care Capacity Planning. - Yue Zhang 023; Martin L. Puterman; Matthew Nelson; Derek R. Atkins (Oper. Res., 2012)

Self and social optimization in multi-class multi-server queueing systems with relative priorities. - Binyamin Oz; Moshe Haviv; Martin L. Puterman (NetGCooP, 2014)

The Appointment Scheduling Game. - Antoine Sauré; Martin L. Puterman (INFORMS Trans. Educ., 2014)

Technical Note - Trading Off Quick versus Slow Actions in Optimal Search. - Steven M. Shechter; Farhad Ghassemi; Yasin Gocgun; Martin L. Puterman (Oper. Res., 2015)

The advantage of relative priority regimes in multi-class multi-server queueing systems with strategic customers. - Binyamin Oz; Moshe Haviv; Martin L. Puterman (Oper. Res. Lett., 2017)

Dynamic Programming. - Martin L. Puterman; Jonathan Patrick (Encyclopedia of Machine Learning and Data Mining, 2017)

Queuing network models for panel sizing in oncology. - Peter T. Vanberkel; Nelly Litvak; Martin L. Puterman; Scott Tyldesley (Queueing Syst. Theory Appl., 2018)

Points Gained in Football: Using Markov Process-Based Value Functions to Assess Team Performance. - Timothy C. Y. Chan; Craig Fernandes; Martin L. Puterman (Oper. Res., 2021)