Technical Note - The Method of Successive Approximations and Markovian Decision Problems. - Arie Hordijk; Henk C. Tijms (Oper. Res., 1974)

Sensitive Optimality Criteria in Countable State Dynamic Programming. - Arie Hordijk; Karel Sladký (Math. Oper. Res., 1977)

Insensitivity for Stochastic Networks. - Arie Hordijk (Computer Performance and Reliability, 1983)

Constrained Undiscounted Stochastic Dynamic Programming. - Arie Hordijk; Lodewijk C. M. Kallenberg (Math. Oper. Res., 1984)

Discretization and Weak Convergence in Markov Decision Drift Processes. - Arie Hordijk; Frank A. Van der Duyn Schouten (Math. Oper. Res., 1984)

Transient policies in discrete dynamic programming: Linear programming including suboptimality tests and additional constraints. - Arie Hordijk; Lodewijk C. M. Kallenberg (Math. Program., 1984)

Markov Decision Drift Processes; Conditions for Optimality Obtained by Discretization. - Arie Hordijk; Frank A. Van der Duyn Schouten (Math. Oper. Res., 1985)

Approximating Sensitive Queueing Networks by Reversible Markov Chains. - Arie Hordijk; Ad Ridder (Computer Performance and Reliability, 1987)

On the Convergence of Policy Iteration in Finite State Undiscounted Markov Decision Processes: The Unichain Case. - Arie Hordijk; Martin L. Puterman (Math. Oper. Res., 1987)

Average, Sensitive and Blackwell Optimal Policies in Denumerable Markov Decision Chains with Unbounded Rewards. - Rommert Dekker; Arie Hordijk (Math. Oper. Res., 1988)

Recurrence Conditions for Average and Blackwell Optimality in Denumerable State Markov Decision Chains. - Rommert Dekker; Arie Hordijk (Math. Oper. Res., 1992)

Linear programming formulation of MDPs in countable state space: The multichain case. - Arie Hordijk; Jean B. Lasserre (Math. Methods Oper. Res., 1994)

Undiscounted Markov decision chains with partial information; an algorithm for computing a locally optimal periodic policy. - Arie Hordijk; J. A. Loeve (Math. Methods Oper. Res., 1994)

On the Relation Between Recurrence and Ergodicity Properties in Denumerable Markov Decision Chains. - Rommert Dekker; Arie Hordijk; F. M. Spieksma (Math. Oper. Res., 1994)

Zero-sum Markov games and worst-case optimal control of queueing systems. - Eitan Altman; Arie Hordijk (Queueing Syst. Theory Appl., 1995)

Time-discretization for controlled Markov processes. I. General approximation results. - Nico M. van Dijk; Arie Hordijk (Kybernetika, 1996)

Time-discretization for controlled Markov processes. II. A jump and diffusion application. - Nico M. van Dijk; Arie Hordijk (Kybernetika, 1996)

On the value function in constrained control of Markov chains. - Eitan Altman; Arie Hordijk; Lodewijk C. M. Kallenberg (Math. Methods Oper. Res., 1996)

Optimal service control against worst case admission policies: A multichained stochastic game. - Arie Hordijk; Olaf Passchier; Floske Spieksma (Math. Methods Oper. Res., 1997)

Contraction Conditions for Average and α-Discount Optimality in Countable State Markov Games with Unbounded Rewards. - Eitan Altman; Arie Hordijk; F. M. Spieksma (Math. Oper. Res., 1997)

Analysis of a finite-source customer assignment model with no state information. - Arie Hordijk; Anneke Loeve; Jeroen Tiggelman (Math. Methods Oper. Res., 1998)

Blackwell optimality in the class of all policies in Markov decision chains with a Borel state space and unbounded rewards. - Arie Hordijk; Alexander Yushkevich (Math. Methods Oper. Res., 1999)

Blackwell optimality in the class of stationary policies in Markov decision chains with a Borel state space and unbounded rewards. - Arie Hordijk; Alexander Yushkevich (Math. Methods Oper. Res., 1999)

Simplex convexity, with application to open loop stochastic control in networks. - Eitan Altman; Bruno Gaujal; Arie Hordijk (CDC, 2000)

Balanced sequences and optimal routing. - Eitan Altman; Bruno Gaujal; Arie Hordijk (J. ACM, 2000)

Multimodularity, Convexity, and Optimization Properties. - Eitan Altman; Bruno Gaujal; Arie Hordijk (Math. Oper. Res., 2000)

Optimal Open-Loop Control of Vacations, Polling and Service Assignment. - Eitan Altman; Bruno Gaujal; Arie Hordijk (Queueing Syst. Theory Appl., 2000)

Fluid approximation of a controlled multiclass tandem network. - A. Gajrat; Arie Hordijk (Queueing Syst. Theory Appl., 2000)

Admission control in stochastic event graphs. - Eitan Altman; Bruno Gaujal; Arie Hordijk (IEEE Trans. Autom. Control., 2000)

Bounds for Deterministic Periodic Routing Sequences. - Arie Hordijk; D. A. van der Laan (IPCO, 2001)

Performance bounds for queues via generating functions. - Arie Hordijk; Adam Shwartz (IEEE Trans. Autom. Control., 2001)

Regular Ordering and Applications in Control Policies. - Eitan Altman; Bruno Gaujal; Arie Hordijk (Discret. Event Dyn. Syst., 2002)

Discrete-Event Control of Stochastic Networks - Multimodularity and Regularity. - Eitan Altman; Bruno Gaujal; Arie Hordijk (Springer, 2003)

The unbalance and bounds on the average waiting time for periodic routing to one queue. - Arie Hordijk; Dinard van der Laan (Math. Methods Oper. Res., 2004)

Periodic routing to parallel queues and billiard sequences. - Arie Hordijk; Dinard van der Laan (Math. Methods Oper. Res., 2004)

Single-run gradient estimation via measure-valued differentiation. - Bernd Heidergott; Arie Hordijk (IEEE Trans. Autom. Control., 2004)

On the structure of the optimal server control for fluid networks. - S. Gajrat; Arie Hordijk (Math. Methods Oper. Res., 2005)

On the Average Waiting Time for Regular Routing to Deterministic Queues. - Arie Hordijk; Dinard van der Laan (Math. Oper. Res., 2005)

Measure-Valued Differentiation for Stationary Markov Chains. - Bernd Heidergott; Arie Hordijk; Heinz Weisshaupt (Math. Oper. Res., 2006)

Strong bounds on perturbations. - Bernd Heidergott; Arie Hordijk; Haralambie Leahu (Math. Methods Oper. Res., 2009)

Series Expansions for Continuous-Time Markov Processes. - Bernd Heidergott; Arie Hordijk; Nicole Leder (Oper. Res., 2010)

An Approximation Approach for the Deviation Matrix of Continuous-Time Markov Processes with Application to Markov Decision Theory. - Nicole Leder; Bernd Heidergott; Arie Hordijk (Oper. Res., 2010)

Perturbation analysis of waiting times in the G/G/1 queue. - Haralambie Leahu; Bernd Heidergott; Arie Hordijk (Discret. Event Dyn. Syst., 2013)

A Genetic Algorithm for Finding Good Balanced Sequences in a Customer Assignment Problem with no State Information. - Wim Hordijk; Arie Hordijk; Bernd Heidergott (Asia Pac. J. Oper. Res., 2015)