Eugene A. Feinberg

Orcid: 0000-0002-8263-0772

Affiliations:
  • Stony Brook University, USA


According to our database1, Eugene A. Feinberg authored at least 68 papers between 1991 and 2023.

Collaborative distances:

Timeline

Legend:

Book 
In proceedings 
Article 
PhD thesis 
Dataset
Other 

Links

Online presence:

On csauthors.net:

Bibliography

2023
Equivalent conditions for weak continuity of nonlinear filters.
Syst. Control. Lett., March, 2023

2022
CVaR Optimization for MDPs: Existence and Computation of Optimal Policies.
SIGMETRICS Perform. Evaluation Rev., August, 2022

Markov Decision Processes with Incomplete Information and Semiuniform Feller Transition Probabilities.
SIAM J. Control. Optim., August, 2022

Sufficiency of Markov Policies for Continuous-Time Jump Markov Decision Processes.
Math. Oper. Res., 2022

Kolmogorov's equations for jump Markov processes with unbounded jump rates.
Ann. Oper. Res., 2022

On the optimality equation for average cost Markov decision processes and its validity for inventory control.
Ann. Oper. Res., 2022

Structure of optimal policies to periodic-review inventory models with convex costs and backorders for all values of discount factors.
Ann. Oper. Res., 2022

Continuity of equilibria for two-person zero-sum games with noncompact action sets and unbounded payoffs.
Ann. Oper. Res., 2022

Probability methods in business and industry in honor of Benjamin Avi-Itzhak and Matthew J. Sobel.
Ann. Oper. Res., 2022

2021
MDPs with setwise continuous transition probabilities.
Oper. Res. Lett., 2021

A Class of Solvable Markov Decision Models with Incomplete Information.
Proceedings of the 2021 60th IEEE Conference on Decision and Control (CDC), 2021

2020
Complexity bounds for approximately solving discounted MDPs by value iterations.
Oper. Res. Lett., 2020

Constrained discounted Markov decision processes with Borel state spaces.
Autom., 2020

2019
Sufficiency of Deterministic Policies for Atomless Discounted and Uniformly Absorbing MDPs with Multiple Criteria.
SIAM J. Control. Optim., 2019

2018
An example showing that A-lower semi-continuity is essential for minimax continuity theorems.
Oper. Res. Lett., 2018

Reduction of total-cost and average-cost MDPs with weakly continuous transition probabilities to discounted MDPs.
Oper. Res. Lett., 2018

2017
Strongly Polynomial Algorithms for Transient and Average-Cost MDPs.
SIGMETRICS Perform. Evaluation Rev., 2017

On the average-cost optimality equations and convergence of discounted-cost relative value functions for inventory control problems with quasiconvex cost functions.
Proceedings of the 56th IEEE Annual Conference on Decision and Control, 2017

2016
Structure of Optimal Solutions to Periodic-Review Total-Cost Stochastic Inventory Control Problems.
SIGMETRICS Perform. Evaluation Rev., 2016

Optimal pricing for a GI/M/k/N queue with several customer types and holding costs.
Queueing Syst. Theory Appl., 2016

Partially Observable Total-Cost Markov Decision Processes with Weakly Continuous Transition Probabilities.
Math. Oper. Res., 2016

2014
Optimizing cloud utilization via switching decisions.
SIGMETRICS Perform. Evaluation Rev., 2014

Modified policy iteration algorithms are not strongly polynomial for discounted dynamic programming.
Oper. Res. Lett., 2014

The value iteration algorithm is not strongly polynomial for discounted dynamic programming.
Oper. Res. Lett., 2014

Convergence of value iterations for total-cost MDPs and POMDPs with general state and action sets.
Proceedings of the 2014 IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning, 2014

2013
Dynamic price optimization for an M/M/k/N queue with several customer types.
SIGMETRICS Perform. Evaluation Rev., 2013

Strong polynomiality of policy iterations for average-cost MDPs modeling replacement and maintenance problems.
Oper. Res. Lett., 2013

Variance minimization for constrained discounted continuous-time MDPs with exponentially distributed stopping times.
Ann. Oper. Res., 2013

The multi-armed bandit, with constraints.
Ann. Oper. Res., 2013

Sufficiency of Markov policies for continuous-time Markov decision processes and solutions to Kolmogorov's forward equation for jump Markov processes.
Proceedings of the 52nd IEEE Conference on Decision and Control, 2013

Optimality conditions for total-cost Partially Observable Markov Decision Processes.
Proceedings of the 52nd IEEE Conference on Decision and Control, 2013

Voltage and reactive power control using approximate stochastic annealing.
Proceedings of the 52nd IEEE Conference on Decision and Control, 2013

2012
Splitting in a finite Markov decision problem.
SIGMETRICS Perform. Evaluation Rev., 2012

Splitting Randomized Stationary Policies in Total-Reward Markov Decision Processes.
Math. Oper. Res., 2012

Average Cost Markov Decision Processes with Weakly Continuous Transition Probabilities.
Math. Oper. Res., 2012

2011
A rolling horizon approach to distribution feeder reconfiguration with switching costs.
Proceedings of the IEEE Second International Conference on Smart Grid Communications, 2011

Switching on and off the full capacity of an M/M/∞ queue.
Proceedings of the 50th IEEE Conference on Decision and Control and European Control Conference, 2011

2010
Compactness of the space of non-randomized policies in countable-state sequential decision processes.
Math. Methods Oper. Res., 2010

Optimal admission to an M/M/k/N queue with several customer types and holding costs.
Proceedings of the 49th IEEE Conference on Decision and Control, 2010

2009
Adaptive computation of optimal nonrandomized policies in constrained average-reward MDPs.
Proceedings of the IEEE Symposium on Adaptive Dynamic Programming and Reinforcement Learning, 2009

2008
On polynomial cases of the unichain classification problem for Markov Decision Processes.
Oper. Res. Lett., 2008

Polynomial classification algorithms for Markov decision processes.
Proceedings of the 47th IEEE Conference on Decision and Control, 2008

On occupation measures for total-reward MDPs.
Proceedings of the 47th IEEE Conference on Decision and Control, 2008

2007
Optimality Inequalities for Average Cost Markov Decision Processes and the Stochastic Cash Balance Problem.
Math. Oper. Res., 2007

Non-randomized policies for constrained Markov decision processes.
Math. Methods Oper. Res., 2007

2006
Non-randomized control of constrained Markov decision processes.
Proceedings of the American Control Conference, 2006

2005
Generalized Pinwheel Problem.
Math. Methods Oper. Res., 2005

On essential information in sequential decision processes.
Math. Methods Oper. Res., 2005

A continuous time markov decision process based on-chip buffer allocation methodology.
Proceedings of the 15th ACM Great Lakes Symposium on VLSI 2005, 2005

Buffer Insertion for Bridges and Optimal Buffer Sizing for Communication Sub-System of Systems-on-Chip.
Proceedings of the 2005 Design, 2005

On State Space Reduction in Sequential Decision Processes.
Proceedings of the 44th IEEE IEEE Conference on Decision and Control and 8th European Control Conference Control, 2005

Optimal Admission Control for a Markovian Queue Under the Quality of Service Constraint.
Proceedings of the 44th IEEE IEEE Conference on Decision and Control and 8th European Control Conference Control, 2005

2004
Continuous Time Discounted Jump Markov Decision Processes: A Discrete-Event Approach.
Math. Oper. Res., 2004

Optimality inequalities for average cost MDPs and their inventory control applications.
Proceedings of the 43rd IEEE Conference on Decision and Control, 2004

2003
Online scheduling: generalized pinwheel problem.
Proceedings of the 42nd IEEE Conference on Decision and Control, 2003

2002
Optimality of D-Policies for an M/G/1 Queue with a Removable Server.
Queueing Syst. Theory Appl., 2002

Optimal control of average reward constrained continuous-time finite Markov decision processes.
Proceedings of the 41st IEEE Conference on Decision and Control, 2002

2000
Constrained Discounted Markov Decision Processes and Hamiltonian Cycles.
Math. Oper. Res., 2000

A Note on the Existence of Optimal Policies in Total Reward Dynamic Programs with Compact Action Sets.
Math. Oper. Res., 2000

Nonatomic total rewards Markov decision processes with multiple criteria.
Proceedings of the 39th IEEE Conference on Decision and Control, 2000

1999
Constrained dynamic programming with two discount factors: applications and an algorithm.
IEEE Trans. Autom. Control., 1999

1996
Constrained Discounted Dynamic Programming.
Math. Oper. Res., 1996

Notes on equivalent stationary policies in Markov decision processes with total rewards.
Math. Methods Oper. Res., 1996

1995
Constrained Markov Decision Models with Weighted Discounted Rewards.
Math. Oper. Res., 1995

1994
Markov Decision Models with Weighted Discounted Criteria.
Math. Oper. Res., 1994

Constrained Semi-Markov decision processes with average rewards.
Math. Methods Oper. Res., 1994

1992
On Stationary Strategies in Borel Dynamic Programming.
Math. Oper. Res., 1992

1991
Non-randomized strategies in stochastic decision processes.
Ann. Oper. Res., 1991


  Loading...